BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Out Of Memory
by Mansi Sheth 06 Jan '15

06 Jan '15

Hello, I have a use case, where I have to extract lots in information from each XML in each DB. Something like, attribute values of most of the nodes in an XML. For such, queries based goes Out Of Memory with below exception. I am giving it ~12GB of RAM on i7 processor. Well I can't complain here since I am most definitely asking for loads of data, but is there any way I can get these kinds of data successfully ? mansi-veracode:BigData mansiadmin$ ~/Downloads/basex/bin/basexhttp BaseX 8.0 beta b45c1e2 [Server] Server was started (port: 1984) HTTP Server was started (port: 8984) Exception in thread "qtp2068921630-18" java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1857) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2073) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:744) -- - Mansi

5 17

Python client and BaseX 8.0
by Marc van Grootel 06 Jan '15

06 Jan '15

Hi, Anyone using the python client. I used it before, I think it was with 7.9, where it was still working. But now on a recent snapshot I cannot get my example to work anymore. I will report to maintainer but I would like to know if anyone could confirm having difficulties too. Anything changed in the protocol? I'm running on Python 2.7.8 :: Anaconda 2.0.1 (x86_64), on Mac that is. The error message occurs when trying to set up a session: /Users/marcvangrootel/Dropbox/notebooks/BaseXClient.py in __init__(self, host, port, user, password, receive_bytes_encoding, send_bytes_encoding) 129 # evaluate success flag 130 if not self.server_response_success(): --> 131 raise IOError('Access Denied.') 132 133 def execute(self, com): IOError: Access Denied. Thanks, --Marc

4 9

What's the best way to do some qualitative benchmarking?
by Marc van Grootel 06 Jan '15

06 Jan '15

Hi, For a few new blog posts I'm working on some examples where I compare traditional XQuery code with an Origami example. I am not looking for scientific answers but I do want to be able to do a more or less fair comparison. I noticed that when running code from the GUI timings can be quite different from running basex. Currently I do something like basex -V example/foo.xq or basex -r10 -V example/foo.xq What would be a honest way of including timings in an article. It's mainly for a qualitative assessment and comparing a traditional solution with an Origami solution. What to look for in the breakdown between parsing/compiling/evaluating and printing. Tips? Thanks, and I hope you are all having a good Xmas break. --Marc

2 1

Design finding "almost" duplicate xml files
by Mansi Sheth 02 Jan '15

02 Jan '15

Hello, I am trying to come up with a design, which just before insert a xml file into database, will warn us, that there is almost an identical xml file (with different name and different size) already stored in the database. "Almost identical" would be based on few elements of xml file such as: <root> <A name=""> <B name=""> <C name=""/> <C name=""/> . . </B> </A> . . . </root> "A" and "B" from above snippet but different "C". Element "A" could be repeated 100s of time in single xml file. Any pointers ? - Mansi

2 3

Fwd: Error Undefined Schema Name While Using schema-element(xbrli:item)
by ankit kumar 31 Dec '14

31 Dec '14

Ankit Kumar ---------- Forwarded message ---------- From: ankit kumar <ankitforstudy(a)gmail.com> Date: Wed, Dec 31, 2014 at 2:10 PM Subject: Error Undefined Schema Name While Using schema-element(xbrli:item) To: christian.gruen(a)uni-konstanz.de, alexander.holupirek(a)uni-konstanz.de, cg(a)basex.org, ms(a)basex.org *I am trying to run this xquery script using base-x gui. But i am getting this error as show by gui* *"Undefined Schema name Q{**http://www.xbrl.org/2003/instance <http://www.xbrl.org/2003/instance>**}item" by schema-element(xbrli:item) function.* *Please help me out.* *declare namespace xfi = "http://www.xbrl.org/2008/function/instance <http://www.xbrl.org/2008/function/instance>";* *declare namespace xbrli="http://www.xbrl.org/2003/instance <http://www.xbrl.org/2003/instance>";* *declare function xfi:test($a as schema-element(xbrli:item)) { let $b := 1 return $a};let $context :=//*return //*/xfi:test(.)* Ankit Kumar

1 0

Performance and benchmark
by Florent Gallaire 29 Dec '14

29 Dec '14

Hello, I have evaluated XML databases for an important project, and I'm very happy with BaseX which has great fonctionnalities and is very easy to use. I'm now about deploying my project in production, so I have new questions. My database has 400 000 XML resource files for a total 2.4 Go size, so it should work fine (http://docs.basex.org/wiki/Statistics). 1) What are the CPU/RAM quantityies recommanded to use BaseX in production ? 2) Is there a benchmark to run to have an evaluation of the CPU/RAM quantities from a BaseX point of view ? 3) What about the JVM options ? In particular should I change the "-Xmx512m" default value ? What will be the best value ? 4) With my database, on a t2.micro EC2 instance (1 VCPU + 1 Go RAM), BaseX is unusable. On a powerful shared server (16 VCPU + 16 Go RAM) it works fine (until I exceed my 512Mb personal hosting limitation). On my shared server, a request like "curl 'http://mydomain/rest/database/file.xml?query=/a/direct/path' takes 1.5 second. It seems to me that it's a lot and should be faster as I give the good resource file and the complete path to BaseX, so there is no computation to do. What do you think about it ? 5) How many simultaneous requests can handle BaseXHTTP ? Best regards Florent -- FLOSS Engineer & Lawyer

3 6

element or attribute
by Florent Gallaire 29 Dec '14

29 Dec '14

Hello, When creating a XML file for usage as database with BaseX, is there some policy about when it's good to use an element and when it's good to use an attribut ? Cheers, Florent -- FLOSS Engineer & Lawyer

2 2

Reg : Multi Threading While Adding XMLS
by Chandrasekhar 28 Dec '14

28 Dec '14

Dear Christian We are adding the xml's to the collection database one by one(sequentially),For we are implemented multithreading concept to add the xml's to database,but at basex server level the server is adding the xmls sequentially. In our case we are opening the database and adding xmls,and also from that directory(which is having the xml's ) ,this directory can have the thousand's of xml's ,from this we need to add some particular xml's to the database, that's the reason we are adding one by one xml's to the database. Is their any way to achieve the multithreading to add xml's to database for improving the performence while adding the xml's to the database. Thanks Chandrasekhar The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.

1 0

Editor Background Color
by Alex R. Loayza 25 Dec '14

25 Dec '14

Hello, I’m new toBaseX, and I’m trying to customize the GUI, by changing the background color ofthe Editor panel. I always use dark themes in IDEs because brightwhites hurt my eyes. However,I’ve found no way to change that setting in Base X. The Options / Colorssetting in the main menu effects changes to panels other than the Editor. Is there away to customize this? Thank youvery much for any help, and especially for having built this great product andmaking it open source! Bestregards, Alex

3 5

Preparing for Origami 0.4: new blog post on HTML templating
by Marc van Grootel 24 Dec '14

24 Dec '14

Hi all, I am preparing for a new release for Origami[1]: 0.4. This will make it almost feature complete. I introduce the most important new function which helps to build an HTML view from HTML templates. An example is described in detail in a new blog post. See http://xokomola.com/2014/12/23/xquery-origami-3.html Merry Christmas, --Marc [1] https://github.com/xokomola/origami

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk