HI Michael,
For dirk that was a separate issue(grouping of records) in that also iam facing the memory issue,and in our case of querying on 10k xml's after creating collections also is taking huge memory as mentioned in my previous mail.
Waiting for your suggestions ,It would really help me in closing the issue as I am at a crucial stage of the project.
Thanks & Regards Sateesh.A
-----Original Message----- From: Michael Seiferle [mailto:ms@basex.org] Sent: Tuesday, August 21, 2012 1:52 PM To: sateesh Cc: basex-talk@mailman.uni-konstanz.de Subject: Re: [basex-talk] large number of xml files
Hi Sateesh,
is saw that you sent dirk an XQuery file, is it the same that takes that much memory? In case yes we will see if we can help with that :) Kind Regards Michael Am 20.08.2012 um 14:34 schrieb sateesh sateesh@intense.in:
Hi Michael,
I created the collection of 2k xml's as per your previous mail and tried executing the query,even though after creating the collection also the memory consumption is high(700MB of heap memory) and also it is taking 3 mins of time for processing.
Thanks & Regards Sateesh.A
-----Original Message----- From: Michael Seiferle [mailto:ms@basex.org] Sent: Monday, August 20, 2012 2:33 PM To: sateesh Cc: basex-talk@mailman.uni-konstanz.de Subject: Re: [basex-talk] large number of xml files
Sateesh,
sorry I totally overlooked your last email. I'll reply inline: Am 18.08.2012 um 08:58 schrieb "sateesh" sateesh@intense.in:
Hi Micheal,
I have tried to implemet your suggested changes , but I got struck as the 10k xml's which I have to query on comes from different folders,and also
one
more question is how do I create collections using the program before running the query.
XQuery at the moment has no possibility to create a collection on the fly, as such you would have to use our Java API [1] or Commandline API [2].
For creating a collection from different folders you would do as follows: create db myDB "path/to/files";
. creates the database coll with all documents found in the input
directory.
ADD TO target/ xmldir
. adds all files from the xmldir directory to the database in the
target path.
I hope this helps :-)
Kind Regards Michael
Thanks & Regards Sateesh.A
[1]
https://github.com/BaseXdb/basex-examples/blob/master/src/main/java/org/base
x/examples/query/CreateCollection.java [2] http://docs.basex.org/wiki/Commands