BaseX-Talk

basex-talk@mailman.uni-konstanz.de

4 participants
5268 discussions

bulk-load
by Tomaso Musitelli 04 Jul '11

04 Jul '11

Hello dear BaseX Team, I would like to load a big number of small documents in Basex. What I do is to use a little Java program: Context ctx = new Context(); new CreateDB("basex1").execute(ctx); new CreateIndex("fulltext").execute(ctx); System.err.println("\n* Show database information:"); System.err.print(new InfoDB().execute(ctx)); for( ... ) { new Add(somedata, miname, collection).execute(ctx); } I dont know if it is correct , efficient ? Do you have a notion of transaction, like begin/commit ? ( I did not see something like that) My concern is that it seems not to behave well when the number of documents goes big: (each doc is about 2500 bytes) 10000 => 54 seconds ; 5.4 millis / document 20000 => 202 s ; 10 ms 50000 => 862 s ; 17.2 ms And in fact I want to store more than 1 million! Actually is there a limit in size ? Is 1 million x 2.5Kb OK? Thank you very much Tomaso

2 1

API does not contain XQueryService interface
by Robby Pelssers 04 Jul '11

04 Jul '11

Hi all, I was trying to test some code I wrote for Sedna XML DB but I noticed that org.xmldb.api.modules.XQueryService is not part of the API. I checked EXIST and Sedna and both include this Service. Is there any particular reason why this not included by BaseX? Kind regards, Robby Pelssers

2 3

Frequently Updated XML files
by Eric Jones 03 Jul '11

03 Jul '11

Hello all, I am new to BaseX. I want to know how one handles frequently updated xml files. Do you have to monitor the file with a third party tool and upon change drop the file from BaseX and re-add it? Regards, Eric

4 6

FYI: basex_6.7-1_amd64.changes ACCEPTED into unstable
by Alexander Holupirek 02 Jul '11

02 Jul '11

From: Debian FTP Masters <ftpmaster(a)ftp-master.debian.org> Date: 2. Juli 2011 07:17:33 MESZ To: Alexander Holupirek <alex(a)holupirek.de>, tmancill(a)debian.org Subject: basex_6.7-1_amd64.changes ACCEPTED into unstable Accepted: basex_6.7-1.debian.tar.gz to main/b/basex/basex_6.7-1.debian.tar.gz basex_6.7-1.dsc to main/b/basex/basex_6.7-1.dsc basex_6.7-1_all.deb to main/b/basex/basex_6.7-1_all.deb basex_6.7.orig.tar.gz to main/b/basex/basex_6.7.orig.tar.gz Override entries for your package: basex_6.7-1.dsc - source database basex_6.7-1_all.deb - optional database Announcing to debian-devel-changes(a)lists.debian.org Thank you for your contribution to Debian.

1 0

Release BaseX 6.7
by Christian Grün 30 Jun '11

30 Jun '11

Hi all, once more, we are glad to announce a new version of BaseX. Beside continuous tweaks, fixes, minor changes and alignments with the XQuery 3.0 specification, it offers the following enhancements: Main Features: [ADD] Native EXPath Packaging system support: http://docs.basex.org/wiki/Packaging [ADD] Client/server event notification: http://docs.basex.org/wiki/Events [ADD] Persistent document index added to speed up access to large collections XQuery: [ADD] New database and full-text functions: http://docs.basex.org/wiki/Database_Functions http://docs.basex.org/wiki/Full-Text_Functions [ADD] Event function added to fire events [MOD] Index optimizations, better cost estimations Commands: [ADD] Glob syntax added to database commands: http://docs.basex.org/wiki/Commands [ADD] New commands added: REPLACE, RENAME, REPO DELETE/INSTALL/LIST, CREATE/DROP EVENT [MOD] BACKUP optimized, renamed to CREATE BACKUP Next, beside our local trainings, we are also offering a two- and three-day course on XML, XQuery and BaseX now in Germany's renowned LinuxHotel: http://www.linuxhotel.de/kurs/xquery/basex. We are looking forward to your feedback, have fun, Christian, BaseX Team

1 0

BaseX on Wikipedia
by Michael Seiferle 30 Jun '11

30 Jun '11

Dear List, BaseX is now on Wikipedia, we kindly encourage you to extend our article, contribute or provide valuable feedback. You can find the article here: http://en.wikipedia.org/wiki/BaseX If you look hard enough, you might even see a hint for the release date of our upcoming version, now that's peer pressure ;-). Kind regards Michael

1 0

Database format changed?
by Huib Verweij 30 Jun '11

30 Jun '11

Hi, we're getting this error [FODC0004] from our BaseX database out of the blue on our test machine. 14:25:38.236 [127.0.0.1:39513] QUERY(0) declare namespace lexus="http://www.mpi.nl/lat/lexus"; declare function lexus:lexicon($lexus as node()) as node()* { element lexicon { $lexus/lexicon/@*, $lexus/meta } }; let $id := 'uuid:0190305e-730b-4a39-b4c0-2962f09bc01d' let $lexus := collection('lexus')/lexus[@id eq $id] let $schema := $lexus/meta/schema return element result { $schema, lexus:lexicon($lexus) } OK 14:25:38.236 [127.0.0.1:39513] QUERY(0) OK 14:25:38.300 [127.0.0.1:39510] INIT(0) Error: Stopped at line 5, column 48: [FODC0004] The database format has changed; please create a new database. 14:25:38.300 [127.0.0.1:39510] CLOSE(0) OK AFAICT nothing has changed, nobody copied over database files or accessed the database through another interface or something like that. Any ideas on what can cause such a message? When was the last time the format did change? What can we do about it (other than do as it says, assuming it's not actually a feature)? Thanks, Huib Verweij.

3 2

Problems with bigger amounts of data
by Mathias K 28 Jun '11

28 Jun '11

Hello everyone! My name is Mathias. I'm using BaseX for an university project where we are creating a publication database. Right now we have 25 GB xml data spread over 180k documents. Ultimately I want to be able to perform Xquery searches on this data, possibly even full text. I'd like to know whether you think that BaseX is at all suitable for this amount of data. If yes, how would I add these files to the database optimally? If I use the BaseX GUI to add the folder an OutOfMemoryException is produced shortly after starting the process. Even providing more RAM (~7 GB via -Xmx7000M) only delays this. I haven't looked at the code but it appears as though all file contents are stored in RAM and are only written to hard disk at the end, which would at least explain the huge amounts of memory BaseX consumes. Since the GUI can't handle the files I wrote an importer myself which consecutively adds single files via the "Add" command. This seems to work without memory excess. However, it is taking ages to add all 180.000 files this way (several hours, haven't completed it yet). Maybe it's just further delaying the overflow since it's so slow. Also, this might just be my subjective feeling, but adding files seems to get slower as the database grows. Is there some kind of duplicate check going an that could be in the way? If yes, is there a way just to bulk insert all the data I got without checks? I'd be grateful for any thoughts on this! Thanks in advance, Mathias

2 4

Packaging API in BaseX
by Christian Grün 25 Jun '11

25 Jun '11

Dear all, we'd like to give you a preview on our upcoming EXPath Packaging API implementation, which will be released together with BaseX 6.7 next week: http://docs.basex.org/wiki/Packaging_API If you are curious enough, feel free to try our latest stable snapshot: http://files.basex.org/releases/latest/ Two example archives are found at: http://files.basex.org/xar/ Your feedback is valuable to us. If you come across any unexpected behavior, or if you have problems to get it work (..no matter if it's up to you or us..), please give us a note! Regarding the different versions of the Packaging Spec: we decided to only support the latest version (Candidate Module 11 November 2010, http://expath.org/spec/pkg), which means that out-of-dated xar archives need first to be updated. Have fun, Christian ___________________________ BaseX Team Christian Grün Uni KN, Box 188 78457 Konstanz, Germany http://www.basex.org

2 1

Running XQuery in oxygen or Eclipse with default (opened) collection
by Jan Vlčinský (CAD) 24 Jun '11

24 Jun '11

Hi I am currently trying to learn, how to use Oxygen and/or Eclipse to develop XQueries. For installation I followed just the instructions form wiki http://docs.basex.org/wiki/Integrating_oXygen and http://docs.basex.org/wiki/Integrating_Eclipse With Eclipse it worked for me a bit easier, the only problem I had was to specify in the code, what collection I am going to use as default one. My wish is that my xquery code does not have to refer explicitly to single collecion name (configuring collection name around the xquery is fine, but I want prevent having it in the xquery code itself). I did not find any method how to do this. With using explicit collection name in the xquery code it works well. I know I could employ some external parameter and use it to bear the name of the collection, but this is still not, what I would call "use the currently opened collection" and I do not like the fact, my code has to be modified for this purpose. With oxygen is the situation the same with the complication, it keeps asking for xml input, when I use XQuery Transformation - and that is not, what I need. Any advise? Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk