- BaseX-Talk - mailman.uni-konstanz.de

help
by Lusha Wang 07 Jul '11

07 Jul '11

Hello Everyone I am a newbie to baseX For the following xml, how can I select all the transactions with type udp. This command doesn't work: for $transation in doc('test')//transation where $transation/istype='udp' return <transation>{ $transation/@id }</transation> Thanks a million Serena Wang <root> <Journal> <Document id="1"> <Author name="do-not-reply%40domaintools.com" reputation="1.0"/> <Time>Sat, 1 May 2010 00:55:20 -0700 (PDT)</Time> <Entity> <URL>http%3A%2F%2Fwww.domaintools.com%2Fmark-alert%2F</URL> <Domain>mexicoisart.com</Domain> <IP>199.236.158.250</IP> </Entity> </Document> <Document id="2"> <Author name="apache%40den.giac.net+%28Apache%29" reputation="10.0"/> <Time>Sat, 1 May 2010 10:35:54 +0000 (UTC)</Time> <Entity> <URL>https%3A%2F%2Fisc.sans.org%2Fdiary.html%3Fstoryid%3D8605</URL> <IP>66.28.0.45</IP> </Entity> </Document> </Journal> <transactions> <transation id="56977"> <time>09 Sep 10 23:00:52</time> <istype type="type1"/> <src>10.8.124.143</src> <dst>66.28.0.45</dst> <status>INT</status> </transation> </transactions> <types> <type id="type1"> <name>udp</name> </type> </types> </root>

6 6

Database Limits
by Dave Glick 05 Jul '11

05 Jul '11

At one point in the past there were limits to how many unique element names could be stored/indexed in the database. We exceeded that limit for our documents and so to address the problem we started splitting out our data into multiple databases and using some hacky rewrites of the QueryContext class to work with them as if they were in one database. We haven't synced up in a while and the BaseX API and class structure has undergone some really good improvement in the meantime. I'm in the processing of revising how we interface with and use BaseX and would like to consider going back to a single database if possible. In general, the question is: does a limit to the number of unique element/attribute names still exist? If so, what is it? Time permitting (it appears you guys have been busy pushing out great new features recently) I think a Wiki page with a list of all limits on the database would be very helpful (I.e., limited to X number of elements, limited to Y number of attributes per element, limited to Z size on disk, etc.) Thanks! -- Dave Glick | dglick(a)dracorp.com<mailto:dglick@dracorp.com> | 703-299-0700 x212 Data Research and Analysis Corp. | www.dracorp.com<http://www.dracorp.com>

2 4

Collation
by Xavier-Laurent Salvador 05 Jul '11

05 Jul '11

Hello Guys, I'm trying to declare default collation in my prologue but whatever i write, the answer is always [XQST0038] Unknown collation Is there a documentation for BaseX reference ? Thank you for all your work, Salvador

2 1

bulk-load
by Tomaso Musitelli 04 Jul '11

04 Jul '11

Hello dear BaseX Team, I would like to load a big number of small documents in Basex. What I do is to use a little Java program: Context ctx = new Context(); new CreateDB("basex1").execute(ctx); new CreateIndex("fulltext").execute(ctx); System.err.println("\n* Show database information:"); System.err.print(new InfoDB().execute(ctx)); for( ... ) { new Add(somedata, miname, collection).execute(ctx); } I dont know if it is correct , efficient ? Do you have a notion of transaction, like begin/commit ? ( I did not see something like that) My concern is that it seems not to behave well when the number of documents goes big: (each doc is about 2500 bytes) 10000 => 54 seconds ; 5.4 millis / document 20000 => 202 s ; 10 ms 50000 => 862 s ; 17.2 ms And in fact I want to store more than 1 million! Actually is there a limit in size ? Is 1 million x 2.5Kb OK? Thank you very much Tomaso

2 1

API does not contain XQueryService interface
by Robby Pelssers 04 Jul '11

04 Jul '11

Hi all, I was trying to test some code I wrote for Sedna XML DB but I noticed that org.xmldb.api.modules.XQueryService is not part of the API. I checked EXIST and Sedna and both include this Service. Is there any particular reason why this not included by BaseX? Kind regards, Robby Pelssers

2 3

Frequently Updated XML files
by Eric Jones 03 Jul '11

03 Jul '11

Hello all, I am new to BaseX. I want to know how one handles frequently updated xml files. Do you have to monitor the file with a third party tool and upon change drop the file from BaseX and re-add it? Regards, Eric

4 6

FYI: basex_6.7-1_amd64.changes ACCEPTED into unstable
by Alexander Holupirek 02 Jul '11

02 Jul '11

From: Debian FTP Masters <ftpmaster(a)ftp-master.debian.org> Date: 2. Juli 2011 07:17:33 MESZ To: Alexander Holupirek <alex(a)holupirek.de>, tmancill(a)debian.org Subject: basex_6.7-1_amd64.changes ACCEPTED into unstable Accepted: basex_6.7-1.debian.tar.gz to main/b/basex/basex_6.7-1.debian.tar.gz basex_6.7-1.dsc to main/b/basex/basex_6.7-1.dsc basex_6.7-1_all.deb to main/b/basex/basex_6.7-1_all.deb basex_6.7.orig.tar.gz to main/b/basex/basex_6.7.orig.tar.gz Override entries for your package: basex_6.7-1.dsc - source database basex_6.7-1_all.deb - optional database Announcing to debian-devel-changes(a)lists.debian.org Thank you for your contribution to Debian.

1 0

Release BaseX 6.7
by Christian Grün 30 Jun '11

30 Jun '11

Hi all, once more, we are glad to announce a new version of BaseX. Beside continuous tweaks, fixes, minor changes and alignments with the XQuery 3.0 specification, it offers the following enhancements: Main Features: [ADD] Native EXPath Packaging system support: http://docs.basex.org/wiki/Packaging [ADD] Client/server event notification: http://docs.basex.org/wiki/Events [ADD] Persistent document index added to speed up access to large collections XQuery: [ADD] New database and full-text functions: http://docs.basex.org/wiki/Database_Functions http://docs.basex.org/wiki/Full-Text_Functions [ADD] Event function added to fire events [MOD] Index optimizations, better cost estimations Commands: [ADD] Glob syntax added to database commands: http://docs.basex.org/wiki/Commands [ADD] New commands added: REPLACE, RENAME, REPO DELETE/INSTALL/LIST, CREATE/DROP EVENT [MOD] BACKUP optimized, renamed to CREATE BACKUP Next, beside our local trainings, we are also offering a two- and three-day course on XML, XQuery and BaseX now in Germany's renowned LinuxHotel: http://www.linuxhotel.de/kurs/xquery/basex. We are looking forward to your feedback, have fun, Christian, BaseX Team

1 0

BaseX on Wikipedia
by Michael Seiferle 30 Jun '11

30 Jun '11

Dear List, BaseX is now on Wikipedia, we kindly encourage you to extend our article, contribute or provide valuable feedback. You can find the article here: http://en.wikipedia.org/wiki/BaseX If you look hard enough, you might even see a hint for the release date of our upcoming version, now that's peer pressure ;-). Kind regards Michael

1 0

Database format changed?
by Huib Verweij 30 Jun '11

30 Jun '11

Hi, we're getting this error [FODC0004] from our BaseX database out of the blue on our test machine. 14:25:38.236 [127.0.0.1:39513] QUERY(0) declare namespace lexus="http://www.mpi.nl/lat/lexus"; declare function lexus:lexicon($lexus as node()) as node()* { element lexicon { $lexus/lexicon/@*, $lexus/meta } }; let $id := 'uuid:0190305e-730b-4a39-b4c0-2962f09bc01d' let $lexus := collection('lexus')/lexus[@id eq $id] let $schema := $lexus/meta/schema return element result { $schema, lexus:lexicon($lexus) } OK 14:25:38.236 [127.0.0.1:39513] QUERY(0) OK 14:25:38.300 [127.0.0.1:39510] INIT(0) Error: Stopped at line 5, column 48: [FODC0004] The database format has changed; please create a new database. 14:25:38.300 [127.0.0.1:39510] CLOSE(0) OK AFAICT nothing has changed, nobody copied over database files or accessed the database through another interface or something like that. Any ideas on what can cause such a message? When was the last time the format did change? What can we do about it (other than do as it says, assuming it's not actually a feature)? Thanks, Huib Verweij.

3 2

Problems with bigger amounts of data
by Mathias K 28 Jun '11

28 Jun '11

Hello everyone! My name is Mathias. I'm using BaseX for an university project where we are creating a publication database. Right now we have 25 GB xml data spread over 180k documents. Ultimately I want to be able to perform Xquery searches on this data, possibly even full text. I'd like to know whether you think that BaseX is at all suitable for this amount of data. If yes, how would I add these files to the database optimally? If I use the BaseX GUI to add the folder an OutOfMemoryException is produced shortly after starting the process. Even providing more RAM (~7 GB via -Xmx7000M) only delays this. I haven't looked at the code but it appears as though all file contents are stored in RAM and are only written to hard disk at the end, which would at least explain the huge amounts of memory BaseX consumes. Since the GUI can't handle the files I wrote an importer myself which consecutively adds single files via the "Add" command. This seems to work without memory excess. However, it is taking ages to add all 180.000 files this way (several hours, haven't completed it yet). Maybe it's just further delaying the overflow since it's so slow. Also, this might just be my subjective feeling, but adding files seems to get slower as the database grows. Is there some kind of duplicate check going an that could be in the way? If yes, is there a way just to bulk insert all the data I got without checks? I'd be grateful for any thoughts on this! Thanks in advance, Mathias

2 4

Packaging API in BaseX
by Christian Grün 25 Jun '11

25 Jun '11

Dear all, we'd like to give you a preview on our upcoming EXPath Packaging API implementation, which will be released together with BaseX 6.7 next week: http://docs.basex.org/wiki/Packaging_API If you are curious enough, feel free to try our latest stable snapshot: http://files.basex.org/releases/latest/ Two example archives are found at: http://files.basex.org/xar/ Your feedback is valuable to us. If you come across any unexpected behavior, or if you have problems to get it work (..no matter if it's up to you or us..), please give us a note! Regarding the different versions of the Packaging Spec: we decided to only support the latest version (Candidate Module 11 November 2010, http://expath.org/spec/pkg), which means that out-of-dated xar archives need first to be updated. Have fun, Christian ___________________________ BaseX Team Christian Grün Uni KN, Box 188 78457 Konstanz, Germany http://www.basex.org

2 1

Running XQuery in oxygen or Eclipse with default (opened) collection
by Jan Vlčinský (CAD) 24 Jun '11

24 Jun '11

Hi I am currently trying to learn, how to use Oxygen and/or Eclipse to develop XQueries. For installation I followed just the instructions form wiki http://docs.basex.org/wiki/Integrating_oXygen and http://docs.basex.org/wiki/Integrating_Eclipse With Eclipse it worked for me a bit easier, the only problem I had was to specify in the code, what collection I am going to use as default one. My wish is that my xquery code does not have to refer explicitly to single collecion name (configuring collection name around the xquery is fine, but I want prevent having it in the xquery code itself). I did not find any method how to do this. With using explicit collection name in the xquery code it works well. I know I could employ some external parameter and use it to bear the name of the collection, but this is still not, what I would call "use the currently opened collection" and I do not like the fact, my code has to be modified for this purpose. With oxygen is the situation the same with the complication, it keeps asking for xml input, when I use XQuery Transformation - and that is not, what I need. Any advise? Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky

2 2

Command line on OS X
by Craig Girard 23 Jun '11

23 Jun '11

I have 2 db's I would like to join. I have the xq thanks to help from Michael yesterday, but my db's are large and I receive a 'out of main memory' error. I have found some info on command line options but have been unable to get them to work. I am running BaseX on OS X. Is there a way to run an xq from the terminal or have the output from the xq go to a file rather than the screen? Thank you all for your help, Craig Girard

3 2

Rebind the variables
by Oda 23 Jun '11

23 Jun '11

Hi, I want to rebind the variables, but got the result that wasn't expected. How can I get the expected result without creating new processor instance? (When I use proc.query() and don't declare $var2 then got the expected result. But I have to declare $var2.) ---------- String query = "declare variable $var1 as xs:string external; " + "declare variable $var2 as xs:string := 'BBB'; " + "($var1, $var2)"; QueryProcessor proc = new QueryProcessor(query, new Context()); // "AAA BBB" proc.bind("var1", "AAA"); System.out.println(proc.execute()); //duplicate definition error of $var2 //proc.query(query); // "AAA BBB" not "CCC BBB" proc.bind("var1", "CCC"); System.out.println(proc.execute()); proc.close(); ---------- Thanks, Oda.

2 2

NEWBIE question - Joining db's
by Craig Girard 22 Jun '11

22 Jun '11

Is there a way in basex to join 2 databases together? I have 2 databases I would like to join based on an ID. I have found examples in xquery but they don't seem to work in basex. Thank you for your time, Craig

2 1

compound documents
by Imsieke, Gerrit, le-tex 21 Jun '11

21 Jun '11

What would be your recommendation for dealing with compound documents? Suppose we have a larger work of literature that consists of chapters, and for some reason we want to store the chapters as different files. A rationale for splitting the work might be that different persons should be able to edit two chapters at the same time. There’s a skeleton document that slurps in the individual chapters, maybe using XInclude or another linking/transclusion mechanism. Suppose there’s an XML database that stores a copy of the complete work and keeps it up to date. And that’s the point: how to implement the update procedure? a) Resolve transclusions first, then store whole work as one XML (as a consequence, every node has the same base URI) b) Store skeleton and individual chapter files, provide virtual single-tree view transparently (but each node would still know its base URI) c) Store skeleton and individual chapter files, leave it to the user (= xquery programmer) to create a custom transcluder for creating intermediate compound document instances that may then be queried or exported In cases b) and c), if a content unit (chapter) was edited, I’d just delete the corresponding DB item and add the changed file to the DB. In case a), I’d either reassemble the compound work and replace the probably large XML file in the DB with a new one (probably an expensive operation), or I’d replace the corresponding content via XQUF (requires that I’m able to precisely locate where the altered snippet was in the compound document). So if fine-granular file-based storage was a requirement, what would you do in order to index the content in BaseX? I think b) is desirable, but not implemented. Maybe you even know a method d)? Gerrit

1 0

whitespace pruning while storing an XML doc to BaseX, how to disable
by software developer 21 Jun '11

21 Jun '11

Hi, Does BaseX attempt some whitespace pruning on the XMLs being stored; if yes, how to get BaseX not to do so. On the wire, at the time request reaches BaseX, the XML is like: ..<xsl:for-each select="LINK"> ...<xsl:if test="A = 'TOKEN'"> ....insert into ....MYTABLE(VERSION) ....values ('LATEST'); ...</xsl:if> . in above is a space character, note the terminating xsl:if is on a line of its own. What BaseX stores is: <xsl:for-each select="LINK"> <xsl:if test="A = 'TOKEN'">insert into MYTABLE(VERSION) values ('LATEST');</xsl:if> </xsl:for-each> As you can see, BaseX has not persisted/stored the incoming XML as-is. I do not want this intelligent pruning since it breaks stuff for me. Thanks.

2 2

BaseX and integration into <oXygen/> - which edition is needed
by Jan Vlčinský (CAD) 20 Jun '11

20 Jun '11

Hi I am considering purchase of <oXygen/> and wonder, which edition is supporting integration with BaseX: It has to be Editor and not Author (Editor cares about transformations, Author about creation of content). But do I need Enterprise or I will live happily with Professional? My feeling is that Professional will be sufficient, as http://docs.basex.org/wiki/Integrating_oXygen describes general method, not bound to some specific vendor, but I can be wrong. Thanks for any reaction. Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky

3 2

Please confirm subscription to Clinical Trials Centre's newsletter! (Action required)
by magnifier 19 Jun '11

19 Jun '11

1 0

Newbie question
by Craig Girard 15 Jun '11

15 Jun '11

I am receiving the following error... No sequence (attribute SCORE [ "16" }, attribute SCORE { "16" }) allowed. Seems like a basic one but I cannot find information about it anywhere. Any suggestion are greatly appreciated. Thank you, Craig Girard

3 2

Re: [basex-talk] "database locked" error on DROP DATABASE
by Andreas Weiler 11 Jun '11

11 Jun '11

Forward to mailing-list... Begin forwarded message: > From: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> > Date: 8. Juni 2011 09:54:23 MESZ > To: Godmar Back <godmar(a)gmail.com> > Subject: Re: [basex-talk] "database locked" error on DROP DATABASE > > Hi, > It seems that the database isnt closed correctly in your Session. > If you try to delete the database then with another Session, it fails, cause the first Session has it still open. > > On 08.06.2011, at 01:32, Godmar Back wrote: > >> On Tue, Jun 7, 2011 at 6:11 PM, Godmar Back <godmar(a)gmail.com> wrote: >>> Hi, >>> >>> I'm trying to delete an XML document by invoking 'execute("DROP >>> DATABASE name")' using the Java binding, but I'm getting: >>> >>> Tue Jun 07 18:06:10 EDT 2011: Unexpected exception: >>> java.io.IOException: Database 'feed_vsony7_at_vt_dot_edu_vijayfeed' is >>> currently locked. >>> java.io.IOException: Database 'feed_vsony7_at_vt_dot_edu_vijayfeed' is >>> currently locked. >>> at org.libx.libappdatabase.BaseXSessionSupport.execute(BaseXSessionSupport.java:71) >>> >>> There are no concurrent accesses to the database. I'm creating a >>> document, then I'm successfully running a few XUpdate/XQuery's on it, >>> then I attempt to delete it as part of a unit test. >>> >> >> FWIW, the problem persists in 6.6.2. >> When the DROP DB fails, show databases shows: >>> show databases >> 1 opened database(s): >> - libx2_feeds_test (1x) >> >> Here's a log: http://top.cs.vt.edu/~gback/bx/b662bugs/2011-06-07.log >> >> The documentation at >> http://docs.basex.org/wiki/Commands_6.6.3#DROP_DATABASE says "The >> command fails if the specified database does not exist or is currently >> locked, or if the database could not be deleted for some other >> reason." but nowhere else does it mention what 'locking' the database >> means. >> >> In the XQuery model, I can only see a need for locking internally >> during an XQuery, which means that leaving a database locked, or >> failing to delete it because of it (instead of waiting until it is no >> longer accessed) would be a bug. >> >>> >>> ps: >>> (I'm not issuing any "OPEN" commands. What does OPEN/CLOSE do, anyway?) >> >> Never mind about this question - this doesn't apply. >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >

3 13

Coming soon: database events
by Christian Grün 09 Jun '11

09 Jun '11

Dear all, we're currently working hard to get Version 6.7 of BaseX finished. One of the major new features will be the support for database events, which can be triggered and received by any client: http://docs.basex.org/wiki/Events BaseX 6.7 will offer some other features, most of which are already available in the current snapshot.. http://files.basex.org/releases/latest/ https://github.com/BaseXdb/basex Some of the new commands can be traced by comparing the old and new Command entry in our Wiki: http://docs.basex.org/wiki/Commands http://docs.basex.org/wiki/Commands_(Snapshot) If you have some early feedback, or if the current documentation does not cover all issues.. Feel free to contribute or give feedback. All the best, Christian PS: Another exciting feature we're currently implementing is the incremental update of all index structures. This feature will be available with BaseX 7.0.

2 1

Embedded BaseX JaxRxServer started from Java desktop app.
by Huib Verwey 08 Jun '11

08 Jun '11

Hi, I'm trying to start a BaseX db instance from my Java desktop application using db = new JaxRxServer(); The log says: BaseX 6.6.2 [Server] Server is gestart. 2011-05-31 08:16:03.666:INFO::Logging to STDERR via org.mortbay.log.StdErrLog 2011-05-31 08:16:03.704:INFO::jetty-6.1.26 2011-05-31 08:16:03.881:INFO::Started SocketConnector@0.0.0.0:8984 JAX-RX Server is gestart And when a curl request is made the log says: 31-mei-2011 8:17:28 com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages: org.jaxrx.resource 31-mei-2011 8:17:28 com.sun.jersey.api.core.ScanningResourceConfig logClasses INFO: Root resource classes found: class org.jaxrx.resource.XMLResource class org.jaxrx.resource.JaxRxResource 31-mei-2011 8:17:28 com.sun.jersey.api.core.ScanningResourceConfig init INFO: No provider classes found. 31-mei-2011 8:17:28 com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.6 03/25/2011 01:14 PM' I can connect to the server using bin/basexclient and it serves all the data from my local BaseX instance I have used before, but when I try to access the JaxRxServer using curl I get: HTTP/1.1 400 Bad Request Content-Type: text/plain Transfer-Encoding: chunked Server: Jetty(6.1.26) cvc-elt.1: Cannot find the declaration of element 'query'. Does anyone know what I need to do to get this working? I am running a maven project with dependencies on basex-6.6.2 and basex-api-6.6.2. Hartelijke groet, Huib Verweij. -- Drs. Huib Verweij Senior software developer - The Language Archive Max Planck Institute for Psycholinguistics P.O. Box 310 6500 AH Nijmegen The Netherlands t +31-24-3521911 e huib.verwey(a)mpi.nl<mailto:huib.verwey@mpi.nl> w http://www.mpi.nl/

4 12

downloading basex 6.6.2
by Godmar Back 08 Jun '11

08 Jun '11

On http://basex.org/products/download/zip-download/ it downloads http://files.basex.org/releases/6.6.2/BaseX662.zip but the link on the page points to http://files.basex.org/releases/6.6/BaseX66.zip Also, I really hate the "download should start automatically" option. I practically never sit in front of the computer on which I develop, so why you're sucking up my home bandwidth by trying to send a copy of .zip to my laptop is beyond me. A good alternative may be a green Download button like on Sourceforge or other sites. On a related note, I notice that BaseX server now has a startup script that requires three other jar files - are those needed? Why do I need, for instance, tagsoup when I'm not planning on parsing any HTML. - Godmar

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk