- BaseX-Talk - mailman.uni-konstanz.de

Renaming of documents
by Thomas Kaltofen 21 Apr '11

21 Apr '11

Hi, why is it not possible to rename a document in a database with an update XQuery? Thanks for helping out! Regards, Thomas

3 3

XQuery from console error
by Hector Diaz 19 Apr '11

19 Apr '11

Hello, I am trying to run some Xqueries from command line but I am getting the following error: $ java -cp "C:\Program Files\BaseX\BaseX.jar" org.basex.BaseXClient -Uadmin -Pa dmin -c"open dbname;xquery <results>{ let $total:=count(//callRecords/*) return <t otal>{$total}</total>}</results>" Error: Stopped at line 1, column 30: [XPST0003] Expecting "}", found ":". If I run the query from the GUI it runs correctly, but here I am always getting this error. I tried running other dummy queries that work in the GUI but here I get an error like this: $ java -cp "C:\Program Files\BaseX\BaseX.jar" org.basex.BaseXClient -Uadmin -Pa dmin -c"open dbname;xquery let $total := count(//callRecords/*) return $total" Error: Stopped at line 1, column 23: Syntax: XQUERY [query] Evaluate XQuery. Any idea of how to solve this? Is it possible to use let in queries from command? Thanks in advance for your help. Hector

5 4

how to dump an basex database
by Immanuel Normann 19 Apr '11

19 Apr '11

Hi, is there an easy way to dump an basex database, either on the command line or in the interactive mode of the basexserver. Immanuel

2 1

Invalid permissions
by Immanuel Normann 18 Apr '11

18 Apr '11

Hello, I wanted to let a user insert nodes into a database. Three related questions about that: 1) why does the user need "CREATE" permissions and not just "WRITE" permissions? 2) why does the pattern "grant create on <db> to <user>" yield the error "Invalid permissions specified", whereas "grant create to <user>" works? 3) how could I let user manipulate (e.g. inserting a node) only a specific database? Thanks for help Immanuel

2 2

should BXCollection.listResources always throw an exception?
by Meredith Gregory 17 Apr '11

17 Apr '11

Dear BaseXers, So far, BaseX has been a lot of fun to work with! Thanks for all your efforts on this codebase. i've got a couple of questions, though. - Whether i've got no documents in a freshly created BXCollection, or i've ensured that there is at least one document present, a call to listResources always throws an IndexOutOfBounds exception. Is that the intended behavior? - The reason i'm using this API is that i need to be able to update a single document in a collection guaranteed to have exactly one document. So, i thought i would simply ask the BXCollection to list it's resources, grab the first one (since there should only be one) and then use the id from the list returned by that API in subsequent queries. Maybe that's not the preferred approach? Is there a better one? Any help would be greatly appreciated. Best wishes, --greg override def getCollection( createIfMissing : Boolean )( xmlCollStr : String ) : Option[Collection] = { try { // BUGBUG -- LGM the semantics of BXCollection a little // different than createIfMissing; and requires catching the // database not found exception Some( new BXCollection( xmlCollStr, true ) ) } catch { case e : XMLDBException => { val bxColl = new BXCollection( xmlCollStr, false ) val document = bxColl.createResource( null, XMLResource.RESOURCE_TYPE ).asInstanceOf[XMLResource] document.setContent( "<database></database>" ) bxColl.storeResource( document ) Some( bxColl ) } case _ => None } } override def update( xmlCollStr : String )( cnxn : CnxnCtxtLabel[Namespace,Var,String] ) : Unit = { for( xmlColl <- getCollection( true )( xmlCollStr ) ) { val resourceList : Array[String] = xmlColl.listResources if ( resourceList.size == 0 ) { val document = xmlColl.createResource( null, XMLResource.RESOURCE_TYPE ).asInstanceOf[XMLResource] document.setContent( xmlIfier.asXML( cnxn ).toString ) xmlColl.storeResource( document ) } else { val cnxnElem = xmlIfier.asXML( cnxn ) cnxnElem match { case cElem : Elem => { delete( xmlCollStr, resourceList( 0 ) )( cElem ) insert( xmlCollStr, resourceList( 0 ) )( cElem ) } case _ => { throw new Exception( "record is not an XML element" ) } } } } } <tweet>storing to db : org.basex.api.xmldb.BXDatabase@77dc754 pair : record(contactMeUsing(email), {"com.biosimilarity.lift.model.store.MonadicTermTypes_-Ground":{"v":{"@class":"string","$":"for the win Mikail.Mauz@gmail.com"},"_-outer":{"@class":"com.biosimilarity.lift.model.store.PersistedMonadicTS$TheMTT$"}}}) in coll : Squibble</tweet> java.lang.IndexOutOfBoundsException at java.io.RandomAccessFile.readBytes(Native Method) at java.io.RandomAccessFile.read(RandomAccessFile.java:322) at java.io.RandomAccessFile.readFully(RandomAccessFile.java:381) at org.basex.io.DataAccess.cursor(DataAccess.java:225) at org.basex.io.DataAccess.readToken(DataAccess.java:147) at org.basex.data.DiskData.txt(DiskData.java:213) at org.basex.data.DiskData.text(DiskData.java:181) at org.basex.api.xmldb.BXCollection.listResources(BXCollection.java:128) at com.biosimilarity.lift.model.store.xml.BaseXCnxnStorage$$anonfun$update$1.apply(BaseXXMLPersist.scala:313) at com.biosimilarity.lift.model.store.xml.BaseXCnxnStorage$$anonfun$update$1.apply(BaseXXMLPersist.scala:312) at scala.Option.foreach(Option.scala:185) at com.biosimilarity.lift.model.store.xml.BaseXCnxnStorage$class.update(BaseXXMLPersist.scala:312) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction.update(PersistedMonadicTermStore.scala:321) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction$$anonfun$putInStore$3$$anonfun$apply$12$$anonfun$apply$13.apply(PersistedMonadicTermStore.scala:468) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction$$anonfun$putInStore$3$$anonfun$apply$12$$anonfun$apply$13.apply(PersistedMonadicTermStore.scala:459) at scala.Option.foreach(Option.scala:185) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction$$anonfun$putInStore$3$$anonfun$apply$12.apply(PersistedMonadicTermStore.scala:459) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction$$anonfun$putInStore$3$$anonfun$apply$12.apply(PersistedMonadicTermStore.scala:458) at scala.Option.foreach(Option.scala:185) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction$$anonfun$putInStore$3.apply(PersistedMonadicTermStore.scala:458) at com.biosimilarity.lift.model.store.PersistedTermStoreScope$PersistedMonadicGeneratorJunction$$anonfun$putInStore$3.apply(PersistedMonadicTermStore.scala:458) at scala.util.continuations.package$.run(package.scala:30) at scala.concurrent.cpsops$$anonfun$spawn$1.apply$mcV$sp(cpsops.scala:9) at scala.concurrent.FJTaskRunners$FJTaskRunner$$anon$1.compute(FJTaskRunners.scala:21) at jsr166y.forkjoin.RecursiveAction.exec(RecursiveAction.java:247) at jsr166y.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:286) -- L.G. Meredith Managing Partner Biosimilarity LLC 7329 39th Ave SW Seattle, WA 98136 +1 206.650.3740 http://biosimilarity.blogspot.com

2 6

Can not generate fulltext search indexes for wikipedia XML dB
by Erol Akarsu 14 Apr '11

14 Apr '11

Ok, I was able to run full text search with another XML Database. I am primarily interested in how Basex will play with big XML file Wikipedia. Actually, Database create of wikipedia is fine. But when I add full tet search and indexes for it, it always throws out of memory exception error. I have changed -Xmx with 6GB that is still not enough to generate indexes for Wikipedia. Can you help me on how to generate indexes with a machine that case 6GB for Basex process? Thanks Erol Akarsu On Sun, Apr 10, 2011 at 4:07 AM, Andreas Weiler < andreas.weiler(a)uni-konstanz.de> wrote: > Hi, > > the following query could work for you: > > declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; > for $i in doc("enwiki-latest-pages-articles")//w:sitename > return $i[. contains text "Wikipedia"]/.. > > -- Andreas > > Am 09.04.2011 um 20:43 schrieb Erol Akarsu: > > Hi > > I am having difficulty in running full text operators. This script gives > siteinfo below > declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; > let $d := fn:doc ("enwiki-latest-pages-articles") > return ($d//w:siteinfo)[1] > > But return $d//w:siteinfo[w:sitename contains text 'Wikipedia'] does NOT > give same node > Why "contains" ft operator behave incorrectly? I remember it was working > fine. I just dropped and recreated database and turn all indexes. Can you > help me? > Query info is here: > > Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; > Compiling: > - pre-evaluating fn:doc("enwiki-latest-pages-articles") > - adding text() step > - optimizing descendant-or-self step(s) > - removing path with no index results > - pre-evaluating (())[1] > - binding static variable $res > - pre-evaluating fn:doc("enwiki-latest-pages-articles") > - binding static variable $d > - adding text() step > - optimizing descendant-or-self step(s) > - removing path with no index results > - simplifying flwor expression > Result: () > Timing: > - Parsing: 0.46 ms > - Compiling: 0.42 ms > - Evaluating: 0.17 ms > - Printing: 0.1 ms > - Total Time: 1.15 ms > Query plan: > <sequence size="0"/> > > > > <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" > http://www.w3.org/2001/XMLSchema-instance"> > <sitename>Wikipedia</sitename> > <base>http://en.wikipedia.org/wiki/Main_Page</base> > <generator>MediaWiki 1.17wmf1</generator> > <case>first-letter</case> > <namespaces> > <namespace key="-2" case="first-letter">Media</namespace> > <namespace key="-1" case="first-letter">Special</namespace> > <namespace key="0" case="first-letter"/> > <namespace key="1" case="first-letter">Talk</namespace> > <namespace key="2" case="first-letter">User</namespace> > <namespace key="3" case="first-letter">User talk</namespace> > <namespace key="4" case="first-letter">Wikipedia</namespace> > <namespace key="5" case="first-letter">Wikipedia talk</namespace> > <namespace key="6" case="first-letter">File</namespace> > <namespace key="7" case="first-letter">File talk</namespace> > <namespace key="8" case="first-letter">MediaWiki</namespace> > <namespace key="9" case="first-letter">MediaWiki talk</namespace> > <namespace key="10" case="first-letter">Template</namespace> > <namespace key="11" case="first-letter">Template talk</namespace> > <namespace key="12" case="first-letter">Help</namespace> > <namespace key="13" case="first-letter">Help talk</namespace> > <namespace key="14" case="first-letter">Category</namespace> > <namespace key="15" case="first-letter">Category talk</namespace> > <namespace key="100" case="first-letter">Portal</namespace> > <namespace key="101" case="first-letter">Portal talk</namespace> > <namespace key="108" case="first-letter">Book</namespace> > <namespace key="109" case="first-letter">Book talk</namespace> > </namespaces> > </siteinfo> > > On Mon, Apr 4, 2011 at 7:31 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > >> I imported wikipedia xml into basex and tried to search it. >> >> But searching it takes longer. >> >> I tried to search one element that is first child of whole document and it >> took 52 sec. >> I know the XML file is very big 31GB. How can I optimize the search? >> >> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> >> let $d := fn:doc ("enwiki-latest-pages-articles")//w:siteinfo >> return $d >> >> Database info: >> >> > open enwiki-latest-pages-articles >> Database 'enwiki-latest-pages-articles' opened in 778.49 ms. >> > info database >> Database Properties >> Name: enwiki-latest-pages-articles >> Size: 23356 MB >> Nodes: 228090153 >> Height: 6 >> >> Database Creation >> Path: /mnt/hgfs/C/tmp/enwiki-latest-pages-articles.xml >> Time Stamp: 03.04.2011 12:29:15 >> Input Size: 30025 MB >> Encoding: UTF-8 >> Documents: 1 >> Whitespace Chopping: ON >> Entity Parsing: OFF >> >> Indexes >> Up-to-date: true >> Path Summary: ON >> Text Index: ON >> Attribute Index: ON >> Full-Text Index: OFF >> > >> >> >> Timing info: >> >> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> Compiling: >> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >> - optimizing descendant-or-self step(s) >> - binding static variable $d >> - removing variable $d >> - simplifying flwor expression >> Result: element siteinfo { ... } >> Timing: >> - Parsing: 1.4 ms >> - Compiling: 52599.0 ms >> - Evaluating: 0.28 ms >> - Printing: 0.62 ms >> - Total Time: 52601.32 ms >> Query plan: >> <DBNode name="enwiki-latest-pages-articles" pre="5"/> >> >> >> >> Result of query: >> >> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >> http://www.w3.org/2001/XMLSchema-instance"> >> <sitename>Wikipedia</sitename> >> <base>http://en.wikipedia.org/wiki/Main_Page</base> >> <generator>MediaWiki 1.17wmf1</generator> >> <case>first-letter</case> >> <namespaces> >> <namespace key="-2" case="first-letter">Media</namespace> >> <namespace key="-1" case="first-letter">Special</namespace> >> <namespace key="0" case="first-letter"/> >> <namespace key="1" case="first-letter">Talk</namespace> >> <namespace key="2" case="first-letter">User</namespace> >> <namespace key="3" case="first-letter">User talk</namespace> >> <namespace key="4" case="first-letter">Wikipedia</namespace> >> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >> <namespace key="6" case="first-letter">File</namespace> >> <namespace key="7" case="first-letter">File talk</namespace> >> <namespace key="8" case="first-letter">MediaWiki</namespace> >> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >> <namespace key="10" case="first-letter">Template</namespace> >> <namespace key="11" case="first-letter">Template talk</namespace> >> <namespace key="12" case="first-letter">Help</namespace> >> <namespace key="13" case="first-letter">Help talk</namespace> >> <namespace key="14" case="first-letter">Category</namespace> >> <namespace key="15" case="first-letter">Category talk</namespace> >> <namespace key="100" case="first-letter">Portal</namespace> >> <namespace key="101" case="first-letter">Portal talk</namespace> >> <namespace key="108" case="first-letter">Book</namespace> >> <namespace key="109" case="first-letter">Book talk</namespace> >> </namespaces> >> </siteinfo> >> >> >> >> Thanks >> >> Erol Akarsu >> >> > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > >

2 3

Re: [basex-talk] lemmatisation
by Christian Grün 14 Apr '11

14 Apr '11

Dear Xavier, thanks for your request; due to time constraints, I'm passing this on to the list.. Hope someone helps; otherwise, please ask again, Christian ___________________________ On Thu, Apr 14, 2011 at 11:49 AM, xavier-laurent salvador <xavier-laurent.salvador(a)univ-paris13.fr> wrote: > Sorry for the send, here is my right xquery routine: > > <texte> { > for $dic in db:open('dictionary')//entry[pos contains text "Advb." ftor > "Conj." any word]/orth return > <res> > > Resultat: {$dic}: > { > let $s:= ft:mark(//*[text() contains text {$dic} using case > insensitive using wildcards], 'advb') > let $sv := $s//advb > return <ff>{$s}</ff>} > </res> > } > </texte> > > > Hello again, > could you give me an advice, please ? > I'm trying to integrate basex in a lexicographic project. Server an >> bindings are useful and ok. >> What i would like to do is crossing the datas of a db (="dictionary") >> with the tokens of another db(="text"): for all the adverbs of my >> dictionary, i want a mark around the token in the text. >> What i get is a new instance of my text, with <mark/> around the lemma, >> for every adverbs of the dictionary. 15 adverbs, 15 times the text. >> >> 'dictionary is <entry><orth>xxx</orth><pos>Advb.</pos></entry> >> 'text' is <root><texte><localisation>1</localisation>Donc dist alors li >> heros a ses amis</texte></root> >> >> here is my routine ('text' is already db:open): >> >> <texte> { >> for $dic in db:open('dictionary')//entry[pos contains text "Advb." ftor >> "Conj." any word]/orth return >> <res> >> >> Resultat: {$dic}: >> { >> let $s:= ft:mark(//*[text() contains text {$dic} using case >> insensitive using wildcards], 'advb') >> let $sv := $s//advb >> return <ff>{$s}</ff>} >> </res> >> } >> </texte> >> >> I tried with tumbling window, but couldn't with basex. >> Do you have an advice, please ? >> >> Thank you by advance and congratulations again for your great work, >> >> xls >> >> > > > >

1 0

Possible bug ?
by xavier-laurent salvador 14 Apr '11

14 Apr '11

Hi, here is a feedback for a "possible bug". I was trying to ft:mark with a "\s" wildcard. Hope I helped, Version: BaseX 6.6.1 Java: Sun Microsystems Inc., 1.6.0_18 OS: Linux, i386 Stack Trace: java.lang.NegativeArraySizeException org.basex.util.ft.WesternTokenizer.orig(WesternTokenizer.java:201) org.basex.util.ft.WesternTokenizer.get(WesternTokenizer.java:187) org.basex.util.ft.WesternTokenizer.nextToken(WesternTokenizer.java:113) org.basex.util.ft.FTLexer.nextToken(FTLexer.java:116) org.basex.query.ft.FTTokenizer.cache(FTTokenizer.java:105) org.basex.query.ft.FTWords.contains(FTWords.java:208) org.basex.query.ft.FTWords.item(FTWords.java:130) org.basex.query.ft.FTContains.item(FTContains.java:75) org.basex.query.ft.FTContains.item(FTContains.java:1) org.basex.query.expr.ParseExpr.ebv(ParseExpr.java:85) org.basex.query.expr.ParseExpr.test(ParseExpr.java:98) org.basex.query.expr.Preds.preds(Preds.java:99) org.basex.query.path.IterStep$1.next(IterStep.java:49) org.basex.query.iter.NodeIter.next(NodeIter.java:1) org.basex.query.path.IterPath$1.next(IterPath.java:67) org.basex.query.iter.NodeIter.next(NodeIter.java:1) org.basex.query.func.FNFt$1.next(FNFt.java:97) org.basex.query.iter.Iter.finish(Iter.java:65) org.basex.query.expr.ParseExpr.value(ParseExpr.java:76) org.basex.query.expr.Let$1.next(Let.java:94) org.basex.query.expr.FLWR$1.next(FLWR.java:62) org.basex.query.expr.Constr.<init>(Constr.java:55) org.basex.query.expr.CElem.item(CElem.java:116) org.basex.query.expr.CElem.item(CElem.java:1) org.basex.query.expr.CFrag.item(CFrag.java:1) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:52) org.basex.query.QueryContext.iter(QueryContext.java:329) org.basex.query.expr.Constr.<init>(Constr.java:54) org.basex.query.expr.CElem.item(CElem.java:116) org.basex.query.expr.CElem.item(CElem.java:1) org.basex.query.expr.CFrag.item(CFrag.java:1) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:52) org.basex.query.QueryContext.iter(QueryContext.java:329) org.basex.query.QueryContext.iter(QueryContext.java:294) org.basex.query.QueryContext.eval(QueryContext.java:254) org.basex.query.QueryProcessor.execute(QueryProcessor.java:113) org.basex.core.cmd.AQuery.query(AQuery.java:83) org.basex.core.cmd.XQuery.run(XQuery.java:22) org.basex.core.Command.run(Command.java:292) org.basex.core.Command.exec(Command.java:274) org.basex.core.Command.execute(Command.java:67) org.basex.gui.GUI.exec(GUI.java:390) org.basex.gui.GUI$5.run(GUI.java:351)

3 2

Apache Lucene for full text search ?
by Erol Akarsu 13 Apr '11

13 Apr '11

I have another question. Does Basex use Apache Lucene for full text search or have its own search engine? Thanks On Mon, Apr 11, 2011 at 12:35 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Ok, > > I was able to run full text search with another XML Database. > > I am primarily interested in how Basex will play with big XML file > Wikipedia. > > Actually, Database create of wikipedia is fine. But when I add full tet > search and indexes for it, it always throws out of memory exception error. > > I have changed -Xmx with 6GB that is still not enough to generate indexes > for Wikipedia. > > Can you help me on how to generate indexes with a machine that case 6GB > for Basex process? > > Thanks > > Erol Akarsu > > > > On Sun, Apr 10, 2011 at 4:07 AM, Andreas Weiler < > andreas.weiler(a)uni-konstanz.de> wrote: > >> Hi, >> >> the following query could work for you: >> >> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> for $i in doc("enwiki-latest-pages-articles")//w:sitename >> return $i[. contains text "Wikipedia"]/.. >> >> -- Andreas >> >> Am 09.04.2011 um 20:43 schrieb Erol Akarsu: >> >> Hi >> >> I am having difficulty in running full text operators. This script gives >> siteinfo below >> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> let $d := fn:doc ("enwiki-latest-pages-articles") >> return ($d//w:siteinfo)[1] >> >> But return $d//w:siteinfo[w:sitename contains text 'Wikipedia'] does NOT >> give same node >> Why "contains" ft operator behave incorrectly? I remember it was working >> fine. I just dropped and recreated database and turn all indexes. Can you >> help me? >> Query info is here: >> >> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> Compiling: >> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >> - adding text() step >> - optimizing descendant-or-self step(s) >> - removing path with no index results >> - pre-evaluating (())[1] >> - binding static variable $res >> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >> - binding static variable $d >> - adding text() step >> - optimizing descendant-or-self step(s) >> - removing path with no index results >> - simplifying flwor expression >> Result: () >> Timing: >> - Parsing: 0.46 ms >> - Compiling: 0.42 ms >> - Evaluating: 0.17 ms >> - Printing: 0.1 ms >> - Total Time: 1.15 ms >> Query plan: >> <sequence size="0"/> >> >> >> >> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >> http://www.w3.org/2001/XMLSchema-instance"> >> <sitename>Wikipedia</sitename> >> <base>http://en.wikipedia.org/wiki/Main_Page</base> >> <generator>MediaWiki 1.17wmf1</generator> >> <case>first-letter</case> >> <namespaces> >> <namespace key="-2" case="first-letter">Media</namespace> >> <namespace key="-1" case="first-letter">Special</namespace> >> <namespace key="0" case="first-letter"/> >> <namespace key="1" case="first-letter">Talk</namespace> >> <namespace key="2" case="first-letter">User</namespace> >> <namespace key="3" case="first-letter">User talk</namespace> >> <namespace key="4" case="first-letter">Wikipedia</namespace> >> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >> <namespace key="6" case="first-letter">File</namespace> >> <namespace key="7" case="first-letter">File talk</namespace> >> <namespace key="8" case="first-letter">MediaWiki</namespace> >> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >> <namespace key="10" case="first-letter">Template</namespace> >> <namespace key="11" case="first-letter">Template talk</namespace> >> <namespace key="12" case="first-letter">Help</namespace> >> <namespace key="13" case="first-letter">Help talk</namespace> >> <namespace key="14" case="first-letter">Category</namespace> >> <namespace key="15" case="first-letter">Category talk</namespace> >> <namespace key="100" case="first-letter">Portal</namespace> >> <namespace key="101" case="first-letter">Portal talk</namespace> >> <namespace key="108" case="first-letter">Book</namespace> >> <namespace key="109" case="first-letter">Book talk</namespace> >> </namespaces> >> </siteinfo> >> >> On Mon, Apr 4, 2011 at 7:31 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >>> I imported wikipedia xml into basex and tried to search it. >>> >>> But searching it takes longer. >>> >>> I tried to search one element that is first child of whole document and >>> it took 52 sec. >>> I know the XML file is very big 31GB. How can I optimize the search? >>> >>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> >>> let $d := fn:doc ("enwiki-latest-pages-articles")//w:siteinfo >>> return $d >>> >>> Database info: >>> >>> > open enwiki-latest-pages-articles >>> Database 'enwiki-latest-pages-articles' opened in 778.49 ms. >>> > info database >>> Database Properties >>> Name: enwiki-latest-pages-articles >>> Size: 23356 MB >>> Nodes: 228090153 >>> Height: 6 >>> >>> Database Creation >>> Path: /mnt/hgfs/C/tmp/enwiki-latest-pages-articles.xml >>> Time Stamp: 03.04.2011 12:29:15 >>> Input Size: 30025 MB >>> Encoding: UTF-8 >>> Documents: 1 >>> Whitespace Chopping: ON >>> Entity Parsing: OFF >>> >>> Indexes >>> Up-to-date: true >>> Path Summary: ON >>> Text Index: ON >>> Attribute Index: ON >>> Full-Text Index: OFF >>> > >>> >>> >>> Timing info: >>> >>> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> Compiling: >>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>> - optimizing descendant-or-self step(s) >>> - binding static variable $d >>> - removing variable $d >>> - simplifying flwor expression >>> Result: element siteinfo { ... } >>> Timing: >>> - Parsing: 1.4 ms >>> - Compiling: 52599.0 ms >>> - Evaluating: 0.28 ms >>> - Printing: 0.62 ms >>> - Total Time: 52601.32 ms >>> Query plan: >>> <DBNode name="enwiki-latest-pages-articles" pre="5"/> >>> >>> >>> >>> Result of query: >>> >>> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >>> http://www.w3.org/2001/XMLSchema-instance"> >>> <sitename>Wikipedia</sitename> >>> <base>http://en.wikipedia.org/wiki/Main_Page</base> >>> <generator>MediaWiki 1.17wmf1</generator> >>> <case>first-letter</case> >>> <namespaces> >>> <namespace key="-2" case="first-letter">Media</namespace> >>> <namespace key="-1" case="first-letter">Special</namespace> >>> <namespace key="0" case="first-letter"/> >>> <namespace key="1" case="first-letter">Talk</namespace> >>> <namespace key="2" case="first-letter">User</namespace> >>> <namespace key="3" case="first-letter">User talk</namespace> >>> <namespace key="4" case="first-letter">Wikipedia</namespace> >>> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >>> <namespace key="6" case="first-letter">File</namespace> >>> <namespace key="7" case="first-letter">File talk</namespace> >>> <namespace key="8" case="first-letter">MediaWiki</namespace> >>> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >>> <namespace key="10" case="first-letter">Template</namespace> >>> <namespace key="11" case="first-letter">Template talk</namespace> >>> <namespace key="12" case="first-letter">Help</namespace> >>> <namespace key="13" case="first-letter">Help talk</namespace> >>> <namespace key="14" case="first-letter">Category</namespace> >>> <namespace key="15" case="first-letter">Category talk</namespace> >>> <namespace key="100" case="first-letter">Portal</namespace> >>> <namespace key="101" case="first-letter">Portal talk</namespace> >>> <namespace key="108" case="first-letter">Book</namespace> >>> <namespace key="109" case="first-letter">Book talk</namespace> >>> </namespaces> >>> </siteinfo> >>> >>> >>> >>> Thanks >>> >>> Erol Akarsu >>> >>> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> >

2 1

Basex performance
by Erol Akarsu 11 Apr '11

11 Apr '11

I imported wikipedia xml into basex and tried to search it. But searching it takes longer. I tried to search one element that is first child of whole document and it took 52 sec. I know the XML file is very big 31GB. How can I optimize the search? declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; let $d := fn:doc ("enwiki-latest-pages-articles")//w:siteinfo return $d Database info: > open enwiki-latest-pages-articles Database 'enwiki-latest-pages-articles' opened in 778.49 ms. > info database Database Properties Name: enwiki-latest-pages-articles Size: 23356 MB Nodes: 228090153 Height: 6 Database Creation Path: /mnt/hgfs/C/tmp/enwiki-latest-pages-articles.xml Time Stamp: 03.04.2011 12:29:15 Input Size: 30025 MB Encoding: UTF-8 Documents: 1 Whitespace Chopping: ON Entity Parsing: OFF Indexes Up-to-date: true Path Summary: ON Text Index: ON Attribute Index: ON Full-Text Index: OFF > Timing info: Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; Compiling: - pre-evaluating fn:doc("enwiki-latest-pages-articles") - optimizing descendant-or-self step(s) - binding static variable $d - removing variable $d - simplifying flwor expression Result: element siteinfo { ... } Timing: - Parsing: 1.4 ms - Compiling: 52599.0 ms - Evaluating: 0.28 ms - Printing: 0.62 ms - Total Time: 52601.32 ms Query plan: <DBNode name="enwiki-latest-pages-articles" pre="5"/> Result of query: <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance"> <sitename>Wikipedia</sitename> <base>http://en.wikipedia.org/wiki/Main_Page</base> <generator>MediaWiki 1.17wmf1</generator> <case>first-letter</case> <namespaces> <namespace key="-2" case="first-letter">Media</namespace> <namespace key="-1" case="first-letter">Special</namespace> <namespace key="0" case="first-letter"/> <namespace key="1" case="first-letter">Talk</namespace> <namespace key="2" case="first-letter">User</namespace> <namespace key="3" case="first-letter">User talk</namespace> <namespace key="4" case="first-letter">Wikipedia</namespace> <namespace key="5" case="first-letter">Wikipedia talk</namespace> <namespace key="6" case="first-letter">File</namespace> <namespace key="7" case="first-letter">File talk</namespace> <namespace key="8" case="first-letter">MediaWiki</namespace> <namespace key="9" case="first-letter">MediaWiki talk</namespace> <namespace key="10" case="first-letter">Template</namespace> <namespace key="11" case="first-letter">Template talk</namespace> <namespace key="12" case="first-letter">Help</namespace> <namespace key="13" case="first-letter">Help talk</namespace> <namespace key="14" case="first-letter">Category</namespace> <namespace key="15" case="first-letter">Category talk</namespace> <namespace key="100" case="first-letter">Portal</namespace> <namespace key="101" case="first-letter">Portal talk</namespace> <namespace key="108" case="first-letter">Book</namespace> <namespace key="109" case="first-letter">Book talk</namespace> </namespaces> </siteinfo> Thanks Erol Akarsu

5 8

Re: [basex-talk] BaseX 6.6.1 Update - Soft-Files.com
by Alexander Holupirek 11 Apr '11

11 Apr '11

Hi Gary, the changelog can be found here: https://github.com/BaseXdb/basex/blob/master/changelog Kind regards, Alex On 11.04.2011, at 14:56, Gary Larsen wrote: > Could someone point me to a change log to learn what’s in this update? > > > > Thanks, > > gary > > > > > > > > From: basex-talk-bounces(a)mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of Soft-Files Team > Sent: Monday, April 11, 2011 1:00 AM > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] BaseX 6.6.1 Update - Soft-Files.com > > > > Dear Developer, > > Your product BaseX 6.6.1 has been updated. > > Your product review page is located at: http://www.soft-files.com/basex_72311.html. > > Sincerely, > The Soft-Files Team > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Alexander Holupirek |-- http://www.informatik.uni-konstanz.de/~holupire |-- Database & Information Systems Group, U Konstanz `-- Room E 209, 0049 7531 88 4449 (phone) 3577 (fax)

1 1

BaseX 6.6.1 Update - Soft-Files.com
by Soft-Files Team 11 Apr '11

11 Apr '11

Dear Developer, Your product BaseX 6.6.1 has been updated. Your product review page is located at: http://www.soft-files.com/basex_72311.html. Sincerely, The Soft-Files Team

2 1

Puzzling XQuery result
by Meredith Gregory 08 Apr '11

08 Apr '11

Dear BaseXers, i've got a result from an XQuery that i don't understand and am looking for insight and guidance. i've got a collection called 'Squibble' with three documents in it. They are listed below. The query for $rcrd in collection( 'Squibble' )//record where $rcrd/*[1] = <contentChannel><String>email</String></contentChannel> return $rcrd returns record elements from the first *two* documents. This is surprising to me because the first child of the first record element in the first document is <contactMeUsing>...</contactMeUsing>, not <contentChannel>...</contentChannel>. i was expecting it to return just the record element from the second document. i confess, i don't know anything about XQuery. So, it could be that i don't understand how the where clause is supposed to work. Any clues would be most appreciated. i'm running my tests using - BaseX 6.6 - on Mac OS X 10.6.7 Best wishes, --greg <?xml version="1.0" encoding="UTF-8"?> <record> <contactMeUsing> <String>email</String> </contactMeUsing> <String>{&quot;com.biosimilarity.lift.model.store.MonadicTermTypes_-Ground&quot;:{&quot;v&quot;:{&quot;@class&quot;:&quot;string&quot;,&quot;$&quot;:&quot;for the win Mikail.Mauz(a)gmail.com &quot;},&quot;_-outer&quot;:{&quot;@class &quot;:&quot;com.biosimilarity.lift.model.store.PersistedMonadicTS$TheMTT$&quot;}}}</String> </record> <?xml version="1.0" encoding="UTF-8"?> <record> <contentChannel> <String>email</String> </contentChannel> <String>{&quot;com.biosimilarity.lift.model.store.MonadicTermTypes_-Ground&quot;:{&quot;v&quot;:{&quot;@class&quot;:&quot;string&quot;,&quot;$&quot;:&quot;for the get Donald.Duque(a)yahoo.com &quot;},&quot;_-outer&quot;:{&quot;@class &quot;:&quot;com.biosimilarity.lift.model.store.PersistedMonadicTS$TheMTT$&quot;}}}</String> </record> <?xml version="1.0" encoding="UTF-8"?> <record> <phone> <var>cell</var> </phone> <String>{&quot;com.biosimilarity.lift.model.store.MonadicTermTypes_-Ground&quot;:{&quot;v&quot;:{&quot;@class &quot;:&quot;string&quot;,&quot;$&quot;:&quot;2xx.6xx.3xxx&quot;},&quot;_-outer&quot;:{&quot;@class &quot;:&quot;com.biosimilarity.lift.model.store.PersistedMonadicTS$TheMTT$&quot;}}}</String> </record> -- L.G. Meredith Managing Partner Biosimilarity LLC 7329 39th Ave SW Seattle, WA 98136 +1 206.650.3740 http://biosimilarity.blogspot.com

2 7

tf/idf
by Wiard Vasen 06 Apr '11

06 Apr '11

Dear sirs of Basex, I am doing my Master thesis on the letters of Vincent van Gogh at the University of Amsterdam. For that purpose I use BaseX to analyze the letters. I wonder, is there the possibility to generate a tf/idf score automatically? In your faq I noticed there needs to be a special term like 'SET SCORING 0' to be able to get a tf/idf score. This information I get from the following page: http://docs.basex.org/wiki/Full-Text Could you help me with this? I would be very grateful. Kind regards,

4 25

Trigger!
by Truong An Nguyen 06 Apr '11

06 Apr '11

Hi, Does Basex have trigger? If not, can you please show me how to recognize which documents are changed after the execution of an xquery update? Thanks. Cheers, An

2 1

Re: [basex-talk] Updates and indexing
by Gary Larsen 05 Apr '11

05 Apr '11

Hi, Just wondering if there is something available to test from the index update effort. Thanks, Gary From: basex-talk-bounces(a)mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of Gary Larsen Sent: Tuesday, March 15, 2011 3:09 PM To: basex-talk(a)mailman.uni-konstanz.de Subject: Re: [basex-talk] Updates and indexing Hi Dimitar, Thanks for the info. I see that adding a document changes the database indexing status to off. A query to locate a document by node value in a database with 54k documents went from 3 seconds to 4 minutes. I can image its difficult to balance performance in different aspects of the application and maintain database stability at the same time. For the past couple of weeks Ive tested query performance on a half dozen databases and BaseX queries were almost always quickest and never crashed even when running with lower memory. Depending on how things go with my research I may be able to help test the index updating feature when you are ready for that. Thanks, Gary >Hi Gary, >I'm the one who's working on the index updating. As Michael said it's a work >in progress, but I expect to finish my work soon. Most probably it will be >released at some point after 6.6 (which should be available on March 23). >Best regards, >Dimitar Am Dienstag 15 März 2011, 10:01:20 schrieb Michael Seiferle: > Hi Gary, > > yes this is true either way, still in 6.5.1. > We are currently working on incremental index updates, but I unfortunately > can't give you any hint on a release date. > > For most use-cases recreating the indexes (OPTIMIZE [1]) works fine in day > to day use, but we are aware that this might get a little annoying under > some circumstances. > > Thanks a lot for your feedback, feel free to discuss or ask for more > information. -- > > Kind regards > Michael From: Gary Larsen [mailto:gary.larsen@envisn.com] Sent: Monday, March 14, 2011 8:08 PM To: 'basex-talk(a)mailman.uni-konstanz.de' Subject: Updates and indexing Hi, I was reading a thread in the mail list from Oct 2010 which states updates are not indexed: https://mailman.uni-konstanz.de/pipermail/basex-talk/2010-October/000707.htm l Is this still the case with version 6.5.1? When talking of updates does that mean whole document replacement (or deletion) as well as XQuery updates? Thanks for any clarification, gary

1 0

using variables along with namespace prefix
by Sony Vijay 05 Apr '11

05 Apr '11

Hi, I am using the sample xml document(xyz) shown below: <entry xmlns:libx="http://libx.org/xml/libx2"> <libx:libapp> First libapp </libx:libapp> <libx:libapp> Second libapp </libx:libapp> </entry> I am using BaseX 6.5.2 and am trying to use a variable along with a namespace prefix in my sample xquery like so: declare variable $libx_ns as xs:string external; declare namespace libx=$libx_ns; let $type := 'libapp' return doc('xyz')/entry*[libx:{$type}]*[1] When I pass the value "http://libx.org/xml/libx2" to the parameter libx_ns and run the above xquery I see the following exception: [XPST0003] Incomplete expression. However, the following xquery works: declare variable $libx_ns as xs:string external; declare namespace libx=$libx_ns; let $type := 'libapp' return doc('xyz')/entry*[libx:libapp]*[1] The child nodes could be libx:libapp or libx:module etc. So, I will have to use a variable rather than hard wiring the actual child name. But, I am not sure how to use a variable along with a namespace prefix. Am I doing something wrong or is this a bug ? Thanks, Sony

2 1

Re: [basex-talk] tf/idf
by Andreas Weiler 03 Apr '11

03 Apr '11

You can change the input type in the left combobox to XQuery and then enter your full text query. However, I would suggest to use the XQuery view, because it offers detailed error feedback and syntax highlighting. -- Andreas Am 02.04.2011 um 18:01 schrieb Wiard Vasen: > Thanks a lot Andreas for your answer on my question. > I will look at your solution this week. > > I was in Berlin this weekend. > > Is it possible to use set scoring * and then enter full text queries in the upper text-bar? > > Thank you for the live-demo as well. > > If I succeed I come back to you. > > Regards, > > Wiard Vasen > > Vrije Universiteit van Amsterdam > Masterthesis: Deep diving into Van Gogh > > 2011/3/31 Andreas Weiler <andreas.weiler(a)uni-konstanz.de> > Dear Wiard Vasen, > > you just need to set the scoring property once. > If you work in the GUI: > > Go to the top input bar, choose command and type: > > set scoring * > > as * set the scoring algorithm you like. > > In the console just type: set scoring * > > After setting this you can use the score function, like in the 8th query of our online demo (basex.org/products/live-demo): > > let $names := ('Jack London', 'Jack', 'Jim Beam', 'Jack Daniels') > for $name at $pos score $score in $names[. contains text 'Jack'] > order by $score descending > return <name pos='{ $pos }'>{ $name }</name> > > Don't hesitate to ask for more, > Andreas > > Am 30.03.2011 um 22:02 schrieb Wiard Vasen: > >> Dear sirs of Basex, >> >> I am doing my Master thesis on the letters of Vincent van Gogh at the University of Amsterdam. >> For that purpose I use BaseX to analyze the letters. >> >> I wonder, is there the possibility to generate a tf/idf score automatically? >> In your faq I noticed there needs to be a special term like 'SET SCORING 0' to be able to get a tf/idf score. >> >> This information I get from the following page: http://docs.basex.org/wiki/Full-Text >> >> Could you help me with this? >> >> I would be very grateful. >> >> Kind regards, >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

1 0

BaseX 6.6.1
by Christian Grün 01 Apr '11

01 Apr '11

Dear all, thanks to everyone who gave us great feedback on BaseX 6.6, either by e-mail or directly at the XMLPrague conference! This way, we were able to finish Version 6.6.1 just one week later, which offers some exciting performance improvements and some more bug fixes: XQuery: [ADD] index rewritings added for .../text()[. = ..] syntax [ADD] optimizations of mixed axis path expressions, e.g.: //x/name() [MOD] index rewritings on collections fixed and generalized [MOD] faster evaluation of filters with pos. predicates, e.g.: $x[5] [FIX] fixed relocation of let clauses in GFLWOR expressions [FIX] trace function returned wrong original results [FIX] variables in catch clauses were discarded [FIX] HOF optimizations and fixes GUI: [FIX] language option (for Japanese, German, etc. interface) fixed To be continued, Christian BaseX Team, 2011

3 2

BaseX Issue Tracker
by Christian Grün 31 Mar '11

31 Mar '11

Hi, once again I'd like to remind all of you of our GitHub Issue Tracker, which lists some of the features to come next: https://github.com/BaseXdb/basex/issues You're invited to give your votes on the given issues, or add new entries. The more feedback we get, the better we'll be able to decide which features will be implemented first. Christian ___________________________ Christian Grün Uni KN, Box 188 78457 Konstanz, Germany http://www.inf.uni-konstanz.de/~gruen

1 0

abstract method error?
by Meredith Gregory 31 Mar '11

31 Mar '11

Dear BaseXes, i'm attempting to use the published API from Java (well Scala, really, but we're all JVM family, here...). i'm running into an abstract method error (see the trace below). Any clues would be gratefully appreciated. Best wishes, --greg scala> val db = Class.forName( "org.basex.api.xmldb.BXDatabase" ).newInstance().asInstanceOf[Database] val db = Class.forName( "org.basex.api.xmldb.BXDatabase" ).newInstance().asInstanceOf[Database] db: org.xmldb.api.base.Database = org.basex.api.xmldb.BXDatabase@69dbb4d1 scala> DatabaseManager.registerDatabase( db ) DatabaseManager.registerDatabase( db ) java.lang.AbstractMethodError: org.basex.api.xmldb.BXDatabase.getNames()[Ljava/lang/String; at org.xmldb.api.DatabaseManager.registerDatabase(Unknown Source) at .<init>(<console>:25) at .<clinit>(<console>) at RequestResult$.<init>(<console>:9) at RequestResult$.<clinit>(<console>) at RequestResult$scala_repl_result(<console>) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at scala.tools.nsc.Interpreter$Request$$anonfun$loadAndRun$1$$anonfun$apply$17.apply(Interpreter.scala:988) at scala.tools.nsc.Interpreter$Request$$anonfun$loadAndRun$1$$a... scala> -- L.G. Meredith Managing Partner Biosimilarity LLC 7329 39th Ave SW Seattle, WA 98136 +1 206.650.3740 http://biosimilarity.blogspot.com

3 8

Re: [basex-talk] Xquery through the PERL (or Java) API
by Isidro Vila Verde 30 Mar '11

30 Mar '11

Sorry!!! I am been in a process of focus in little details that I missed the most obvious: reboot the server. I just did that and (this) the problem disappear. I am going now to check if the update problem stills or also go disappear. Sorry the noise on the channel. Just a question. The GUI doesn't use the server to access to the DB? Isidro Em 30-03-2011 15:54, Isidro Vila Verde escreveu: > Dear Andreas, > > Thank you for you quick answer~. I didn't know about logs. It is in > fact a great help, but for presente it seems the query is correctly > received. > This is what I got > > 07:50:25.999 [127.0.0.1:39722] LOGIN serprest OK > 07:50:26.193 [127.0.0.1:39722] QUERY(0) declare > namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; > declare option output:method "xml"; let $col := > collection('invoiceDB') let $invoice := > $col/saf:Invoice[saf:InvoiceNo/text() = '279'] return > $invoice OK > 07:50:26.193 [127.0.0.1:39722] QUERY(0) OK > 07:50:26.307 [127.0.0.1:39722] INIT(0) OK > 07:50:26.319 [127.0.0.1:39722] EXEC(0) OK > 07:50:26.320 [127.0.0.1:39722] INFO(0) OK > 07:50:26.320 [127.0.0.1:39722] CLOSE(0) OK > 07:50:26.347 [127.0.0.1:39722] LOGOUT serprest OK > > Regards > > Isidro > > Em 30-03-2011 15:45, Andreas Weiler escreveu: >> Dear Isidro, >> >> as a quick help, you could have a look at the log files on the >> server, they are located >> in your BaseXData folder (.logs). >> >> Here you can check if the query did arrive correctly at the server. >> >> -- Andreas >> >> Am 30.03.2011 um 16:39 schrieb Isidro Vila Verde: >> >>> Dear all, >>> >>> I have a very strange situation when invoking this xquery >>> >>> declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; >>> declare option output:method "xml"; >>> >>> let $col := collection('invoiceDB') >>> let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279'] >>> return $invoice >>> >>> When invoked from GUI it returns the right XML element, but the same >>> query invoked through the perl (or java) API it returns a null result. >>> >>> Bellow is the perl (andf java version) code. What is more strange is >>> that it works for any other value of node saf:InvoiceNo/text(). It >>> just doesn't work for the value 279. >>> >>> In collection invoice DB each saf:Invoice is a single document and >>> the invoiceNo/text()='279' is the "last" document. The collection >>> was just created from a input directory and no other operations was >>> performed on it. >>> >>> Can you help please? >>> >>> I am using the last Basex 6.6 version on ubuntu with java-6-sun. >>> >>> I came to this error when I was in a process to identify why a >>> update operation through the perl API corrupted the database while >>> the same upadate query works fine when invoked from GUI. >>> So, my problem is not exactly this one but I can go any further >>> without resolving this. >>> >>> I notice, on page https://github.com/BaseXdb/BaseX, there is no API >>> version not the last basex 6.6. Should I go back to the version 6.5? >>> >>> >>> Thanks in advance for your help >>> >>> Isidro >>> >>> ------------------Perl Version----------------------------- >>> #!/usr/bin/perl >>> use strict; >>> use lib qw|/var/www/serprest/perl/3rd-party|; >>> use BaseXClient; >>> use warnings; >>> >>> eval { >>> my $session = Session->new("localhost", 1984, "serprest", >>> ".prest,ser"); >>> >>> my $q = q| >>> declare namespace >>> saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; >>> declare option output:method "xml"; >>> >>> let $col := collection('invoiceDB') >>> let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = >>> '279'] >>> return $invoice >>> |; >>> my $query = $session->query($q); >>> $query->init(); >>> print $query->execute(); >>> print $query->info(); >>> $query->close(); >>> $session->close(); >>> }; >>> >>> # print exception >>> print qq|<error>$@</error>| if $@; >>> >>> >>> ------------------Java Version----------------------------- >>> import java.io.IOException; >>> >>> public final class QueryTeste { >>> public static void main(final String[] args) { >>> try { >>> BaseXClient session = >>> new BaseXClient("localhost", 1984, "serprest", ".prest,ser"); >>> >>> try { >>> String input = "declare namespace >>> saf=\"urn:OECD:StandardAuditFile-Tax:PT_1.00_01\";" >>> + "declare option output:method \"xml\";" >>> + "let $col := collection('invoiceDB')" >>> + "let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() >>> = '279']" >>> + "return $invoice"; >>> BaseXClient.Query query = session.query(input); >>> System.out.print(query.init()); >>> while(query.more()) { >>> System.out.println(query.next()); >>> } >>> System.out.print(query.close()); >>> } catch(IOException ex) { >>> ex.printStackTrace(); >>> } >>> session.close(); >>> } catch(IOException ex) { >>> ex.printStackTrace(); >>> } >>> } >>> } >>> ----------------------------------------------- >>> >>> >>> >>> >>> >>> >>> --- >>> avast! Antivirus: Outbound message clean. >>> Virus Database (VPS): 110330-0, 30-03-2011 >>> Tested on: 30-03-2011 15:39:30 >>> avast! - copyright (c) 1988-2011 AVAST Software. >>> http://www.avast.com >>> >>> >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> --- >> avast! Antivirus: Inbound message clean. >> Virus Database (VPS): 110330-0, 30-03-2011 >> Tested on: 30-03-2011 15:47:51 >> avast! - copyright (c) 1988-2011 AVAST Software. >> http://www.avast.com >> >> >> > > > > --- > avast! Antivirus: Outbound message clean. > Virus Database (VPS): 110330-0, 30-03-2011 > Tested on: 30-03-2011 15:54:40 > avast! - copyright (c) 1988-2011 AVAST Software. > http://www.avast.com > > > > > > --- > avast! Antivirus: Inbound message clean. > Virus Database (VPS): 110330-0, 30-03-2011 > Tested on: 30-03-2011 16:16:17 > avast! - copyright (c) 1988-2011 AVAST Software. > http://www.avast.com > > > --- avast! Antivirus: Outbound message clean. Virus Database (VPS): 110330-0, 30-03-2011 Tested on: 30-03-2011 16:22:03 avast! - copyright (c) 1988-2011 AVAST Software. http://www.avast.com

4 7

Fwd: Xquery through the PERL (or Java) API
by Andreas Weiler 30 Mar '11

30 Mar '11

Forwarding to mailing list. Anfang der weitergeleiteten E-Mail: > Von: Isidro Vila Verde <jvverde(a)gmail.com> > Datum: 30. März 2011 16:54:37 MESZ > An: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> > Betreff: Re: [basex-talk] Xquery through the PERL (or Java) API > > Dear Andreas, > > Thank you for you quick answer~. I didn't know about logs. It is in fact a great help, but for presente it seems the query is correctly received. > This is what I got > > 07:50:25.999 [127.0.0.1:39722] LOGIN serprest OK > 07:50:26.193 [127.0.0.1:39722] QUERY(0) declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; declare option output:method "xml"; let $col := collection('invoiceDB') let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279'] return $invoice OK > 07:50:26.193 [127.0.0.1:39722] QUERY(0) OK > 07:50:26.307 [127.0.0.1:39722] INIT(0) OK > 07:50:26.319 [127.0.0.1:39722] EXEC(0) OK > 07:50:26.320 [127.0.0.1:39722] INFO(0) OK > 07:50:26.320 [127.0.0.1:39722] CLOSE(0) OK > 07:50:26.347 [127.0.0.1:39722] LOGOUT serprest OK > > Regards > > Isidro > > Em 30-03-2011 15:45, Andreas Weiler escreveu: >> Dear Isidro, >> >> as a quick help, you could have a look at the log files on the server, they are located >> in your BaseXData folder (.logs). >> >> Here you can check if the query did arrive correctly at the server. >> >> -- Andreas >> >> Am 30.03.2011 um 16:39 schrieb Isidro Vila Verde: >> >>> Dear all, >>> >>> I have a very strange situation when invoking this xquery >>> >>> declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; >>> declare option output:method "xml"; >>> >>> let $col := collection('invoiceDB') >>> let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279'] >>> return $invoice >>> >>> When invoked from GUI it returns the right XML element, but the same query invoked through the perl (or java) API it returns a null result. >>> >>> Bellow is the perl (andf java version) code. What is more strange is that it works for any other value of node saf:InvoiceNo/text(). It just doesn't work for the value 279. >>> >>> In collection invoice DB each saf:Invoice is a single document and the invoiceNo/text()='279' is the "last" document. The collection was just created from a input directory and no other operations was performed on it. >>> >>> Can you help please? >>> >>> I am using the last Basex 6.6 version on ubuntu with java-6-sun. >>> >>> I came to this error when I was in a process to identify why a update operation through the perl API corrupted the database while the same upadate query works fine when invoked from GUI. >>> So, my problem is not exactly this one but I can go any further without resolving this. >>> >>> I notice, on page https://github.com/BaseXdb/BaseX, there is no API version not the last basex 6.6. Should I go back to the version 6.5? >>> >>> >>> Thanks in advance for your help >>> >>> Isidro >>> >>> ------------------Perl Version----------------------------- >>> #!/usr/bin/perl >>> use strict; >>> use lib qw|/var/www/serprest/perl/3rd-party|; >>> use BaseXClient; >>> use warnings; >>> >>> eval { >>> my $session = Session->new("localhost", 1984, "serprest", ".prest,ser"); >>> >>> my $q = q| >>> declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; >>> declare option output:method "xml"; >>> >>> let $col := collection('invoiceDB') >>> let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279'] >>> return $invoice >>> |; >>> my $query = $session->query($q); >>> $query->init(); >>> print $query->execute(); >>> print $query->info(); >>> $query->close(); >>> $session->close(); >>> }; >>> >>> # print exception >>> print qq|<error>$@</error>| if $@; >>> >>> >>> ------------------Java Version----------------------------- >>> import java.io.IOException; >>> >>> public final class QueryTeste { >>> public static void main(final String[] args) { >>> try { >>> BaseXClient session = >>> new BaseXClient("localhost", 1984, "serprest", ".prest,ser"); >>> >>> try { >>> String input = "declare namespace saf=\"urn:OECD:StandardAuditFile-Tax:PT_1.00_01\";" >>> + "declare option output:method \"xml\";" >>> + "let $col := collection('invoiceDB')" >>> + "let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279']" >>> + "return $invoice"; >>> BaseXClient.Query query = session.query(input); >>> System.out.print(query.init()); >>> while(query.more()) { >>> System.out.println(query.next()); >>> } >>> System.out.print(query.close()); >>> } catch(IOException ex) { >>> ex.printStackTrace(); >>> } >>> session.close(); >>> } catch(IOException ex) { >>> ex.printStackTrace(); >>> } >>> } >>> } >>> ----------------------------------------------- >>> >>> >>> >>> >>> >>> >>> --- >>> avast! Antivirus: Outbound message clean. >>> Virus Database (VPS): 110330-0, 30-03-2011 >>> Tested on: 30-03-2011 15:39:30 >>> avast! - copyright (c) 1988-2011 AVAST Software. >>> http://www.avast.com >>> >>> >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> --- >> avast! Antivirus: Inbound message clean. >> Virus Database (VPS): 110330-0, 30-03-2011 >> Tested on: 30-03-2011 15:47:51 >> avast! - copyright (c) 1988-2011 AVAST Software. >> http://www.avast.com >> >> >> > > > > --- > avast! Antivirus: Outbound message clean. > Virus Database (VPS): 110330-0, 30-03-2011 > Tested on: 30-03-2011 15:54:40 > avast! - copyright (c) 1988-2011 AVAST Software. > http://www.avast.com > > >

2 1

Xquery through the PERL (or Java) API
by Isidro Vila Verde 30 Mar '11

30 Mar '11

Dear all, I have a very strange situation when invoking this xquery declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; declare option output:method "xml"; let $col := collection('invoiceDB') let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279'] return $invoice When invoked from GUI it returns the right XML element, but the same query invoked through the perl (or java) API it returns a null result. Bellow is the perl (andf java version) code. What is more strange is that it works for any other value of node saf:InvoiceNo/text(). It just doesn't work for the value 279. In collection invoice DB each saf:Invoice is a single document and the invoiceNo/text()='279' is the "last" document. The collection was just created from a input directory and no other operations was performed on it. Can you help please? I am using the last Basex 6.6 version on ubuntu with java-6-sun. I came to this error when I was in a process to identify why a update operation through the perl API corrupted the database while the same upadate query works fine when invoked from GUI. So, my problem is not exactly this one but I can go any further without resolving this. I notice, on page https://github.com/BaseXdb/BaseX, there is no API version not the last basex 6.6. Should I go back to the version 6.5? Thanks in advance for your help Isidro ------------------Perl Version----------------------------- #!/usr/bin/perl use strict; use lib qw|/var/www/serprest/perl/3rd-party|; use BaseXClient; use warnings; eval { my $session = Session->new("localhost", 1984, "serprest", ".prest,ser"); my $q = q| declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; declare option output:method "xml"; let $col := collection('invoiceDB') let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279'] return $invoice |; my $query = $session->query($q); $query->init(); print $query->execute(); print $query->info(); $query->close(); $session->close(); }; # print exception print qq|<error>$@</error>| if $@; ------------------Java Version----------------------------- import java.io.IOException; public final class QueryTeste { public static void main(final String[] args) { try { BaseXClient session = new BaseXClient("localhost", 1984, "serprest", ".prest,ser"); try { String input = "declare namespace saf=\"urn:OECD:StandardAuditFile-Tax:PT_1.00_01\";" + "declare option output:method \"xml\";" + "let $col := collection('invoiceDB')" + "let $invoice := $col/saf:Invoice[saf:InvoiceNo/text() = '279']" + "return $invoice"; BaseXClient.Query query = session.query(input); System.out.print(query.init()); while(query.more()) { System.out.println(query.next()); } System.out.print(query.close()); } catch(IOException ex) { ex.printStackTrace(); } session.close(); } catch(IOException ex) { ex.printStackTrace(); } } } ----------------------------------------------- --- avast! Antivirus: Outbound message clean. Virus Database (VPS): 110330-0, 30-03-2011 Tested on: 30-03-2011 15:39:30 avast! - copyright (c) 1988-2011 AVAST Software. http://www.avast.com

2 1

Re: [basex-talk] Out of memory
by Christian Grün 30 Mar '11

30 Mar '11

Hi Rupert, nice to hear that! Btw, I've added a little optimizations for mixed location paths (as the one containing the name() function after the location steps), which should perform the discussed optimizations on-the-fly: http://files.basex.org/releases/latest/ It's recommended to switch to that latest snapshot anyway, as it fixes some important index rewritings on collections, which have been temporarily removed in Version 6.6. More feedback is welcome, Christian ____________________________ > Hello Christian! > > You're my personal hero! The query > "dinstinct-values(/descendant::*[randnr]/name())" worked perfectly! 2 GB of > data analysed in 3 seconds, WOW! > > > Greetings and thanks again! > Rupert Jung > > -- > Rupert Jung > <pagina> GmbH > Gesamtherstellung wissenschaftlicher Werke > Herrenberger Str. 51 > D-72070 Tübingen > Handelsregister Stuttgart HRB 380249 > Geschäftsführer: Tobias Ott > > E-Mail: rupert.jung(a)pagina-tuebingen.de > Phone: (0 70 71) 98 76-37 > Fax: (0 70 71) 98 76-22 > > http://www.pagina-online.de > > > -----Ursprüngliche Nachricht----- > Von: Christian Grün [mailto:christian.gruen@gmail.com] > Gesendet: Dienstag, 29. März 2011 18:51 > An: rupert.jung(a)pagina-tuebingen.de > Cc: Andreas Weiler; bjoern.duenckel(a)pagina-tuebingen.de; > basex-talk(a)mailman.uni-konstanz.de > Betreff: Re: [basex-talk] Out of memory > > Rupert, > > thanks for your observation. My assumption is that the (hidden) > descendant-or-self step in your query causes a huge number of > intermediary nodes, which are then reduced to a small result set. In > other words, your query.. > > dinstinct-values(//*[randnr]/name()) > > ..equals the following query: > > > dinstinct-values(/descendant-or-self::node()/child::*[child::randnr]/name()) > > There are several choices how to possibly speed up your query; please > try e.g. to: > > 1. explicitly use the descendant step: > dinstinct-values(/descendant::*[randnr]/name()) > 2. wrap the name function around the location path: > dinstinct-values( name( //*[randnr] )) > 3. directly address the randnr nodes and use a parent step: > dinstinct-values( name( /descendant::randnr/.. )) > > We might add some optimizations to BaseX to automatize some of the > proposed steps. > > If this doesn't help, feel free to give us more feedback. > > Best, > Christian > ___________________________ > > On Tue, Mar 29, 2011 at 5:31 PM, Rupert jung > <rupert.jung(a)pagina-tuebingen.de> wrote: >> Hi Andreas and thanks for your answer, >> >> >> >> unfortunely that didn’t work (java.exe consumed 1.2 GB, then stopped). The >> expected result should not be longer then about 10 element names or so... >> >> >> >> Maybe this could be a bug in basex itself…? >> >> >> >> >> >> ________________________________ >> >> Rupert Jung >> >> <pagina> GmbH >> Gesamtherstellung wissenschaftlicher Werke >> Herrenberger Str. 51 >> D-72070 Tübingen >> >> Handelsregister Stuttgart HRB 380249 >> Geschäftsführer: Tobias Ott >> >> Phone: (0 70 71) 98 76-37 >> Fax: (0 70 71) 98 76-22 >> E-Mail: rupert.jung(a)pagina-tuebingen.de >> http://www.pagina-online.de >> >> >> >> Von: Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] >> Gesendet: Dienstag, 29. März 2011 16:25 >> An: rupert.jung(a)pagina-tuebingen.de >> Cc: basex-talk(a)mailman.uni-konstanz.de; > bjoern.duenckel(a)pagina-tuebingen.de >> Betreff: Re: [basex-talk] Out of memory >> >> >> >> Hi, >> >> >> >> as first hint you could start BaseX with the Xmx flag of Java: >> >> >> >> java -cp BaseX.jar -Xmx1G org.basex.BaseXGUI >> >> >> >> Probably that will solve this issue. >> >> >> >> Kind regards, >> >> Andreas >> >> >> >> Am 29.03.2011 um 16:14 schrieb Rupert jung: >> >> Hi there, >> >> >> >> I’m currently doing some tests with BaseX and a mid-sized database (around > 2 >> GB). >> >> >> >> I wonder myself why I’m not able to process this xquery-statement: >> >> >> >> dinstinct-values(//*[randnr]/name()) >> >> („Give me a list of all elements which have a child-element <randnr> and >> remove all double entries“) >> >> >> >> After about 10 seconds a got a „out of main memory“ error. What’s really >> strange about this: Processing the nodes itself with //*[randnr]/ >> >> works like a charm (but gives me a HUGE amount of text and is not really >> useful for me at all). >> >> >> >> My system: win7-x64, 4 GB RAM, Java 1.6.0_21 >> >> >> >> Thank you in advance, >> >> Rupert Jung >> >> >> >> ________________________________ >> >> Rupert Jung >> >> <pagina> GmbH >> Gesamtherstellung wissenschaftlicher Werke >> Herrenberger Str. 51 >> D-72070 Tübingen >> >> Handelsregister Stuttgart HRB 380249 >> Geschäftsführer: Tobias Ott >> >> Phone: (0 70 71) 98 76-37 >> Fax: (0 70 71) 98 76-22 >> E-Mail: rupert.jung(a)pagina-tuebingen.de >> http://www.pagina-online.de >> >> >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> > >

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk