BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5269 discussions

insert cause db error, often.
by easy 03 Jan '14

03 Jan '14

I lost faith almost. do insert doc continuously ,query often cause : Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.8 beta Java: Sun Microsystems Inc., 1.6.0_24 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 4096 at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:196) at org.basex.data.Data.kind(Data.java:283) at org.basex.query.value.node.DBNode$5.next(DBNode.java:366) at org.basex.query.value.node.DBNode$5.next(DBNode.java:356) at org.basex.query.path.IterStep$1.next(IterStep.java:39) at org.basex.query.path.IterStep$1.next(IterStep.java:31) at org.basex.query.path.IterPath$1.next(IterPath.java:70) at org.basex.query.path.IterPath$1.next(IterPath.java:41) at org.basex.query.func.FNAggr.item(FNAggr.java:44) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.MainModule.iter(MainModule.java:96) at org.basex.query.QueryContext.iter(QueryContext.java:309) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:81) at org.basex.core.cmd.AQuery.query(AQuery.java:89) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:329) at org.basex.core.Command.execute(Command.java:94) at org.basex.server.LocalSession.execute(LocalSession.java:121) at org.basex.server.Session.execute(Session.java:37) at org.basex.core.Main.execute(Main.java:146) at org.basex.core.Main.execute(Main.java:130) at org.basex.core.Main.console(Main.java:90) at org.basex.BaseX.<init>(BaseX.java:168) at org.basex.BaseX.main(BaseX.java:38) -- 此致 easy 莫愁前路无知己，天下谁人不识君。

2 2

Re: [basex-talk] restxq with html form get, bug response
by e-letter 02 Jan '14

02 Jan '14

On 27/12/2013, e-letter <inpost(a)gmail.com> wrote: > declare > %rest:path("/form") > %rest:GET > function page:post() > { > let $x := > fn:doc("xmldatabasefile.xml")/bookstore/book/title[contains(text(),'Everyday > Italian')]/parent::* > return $x > }; ... was changed to: declare %rest:GET %rest:path(./xmldatabasefile.xml/bookstore/book) function book:bookstore() as element(bookstore) { <bookstore> { let $x := fn:doc("xmldatabasefile.xml")/bookstore/book/title[contains(text(),'Everyday Italian')]/parent::* return $x } </bookstore> }; The server result: HTTP ERROR 500 Problem accessing /. Reason: Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7.2 Java: Sun Microsystems Inc., 1.6.0_24 OS: Linux, i386 Stack Trace: java.lang.NumberFormatException at java.math.BigDecimal.<init>(BigDecimal.java:516) at java.math.BigDecimal.<init>(BigDecimal.java:739) at org.basex.query.value.item.Dec.<init>(Dec.java:35) at org.basex.query.QueryParser.numericLiteral(QueryParser.java:2200) at org.basex.query.QueryParser.literal(QueryParser.java:2173) at org.basex.query.QueryParser.annotation(QueryParser.java:475) at org.basex.query.QueryParser.prolog2(QueryParser.java:423) at org.basex.query.QueryParser.parseLibrary(QueryParser.java:247) at org.basex.query.QueryContext.parseLibrary(QueryContext.java:194) at org.basex.http.restxq.RestXqModule.parseModule(RestXqModule.java:130) at org.basex.http.restxq.RestXqModule.parse(RestXqModule.java:51) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:137) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:104) at org.basex.http.restxq.RestXqModules.find(RestXqModules.java:59) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:27) at org.basex.http.BaseXServlet.service(BaseXServlet.java:58) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:457) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:949) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1011) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:668) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:679) Powered by Jetty://

1 0

Urgent Help, concurrently update db cause db error, how???
by easy 01 Jan '14

01 Jan '14

Hi,all, I have a restxq web service to do insert or update xml doc , which is called by many clients to provide xml data to db, there will be 500000 files to provide to basex server. I have found some problem few times : 1) often, after insert tens of thousands xml file, the db "list" will cause error,cause db corrupt, I don't know why, How, please help me. I don't know how to control the concurrently update db. 2) I often found there will automatically startup a basexhttp service in the server even the manually started service still run. ???, maybe the "basexhttp stop" command can't stop the service though it say stopped. the restxq service code as fellow: ---------------------------------------------------------- declare %output:method("xml") %output:omit-xml-declaration("no") %output:media-type("application/xml") %updating %rest:path("/add_ehr_doc") %rest:POST("{$body}") %rest:header-param("pid","{$pid}") %rest:header-param("doc_id","{$doc_id}") %rest:header-param("op","{$op}","APND") function ehr:add_ehr_doc( $body,$pid as xs:string,$doc_id as xs:string,$op as xs:string ) { let $dbname: ='myehr' let $fp:=substring($pid,1,6)||'/'||substring($pid,7,8)||'/'||substring($pid,15)||'.xml' (: pid is a patient id code as: area_code-section_code-serialnumber :) return try{ if (db:exists($dbname,$fp)) then ( insert node ($body//*:DataSet) into (doc($dbname||"/"||$fp)//*:BasicDataset), db:output(<msg><Ack>200:append</Ack><Url>{$fp}</Url></msg>) ) else ( db:add($dbname, $body,$fp),db:output(<msg><Ack>200 new add</Ack><Url>{$fp}</Url></msg>) ) } catch *{ db:output(<msg><Ack>201 error</Ack></msg>) } }; -- 此致林晓东莫愁前路无知己，天下谁人不识君。

1 0

Re: [basex-talk] Again need help on ft:search() :)
by Dirk Kirsten 31 Dec '13

31 Dec '13

Hello Anand, please make sure to send all help requests to the mailing list - this way all users can benefit from it. At the moment I don't see much potential to improve your query (but I am no expert on full-text search, so this is merely my opinion). The "all words" keywords are unnecessary, as you only use one word. The most important consideration is if the Full-Text Index is actually applied to your query. You can check by analyzing the query info, something like "Applying full-text index" should be found. You can find more information at https://docs.basex.org/wiki/Full-Text#Index_Processing So, have you created a Full-Text Index? This should definitely be your first step, as this will certainly boost your performance. You should also check the query info as suggested and also take a look at the optimized query plan given by the compiler, as this can point you to some bottlenecks in your query. Cheers, Dirk On 28/12/13 10:25, Anand Chiney wrote: > Dear Dirk, > > How are you ? > > Need some help on using ft:search() in following condition, if applicable. > > Following is the structure of XML file. Around 6 GB of articles in 3 XML DBs > > --- > > > <Docs> > <Doc> > <Title name="Speed of Light" author="John Best" /> > <SDesc> > <Summary> > <SSum> > <Keyword w="Speed of Light"/> > Short Summary Text here. > </SSum> > <LSum> > Long Summary. > </LSum> > </Summary> > </SDesc> > <LDesc> > Complete Description of the Article. > </LDesc> > </Doc> > <Doc> > <Title name="Vibration Analysis" author="John Best" /> > <SDesc> > <Summary> > <SSum> > <Keyword w="Vibration"/> > Short Summary Text here. > </SSum> > <LSum> > <P>Long Summary Para 1</P> > <P>Long Summary Para 2</P> > </LSum> > </Summary> > </SDesc> > <LDesc> > Complete Description of the Article. > </LDesc> > </Doc> > </Docs> > > Execution of below query is taking around 1 min !!! > > for $db in("Doc1","Doc2", "Doc3") > for $x in doc($db)/Docs/Doc > where $x/SDesc/Summary/SSum/Keyword/lower-case(@w) contains text > "vibration" and ($x/SDesc/Summary/LSum/P/text() contains text "spring" all > words or SDesc/Summary/SSum/text() contains text "spring" all words) > return $x/Title/@name > > Can this be queried using ft:search() ? I tried but failed. > > > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

:)
by Montante Tuggles 30 Dec '13

30 Dec '13

Happy new year !

1 0

BaseX for noobs : how to add user module ?
by jean-marc Mercier 30 Dec '13

30 Dec '13

Hello, I am trying to add some external features to BaseX, and would like to use them into a BaseX client XQUERY module. I can't see any simple way to do it, is there any ? Here is the scenario : suppose that you want to add a super-mega map module to BaseX, let us call it supermegamap, that is a collection of functions : supermegamap:new, supermegamap:contains, supermegamap:get. I would like to use my supermegamap through BaseX via a xquery module : let $my_supermegamp := supermegamap:new(). I see only two quite not very handy ways to do this : 1) The first one is to use JAVA bindings. Ok, it will work, but is not really elegant. 2) The second one is to fork BaseX code : adding the JAVA code to BaseX, modifying the file Function.JAVA. That might work, should be efficient, but it is quite heavy, and overall, will be most probably a dead-code the next time I will have to upgrade BaseX. Is there any alternative way ? Thx Jean-Marc

3 3

Re: [basex-talk] BaseX-Talk Digest, Vol 48, Issue 60
by Anand Chiney 30 Dec '13

30 Dec '13

Hi, The number (1, 2, 3,....) are the various searches done.. The huge amount (its not $$$$ ;) ) is the memory usage in K as indicated by Windows Task Manager. Query's, rather XQuery's are of various kinds, including XQuery functions like disitnct-values, casting functions, and many more.. some using joins, some using ft:search()... Well, I think, the reason would be in JAVA code itself, not related to BaseX.. On Mon, Dec 30, 2013 at 4:30 PM, <basex-talk-request(a)mailman.uni-konstanz.de > wrote: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Memory usage !! (John Best) > 2. Re: Memory usage !! (jean-marc Mercier) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 30 Dec 2013 16:04:40 +0530 > From: John Best <johnbest5673(a)gmail.com> > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] Memory usage !! > Message-ID: > <CAO14Co4C85Y+VA6fURygkb-jUbeqX4qJ0Hm= > biduq8vMFDnzKg(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Dear Team, > > I have developed and application using Eclipse RCP. I am using BaseX 7.6 to > store XML data. > > Yesterday, when I was testing the application with various kind of > searches, the response was quite slow as I went ahead with more and more > searches. > > To my surprise, I notices the in Windows Task Manager, the javaw.exe was > consuming more memory... Then I restarted the laptop and did this procedure > again > > Following is the memory usage - > > 1 - 84920 > 2 - 101584 > 3 - 108224 > 4 - 109284 > 5 - 111768 > 6 - 128468 > 7 - 160616 > 8 - 180212 > 9 - 198313 > 10 - 212592 > > > Why this is so ? and how can I reduce this memory usage by javaw.exe ? > > > > -- > Have a nice day > JBest >

1 0

Memory usage !!
by John Best 30 Dec '13

30 Dec '13

Dear Team, I have developed and application using Eclipse RCP. I am using BaseX 7.6 to store XML data. Yesterday, when I was testing the application with various kind of searches, the response was quite slow as I went ahead with more and more searches. To my surprise, I notices the in Windows Task Manager, the javaw.exe was consuming more memory... Then I restarted the laptop and did this procedure again Following is the memory usage - 1 - 84920 2 - 101584 3 - 108224 4 - 109284 5 - 111768 6 - 128468 7 - 160616 8 - 180212 9 - 198313 10 - 212592 Why this is so ? and how can I reduce this memory usage by javaw.exe ? -- Have a nice day JBest

2 1

[ANN] Higher-Order XQuery Modules
by Leonard Wörteler 30 Dec '13

30 Dec '13

Hello everyone, I want to announce the small collection of XQuery 3.0 modules [1] that I've written over the last few weeks. I use them mostly for testing the BaseX optimizer, but there should be no BaseX-specific XQuery code in the repository. I have implemented some purely functional data structures including maps based on AVL and Red-Black Trees that both support arbitrary values as keys and efficient deletion. Some documentation can be found under each module's namespace URI or under [2]. Constructive feedback of any kind (suggestions, bug reports, pull requests) would be much appreciated. Hope you like it, cheers, Leo [1] https://github.com/LeoWoerteler/xq-modules/ [2] http://www.woerteler.de/xquery/modules/

2 3

INLINER : bug ?
by jean-marc Mercier 30 Dec '13

30 Dec '13

Hi Everybody @Leo, there might be a bug in the BaseX INLINER (I am currently profiling your module https://github.com/LeoWoerteler/xq-modules/). To reproduce it : - use the 3 files attached. - Edit baseX config file .baseX, set the following Local options : # Local Options INLINELIMIT = 5 - launch the XQUERY file MapProfiler.xquery. With these settings, the profile function works finely. Then - Edit baseX config file .baseX, set the following Local options : # Local Options INLINELIMIT = 6 With these settings, I am raising a [XPTY0004] Single item expected error. Cheers, Jean-Marc

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk