- BaseX-Talk - mailman.uni-konstanz.de

26 Nov '18

2 1

ArrayIndexOutOfBoundsException when querying some databases
by Sebastián Filippini 23 Nov '18

23 Nov '18

Hello, I have several databases running and when I try to query one of them I'm getting the attached exception trace. Any ideas? Regards, Sebastián Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.6.3 Java: Oracle Corporation, 1.8.0_131 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 4291 at org.basex.io.random.TableDiskAccess.read5(TableDiskAccess.java:172) at org.basex.data.Data.textRef(Data.java:446) at org.basex.data.DiskData.text(DiskData.java:250) at org.basex.query.func.db.DbListDetails$1.get(DbListDetails.java:58) at org.basex.query.func.db.DbListDetails$1.get(DbListDetails.java:1) at org.basex.query.iter.BasicIter.value(BasicIter.java:63) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:68) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.CachedFilter.value(CachedFilter.java:37) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:71) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.List.value(List.java:148) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.If.value(If.java:128) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.List.value(List.java:150) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:71) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.Try.value(Try.java:82) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:185) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:70) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.expr.If.value(If.java:128) at org.basex.query.QueryContext.value(QueryContext.java:405) at org.basex.query.func.StaticFunc.invValue(StaticFunc.java:182) at org.basex.query.func.FuncCall.invoke(FuncCall.java:87) at org.basex.query.func.FuncCall.value(FuncCall.java:61) at org.basex.query.func.FuncCall.iter(FuncCall.java:66) at org.basex.query.QueryContext.iter(QueryContext.java:394) at org.basex.query.scope.MainModule.iter(MainModule.java:121) at org.basex.query.QueryContext.iter(QueryContext.java:330) at org.basex.http.restxq.RestXqResponse.create(RestXqResponse.java:77) at org.basex.http.restxq.RestXqModule.process(RestXqModule.java:104) at org.basex.http.restxq.RestXqFunction.process(RestXqFunction.java:107) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:49) at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:303) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:208) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:220) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:122) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:612) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:170) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:103) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:950) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:116) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:421) at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1070) at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:611) at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:314) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748)

3 3

Re: [basex-talk] BaseX-Talk Digest, Vol 107, Issue 30
by Han (US), Paul P 21 Nov '18

21 Nov '18

Hi Christian, Thank you for pointing out ADDCACHE option. It's working now. Regards, Paul -----Original Message----- From: BaseX-Talk [mailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of basex-talk-request(a)mailman.uni-konstanz.de Sent: Tuesday, November 20, 2018 12:09 AM To: basex-talk(a)mailman.uni-konstanz.de Subject: BaseX-Talk Digest, Vol 107, Issue 30 Send BaseX-Talk mailing list submissions to basex-talk(a)mailman.uni-konstanz.de To subscribe or unsubscribe via the World Wide Web, visit https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk or, via email, send a message with subject or body 'help' to basex-talk-request(a)mailman.uni-konstanz.de You can reach the person managing the list at basex-talk-owner(a)mailman.uni-konstanz.de When replying, please edit your Subject line so it is more specific than "Re: Contents of BaseX-Talk digest..." Today's Topics: 1. Re: db:add fails to add large XML file (Christian Gr?n) 2. Re: OverlappingFileLockException when using db:add concurrently for large XML files (Christian Gr?n) ---------------------------------------------------------------------- Message: 1 Date: Tue, 20 Nov 2018 09:06:54 +0100 From: Christian Gr?n <christian.gruen(a)gmail.com> To: "Han (US), Paul P" <Paul.P.Han(a)boeing.com> Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> Subject: Re: [basex-talk] db:add fails to add large XML file Message-ID: <CAP94bnOMv4qmuFjGDaXn0evJKYwgeyc2bQs8ONGT+CKe-fxqVA(a)mail.gmail.com> Content-Type: text/plain; charset="utf-8" Hi Paul, Too large documents should actually be rejected with a proper error message; but maybe you get around the problem by enabling the ADDCACHE option. Best, Christian Am Di., 20. Nov. 2018, 01:50 hat Han (US), Paul P <Paul.P.Han(a)boeing.com> geschrieben: > Hello, > > > > We encountered the following error intermittently when using db:add > within the XQuery on a large XML. > > > > Regards, > > Paul > > > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]POST failed with response 400: > Improper use? Potential bug? Your feedback is welcome: > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Contact: > basex-talk(a)mailman.uni-konstanz.de > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Version: BaseX 9.1 > beta > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Java: Oracle > Corporation, > 1.8.0_162 > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT OS: Linux, amd64 > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Stack Trace: > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT > java.lang.RuntimeException: Data Access out of bounds: > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - pre value: > 2053429413 > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - table size: > -2143755530 > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - first/next pre value: > -2143755776/-2143755530 > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - #total/used pages: > 8403171/8403171 > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - accessed page: > 8403170 > (8403171 > 8403170] > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.util.Util.notExpected(Util.java:61) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:456) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.io.random.TableDiskAccess.read4(TableDiskAccess.java:165) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.data.Data.id(Data.java:294) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.data.Data.insert(Data.java:828) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.query.up.primitives.db.DBAdd.apply(DBAdd.java:67) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.query.up.DataUpdates.apply(DataUpdates.java:175) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.query.up.Updates.apply(Updates.java:156) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.query.QueryContext.iter(QueryContext.java:350) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.core.cmd.AQuery.query(AQuery.java:109) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.core.cmd.XQuery.run(XQuery.java:22) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.core.Command.run(Command.java:257) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.http.rest.RESTQuery.query(RESTQuery.java:69) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.http.rest.RESTQuery.run0(RESTQuery.java:37) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.core.Command.run(Command.java:257) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.core.Command.execute(Command.java:93) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.core.Command.execute(Command.java:116) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.http.rest.RESTServlet.run(RESTServlet.java:27) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.basex.http.BaseXServlet.service(BaseXServlet.java:59) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > javax.servlet.http.HttpServlet.service(HttpServlet.java:729) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli > cationFilterChain.java:230) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi > lterChain.java:165) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli > cationFilterChain.java:192) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi > lterChain.java:165) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:4 > 19) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:169) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Appli > cationFilterChain.java:192) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFi > lterChain.java:165) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperVa > lve.java:198) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.StandardContextValve.invoke(StandardContextVa > lve.java:96) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.authenticator.AuthenticatorBase.invoke(Authenticat > orBase.java:474) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.ja > va:140) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.ja > va:79) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAcces > sLogValve.java:624) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValv > e.java:87) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java > :349) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.coyote.http11.Http11Processor.service(Http11Processor.java: > 783) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLigh > t.java:66) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractP > rotocol.java:798) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoi > nt.java:1434) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase > .java:49) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.j > ava:1149) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor. > java:624) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThr > ead.java:61) > > 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at > java.lang.Thread.run(Thread.java:748) >

1 0

OverlappingFileLockException when using db:add concurrently for large XML files
by Han (US), Paul P 20 Nov '18

20 Nov '18

Hello, We encountered OverlappingFileLockException error intermittently when using db:add concurrently within the XQuery on a large XML files. Regards, Paul 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT POST failed with response 400: Improper use? Potential bug? Your feedback is welcome: 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT Contact: basex-talk(a)mailman.uni-konstanz.de 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT Version: BaseX 9.1 beta 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT Java: Oracle Corporation, 1.8.0_162 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT OS: Linux, amd64 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT Stack Trace: 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT java.nio.channels.OverlappingFileLockException 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:1108) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.io.random.TableDiskAccess.lock(TableDiskAccess.java:142) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.io.random.TableDiskAccess.<init>(TableDiskAccess.java:86) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.data.DiskData.init(DiskData.java:125) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.data.DiskData.<init>(DiskData.java:84) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.cmd.Open.open(Open.java:99) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.QueryResources.database(QueryResources.java:151) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.func.StandardFunc.checkData(StandardFunc.java:401) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.func.db.DbAdd.item(DbAdd.java:22) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:48) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.scope.MainModule.cache(MainModule.java:98) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.QueryContext.iter(QueryContext.java:337) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.cmd.AQuery.query(AQuery.java:109) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.cmd.XQuery.run(XQuery.java:22) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.run(Command.java:257) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTQuery.query(RESTQuery.java:69) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTQuery.run0(RESTQuery.java:37) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.run(Command.java:257) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.execute(Command.java:93) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.execute(Command.java:116) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTServlet.run(RESTServlet.java:27) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) 2018-11-19T18:34:12.02-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:419) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:169) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:474) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:624) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:349) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:783) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:798) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1434) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) 2018-11-19T18:34:12.03-0800 [APP/PROC/WEB/0]OUT at java.lang.Thread.run(Thread.java:748)

2 1

db:add fails to add large XML file
by Han (US), Paul P 20 Nov '18

20 Nov '18

Hello, We encountered the following error intermittently when using db:add within the XQuery on a large XML. Regards, Paul 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]POST failed with response 400: Improper use? Potential bug? Your feedback is welcome: 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Contact: basex-talk(a)mailman.uni-konstanz.de 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Version: BaseX 9.1 beta 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Java: Oracle Corporation, 1.8.0_162 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT OS: Linux, amd64 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT Stack Trace: 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT java.lang.RuntimeException: Data Access out of bounds: 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - pre value: 2053429413 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - table size: -2143755530 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - first/next pre value: -2143755776/-2143755530 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - #total/used pages: 8403171/8403171 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT - accessed page: 8403170 (8403171 > 8403170] 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.util.Util.notExpected(Util.java:61) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:456) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.io.random.TableDiskAccess.read4(TableDiskAccess.java:165) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.data.Data.id(Data.java:294) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.data.Data.insert(Data.java:828) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.query.up.primitives.db.DBAdd.apply(DBAdd.java:67) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.query.up.DataUpdates.apply(DataUpdates.java:175) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.query.up.Updates.apply(Updates.java:156) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.query.QueryContext.iter(QueryContext.java:350) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.core.cmd.AQuery.query(AQuery.java:109) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.core.cmd.XQuery.run(XQuery.java:22) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.run(Command.java:257) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTQuery.query(RESTQuery.java:69) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTQuery.run0(RESTQuery.java:37) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.run(Command.java:257) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.execute(Command.java:93) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.core.Command.execute(Command.java:116) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.http.rest.RESTServlet.run(RESTServlet.java:27) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:419) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:169) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:474) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:624) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:349) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:783) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:798) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1434) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) 2018-11-19T16:10:45.80-0800 [APP/PROC/WEB/0]OUT at java.lang.Thread.run(Thread.java:748)

2 1

Fulltext index not applied
by Sebastian Zimmer 16 Nov '18

16 Nov '18

Hi, I'm working on a query where the full-text index is not applied, even though it could be (see attached test.xql). I'm sorry for the somewhat complicated look of the example with data-specific XPaths and so on. I really have tried to simplify it as much as I could, but when I further simplify it, the fulltext index actually will be applied or the query is optimized to () due to cached evaluations. But if you take the expression of the variable $number and inline it into below where the variable is referenced, you may see what I mean. The result is an equivalent query (see attached test-ft.xql) to the original one, but now the fulltext index *is* applied. I'm using the BaseX 9.1 snapshot from 2018-11-05. Best, Sebastian -- Sebastian Zimmer sebastian.zimmer(a)uni-koeln.de <mailto:sebastian.zimmer@uni-koeln.de> CCeH Logo <http://cceh.uni-koeln.de> Cologne Center for eHumanities <http://cceh.uni-koeln.de> DH Center at the University of Cologne Twitter Logo <https://twitter.com/CCeHum>@CCeHum <https://twitter.com/CCeHum>

2 4

BaseX on Eclipse OpenJ9?
by vincent van der leun 16 Nov '18

16 Nov '18

Hello, I've been reading for quite some time. Some time back, I was looking for a way to play with XQuery and came across BaseX database system. Being intrigued, I've been following its development since. I found a use-case for a personal web application, which will be querying BaseX for documents stored in XML. A scheduled cron task will be adding new documents to the database from time to time. At the moment my default JVM is Eclipse OpenJ9 (previously IBM J9), based on OpenJDK 8, as it's promising lower memory consumption in many use-cases than Oracle's HotSpot JVM. My first small tests seem to confirm this. Has anyone else been running BaseX on either OpenJ9 or IBM J9? Thanks and keep up the good work. Kind regards, Vincent

2 1

Support for XML with different file extension in GUI
by Kevin Cline 15 Nov '18

15 Nov '18

Hello, In the GUI, is there any way to set the query context to an XML file that has an extension other than .xml ? Renaming the file works, obviously, but this isn't ideal, as the source of the data exports to and imports from another extension. Also, is it possible to enable syntax highlighting for XML files without changing the extension? I added the extension in Options->Preferences->File Filter, but nothing changed. Thank you for your help.

3 8

BaseX 9.1 behaviour of fn:trace
by Kittelmann, Maike 12 Nov '18

12 Nov '18

Dear fellow users, I updated to BaseX 9.1 and I observe an unexpected behaviour of fn:trace http://docs.basex.org/wiki/XQuery_3.1#fn:trace I inserted logging statements to give warnings in case important content is missing, like so: declare function local:my-function ( $id as xs:string?, $value as xs:string? ) as xs:string? { if ( $ value != '' ) then "foo" else trace( $id, 'No foo given for this record! ') } ; So far, the fn:trace output could be read in the Info window of BaseX. Now, the id-value of the above call to trace is ALSO output to the Result window. Even though the documentation states that the behaviour of trace is implementation-dependent, this behaviour seems unexpected and unhelpful. The extra output to result is hard to notice and destroys a possibly fully valid result file (the trace call is only a warning, there is not necessarily an actual error). 1. Is there anything wrong with my XQuery? 2. Why is trace behaving this way in BaseX 9.1? 3. How to best achieve the desired output? (Desired output is: result file unchanged and warning in Info window.) Thank you and best regards, MK

2 1

restxq
by Giuseppe G. A. Celano 11 Nov '18

11 Nov '18

I am trying to make a RESTXQ webservice I created with BaseX 8.3 available in Basex 9.2. I simply copied my "file.xqm" into the webapp folder but, when I type the path of a function contained in it, it does not work ("No function found that matches the request."). Strangely enough, when I minimally modify restxq.xqm, the modifications do not apply either. Any idea about what the problem might be? Thanks.

4 5

Issue with HTTP Server
by Shaun Flynn 09 Nov '18

09 Nov '18

Hello there, I am using BaseX 9.1, and Java version 8. When I use the basexhttp command, the server appears to start fine, but when I navigate to http:\\localhost:8984\rest, I get the following response below. What am I doing wrong? HTTP ERROR 500 Problem accessing /rest. Reason: Server Error Caused by: java.lang.NoSuchMethodError: org.basex.util.TokenBuilder.<init>(Ljava/lang/String;)V at org.basex.http.HTTPConnection.status(HTTPConnection.java:427) at org.basex.http.HTTPConnection.error(HTTPConnection.java:187) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:857) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:535) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1340) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1242) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:503) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) at java.lang.Thread.run(Unknown Source) ------------------------------ Powered by Jetty:// 9.4.12.v20180830 <http://eclipse.org/jetty> ------------------------------ <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_cam…> Virus-free. www.avg.com <http://www.avg.com/email-signature?utm_medium=email&utm_source=link&utm_cam…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

getting the type of an arbitrary node
by Graydon Saunders 09 Nov '18

09 Nov '18

Hi! I am overcome with the cabbage-nature today, because I can't find this in the docs. I am convinced there's a way to go: (//some-element/node()) ! fn:node-type(.) and get a sequence of "element(),element(),text()..." but do not know what the actual function is called. (it's not node-type()!) How ought I to be approaching this? Thanks! Graydon

3 5

create db with options from command line
by Günter Dunz-Wolff 08 Nov '18

08 Nov '18

Hi all, I just set up my first basex-Server on DigitalOcean. So far, everything is working, but I have no experience, how I could create db with options on the command line, I always did it with the GUI. So how is the syntax for CREATE DB xxx /path with Options - CHOP no - Indices for Text, Attributes and Tokens - Fulltext-Index with Language German, Case Sensitive and Diacritics Thanks for any help. Guenter

2 3

Perceived performance of REST API
by Sebastian Zimmer 07 Nov '18

07 Nov '18

Hi, I'm looking for a way to increase the *perceived* performance of the REST API. On my web page there's a results list that is updated automatically when the text content of an input field is changed. This means that on each keystroke by the user, a GET request to the REST API api is sent to obtain the new results list. One GET request takes about 800 ms, which is acceptable to me given the complexity of the query and the amount of data. The problem is that when the user types faster than the queries are executed, the app starts to respond very slowly, because there are now several requests pending. BaseX seems to execute all of them in parallel and it may well take up to 14 seconds until it returns the results of the most recent search query. Is there a way to tell BaseX to abort running queries (by a specific user) to privilege the most recent query (of this user)? Could this be done with the Jobs module? Or is there a better way to implement such a search? Best regards, Sebastian -- Sebastian Zimmer sebastian.zimmer(a)uni-koeln.de <mailto:sebastian.zimmer@uni-koeln.de> Cologne Center for eHumanities <http://cceh.uni-koeln.de> DH Center at the University of Cologne @CCeHum <https://twitter.com/CCeHum>

3 3

BaseX 9.1 on Maven Repository?
by Han (US), Paul P 07 Nov '18

07 Nov '18

Hello, Do you when the latest BaseX 9.1 release will be available from Maven Repository (https://mvnrepository.com/artifact/org.basex/basex)? Regards, Paul

2 1

Re: [basex-talk] http-server error with version 9
by Günter Dunz-Wolff 07 Nov '18

07 Nov '18

You are wright. I’ve overseen a second WEB-INF Folder in BaseXWeb. Now with the new WEB-INF config files everything is running. Thanks a lot. > Am 06.11.2018 um 18:17 schrieb Christian Grün <christian.gruen(a)gmail.com>: > >> Then I changed the default .basex file from >> WEBPATH = /Users/gdw/basex/webapp >> to >> WEBPATH = /Users/xxx/Documents/kleist/BaseXWeb > > So I assume (see before..) that the jetty.xml and web.xml files from > your existing project need to be updated? Jetty 9 uses a different > configuration syntax, so you’ll need to compare the old and new > WEB-INF configuration files.

1 0

Programmatically extracting function signatures
by Bridger Dyson-Smith 07 Nov '18

07 Nov '18

Hi all - I was curious if there was a way to extract function signatures from BaseX. I'm currently reading through the (excellent) wiki but was curious if there was a more automated process I might be able to use. I've been trying to think of something clever with function-lookup, but I can't seem to make it dynamic based on module namespace; e.g. ``` for $fun in function-lookup(xs:QName("archive:delete"), 1) return $fun ``` I may just grab the wiki and parse it :), but I'm also interested in changes between versions of the processor. Any thoughts or suggestions would be greatly appreciated! Best, Bridger

4 7

Maybe interesting to you, Christian (et al)?
by Andreas Mixich 06 Nov '18

06 Nov '18

Hello Christian & Co., nothing BaseX related, and maybe totally uninteresting to you, but as it seems, you put some major efforts into the full text search, it could be one of those nerdy passions, where one is just hungry and wants more food on the topic: TRE: A Regex Engine with Approximate Matching / http://ducktape.blot.im/tre-a-regex-engine-with-approximate-matching -- Minden jót, all the best, Alles Gute, Andreas Mixich

1 0

rest run query binding problem
by Maximilian Gärber 06 Nov '18

06 Nov '18

Hello, given the query file [1] called by http://localhost:8984/rest?run=argon/create-database.xq&DB=test-db&CHOP=no&… I get the error: Stopped at ., 3/18: [XPDY0002] No value assigned to $CHOP. When I change the value, e.g. to nono I get Invalid 'CHOP' value 'nono'; must be 'yes', 'no', or a boolean. Running on basex 9.1 [1] create-database.xq (:~ New database name. :) declare variable $DB as xs:string external; declare variable $CHOP as xs:string external; declare variable $FTINDEX as xs:string external; declare variable $TEXTINDEX as xs:string external; declare variable $ATTRINDEX as xs:string external; declare variable $TOKENINDEX as xs:string external; let $exists := db:exists($DB) let $meta := concat('~meta_', $DB) let $history := concat('~history_', $DB) return if(not($exists)) then ( db:create($meta), db:create($history), db:create($DB, (), (), map { 'chop' : $CHOP , 'ftindex' : $FTINDEX , 'textindex' : $TEXTINDEX , 'attrindex' : $ATTRINDEX , 'tokenindex' : $TOKENINDEX }) ) else ()

2 2

http-server error with version 9
by Günter Dunz-Wolff 06 Nov '18

06 Nov '18

Hi all, I’m trying to update to version 9 of basex. Everything is OK, but I’m not able to run basexhttp. I’m getting the following message: /Users/gdw/Downloads/basex-2/bin/basexhttp ; exit; gdw-imac:~ gdw$ /Users/gdw/Downloads/basex-2/bin/basexhttp ; exit; /Users/gdw/.basex: writing new configuration file. [main] INFO org.eclipse.jetty.util.log - Logging initialized @370ms to org.eclipse.jetty.util.log.Slf4jLog [main] WARN org.eclipse.jetty.xml.XmlConfiguration - Config error at <Call name="addConnector"><Arg> <New class="org.eclipse.jetty.server.nio.SelectChannelConnector"><Set name="host"><SystemProperty name="org.basex.serverhost" default="0.0.0.0"/></Set><Set name="port"><SystemProperty name="org.basex.serverport" default="8984"/></Set><Set name="maxIdleTime">60000</Set><Set name="reuseAddress">true</Set><Set name="Acceptors">2</Set><Set name="requestHeaderSize">65535</Set></New> </Arg></Call> org.eclipse.jetty.server.nio.SelectChannelConnector logout Saving session... ...copying shared history... ...saving history...truncating history files... ...completed. [Prozess beendet] All versions till 8.6.7 are running. My system is MacOS X Mojave. Java-Version is: java version "1.8.0_191" Java(TM) SE Runtime Environment (build 1.8.0_191-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode) I hope, there is help. Thanks in advance. Guenter

2 3

Potential Bug 9.0
by Dieter Zanzinger 05 Nov '18

05 Nov '18

Dear BaseX-Team, I encountered some unexpected behavour, maybe a bug? I declare a collection of function-signatures. Then I iterate over the collection inside a copy/modify-construct. Each function adds a node to the database. This works as expected: declare variable $_:abschlussqueries := (_:f1#2 , _:f2#2); declare %updating %rest:path('treez/ab4') function _:abschluss4() as element() { <Postabschluss>{ ( try{ let $db := doc('FGfax')/Dateien/Datei for $d in $db return ( copy $c := $d modify ( for $funct at $counter in $_:abschlussqueries return ( (: prof:dump("bla: " || $counter) , :) prof:void(""), $funct($c, $counter) ) ) return ( $c ) ) } catch * { let $db := doc('FGfax')/Dateien return error(xs:QName("dieter:norights10"), "Error: "|| $err:code || ': ' || $err:description , 418 ) } ) }</Postabschluss> }; declare %updating function _:f1($c, $counter ) { try {( filepath:copy-to("C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla.xml","C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla1.xml"), insert node <f1>function1 </f1> as last into $c )} catch * { insert node <f1>{"Error: "|| $err:code || ': ' || $err:description}</f1> as last into $c } }; declare %updating function _:f2($c, $counter ) { try {( filepath:copy-to("C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla.xml","C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla1.xml"), insert node <f2>function2 </f2> as last into $c )} catch * { insert node <f2>{"Error: "|| $err:code || ': ' || $err:description}</f2> as last into $c } }; ————————————— Result: <?xml version="1.0" encoding="ISO-8859-1"?> <Postabschluss> <> <Datei uuid="8ad03f50-4b9c-461a-b818-1a97dc5735e9"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061002-154925-00498171251x1800.pdf</sortedPath> <f1> <>function1 </f1> <f2> <>function2 </f2> </Datei> <Datei uuid="26a3aee7-a0d8-4b8d-acd4-90554c8ab28c"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061003-154928-0049242344x1801.pdf</sortedPath> <f1> <>function1 </f1> <f2> <>function2 </f2> </Datei> <Datei uuid="af0548aa-08cf-464a-839d-421363f452ce"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061220-154966-004999429025.pdf</sortedPath> <f1> <>function1 </f1> <f2> <>function2 </f2> </Datei> —————— But if remove the line: prof:void("“), the result is: <?xml version="1.0" encoding="ISO-8859-1"?> <Postabschluss> <> <Datei uuid="8ad03f50-4b9c-461a-b818-1a97dc5735e9"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061002-154925-00498171251x1800.pdf</sortedPath> </Datei> <Datei uuid="26a3aee7-a0d8-4b8d-acd4-90554c8ab28c"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061003-154928-0049242344x1801.pdf</sortedPath> </Datei> <Datei uuid="af0548aa-08cf-464a-839d-421363f452ce"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061220-154966-004999429025.pdf</sortedPath> </Datei> </Postabschluss> Do you have any explanation for this behavour? Some other updating expression instead of prof:void(„“) works as well. But if my only call is to the functions, it does not work. Sincerely Dieter Zanzinger

2 1

Conceptual problems using BaseX from Python
by Kristian Kankainen 03 Nov '18

03 Nov '18

Hello, XQuery is a lovely language and together with BaseX it is very lovely. But now, for a project that need Python, I find difficulties understanding the general workflow communicating between BaseX and Python. My basic situation boils down to 1) execute a query on BaseX that returns a list of data 2) analyse every item in the in Python 3) push the analysis result back in to BaseX. I have done updates like this solely in XQuery but this time I need the analysis part done in Python. Since I seem to only get a list of strings out of a query executed by the client, is this usecase even possible? Below is attached my sample running code Best regards, Kristian K ```Python from BaseXClient import BaseXClient # open a session session = BaseXClient.Session('localhost', 1984, 'admin', 'admin') # execute a query that returns a list of entry elements query = session.query(""" let $list := <list> <entry> <a>1</a> 2 </entry> <entry> <a>1</a> 2 <c>3</c> </entry> </list> let $items := for $entry in $list/entry[not(exists(./c))] return $entry return $items """ ) # process each item of the query for typecode, item in query.iter(): print(type(item)) print(item) session.close() ``` This returns simply: <class 'str'> # the type of returned item is of class 'str' <entry> # this is the content of the plain text object <a>1</a> 2 </entry>

3 2

blanks after , in set no longer allowed...
by Peter Villadsen 01 Nov '18

01 Nov '18

Hi I installed version 9.1. the other day, and I found that my app did not work after that. A little debugging quickly identified the culprit. When I submit queries to the backend I calculate a set of predefined variable bindings used in the queries. It turns out I did: public string CalculateBindingsString(params Tuple<string, string>[] vars) { string result = string.Empty; if (vars != null) { foreach (var v in vars) { var name = v.Item1; var value = v.Item2; if (ValidateVariableName(name)) { if (result.Any()) result += ", "; result += name + "=" + value; } } } return result; } See the blank there? That caused the subsequent USE BINDINGS call to fail. Removing the blank fixed it all. If this was part of a bug fix, the fix was a breaking change. Is there a list of such breaking changes for each release? Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

1 0

BaseX 9.0: The Spring Edition!
by Christian Grün 01 Nov '18

01 Nov '18

Dear BaseX aficionados, We are very happy to announce the release of BaseX 9.0! The new version of our XML database system and XQuery 3.1 processor includes some great new features and a vast number of minor improvements and optimizations. It’s both the usage of BaseX in productive environments as well as the valuable feedback of our open source users that make BaseX better and better, and that allow and motivate us to keep going. Thanks to all of you! Along with the new release, we invite you to visit our relaunched homepage: http://basex.org/. Java 8 is now required to run BaseX. The most prominent features of Version 9.0 are: XQUERY - Comprehensive extensions in the internal XQuery optimizer framework - Dynamic hash joins rewritings of general comparisons - Register query jobs as persistent services - Process very large CSV files via the new CSV 'xquery' format - Update Module: higher-order functions for performing updates - Unified static typing, including maps, arrays and function items - COPYNODE: Lightweight copying of XML fragments - ENFORCEINDEX: Enforce rewriting for index access STORAGE - Improved database compression (short strings, whitespaces) WEB APPLICATIONS - Permissions layer: Unified definition of RESTXQ access patterns - RESTXQ: Full support for client- and server-side quality factors - REST: Run BaseX command scripts - Web server upgrade to Jetty 9 REPOSITORIES - Combined packaging mechanism (XQuery and Java) - Java Packaging: Bundling of additional libraries DISTRIBUTIONS - Revised detection and configuration of BaseX home directory - Windows executable: better detection of Java libraries DBA: BASEX DATABASE ADMINISTRATION - Improved editing and evaluation of XQuery modules - Revised file, session and job management More details can be found on our homepage. We are looking forward to your feedback. Enjoy and have fun, Christian, BaseX Team

7 8

ArrayIndexOutOfBoundsException: Maximum array size reached
by Han (US), Paul P 30 Oct '18

30 Oct '18

Hello, We encountered the below error when using this API: archive:extract-to($tempDirPath, file:read-binary($zipFilePath)). The zip file size is 51396593 and the inflated file size is 2796146027. Please let me know if you need additional information. We expect our data files to be at least 10 times bigger than these numbers. POST failed with response 400: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de> Version: BaseX 9.0.2 Java: Oracle Corporation, 1.8.0_121 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: Maximum array size reached. at org.basex.util.Array.newSize(Array.java:238) at org.basex.util.Array.newSize(Array.java:227) at org.basex.io.out.ArrayOutput.write(ArrayOutput.java:32) at java.io.OutputStream.write(OutputStream.java:116) at org.basex.query.func.archive.ArchiveIn.read(ArchiveIn.java:77) at org.basex.query.func.archive.ArchiveExtractTo.item(ArchiveExtractTo.java:40) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:48) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:330) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) at org.basex.core.cmd.AQuery.query(AQuery.java:100) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) at org.basex.http.rest.RESTQuery.query(RESTQuery.java:69) at org.basex.http.rest.RESTQuery.run0(RESTQuery.java:37) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.core.Command.execute(Command.java:116) at org.basex.http.rest.RESTServlet.run(RESTServlet.java:27) at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) at org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:419) at org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:169) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:474) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:624) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:349) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:783) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:798) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1434) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Regards, Paul

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk