BaseX-Talk

basex-talk@mailman.uni-konstanz.de

4 participants
5268 discussions

Potential bug?
by Philippe Pons 15 Dec '22

15 Dec '22

Hi all, I tried to replace a database in the BaseX Database Administration (dba). A simple task that I often do. But this time, I get this message: Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact:basex-talk@mailman.uni-konstanz.de Version: BaseX 9.2.1 Java: Oracle Corporation, 1.8.0_231 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 1 at org.basex.io.random.TableDiskAccess.fpre(TableDiskAccess.java:507) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:468) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:156) at org.basex.data.Data.kind(Data.java:304) at org.basex.query.value.node.DBNode.<init>(DBNode.java:50) at org.basex.query.value.seq.DBNodeSeq.get(DBNodeSeq.java:139) at org.basex.query.value.seq.DBNodeSeq.get(DBNodeSeq.java:164) at org.basex.query.func.db.DbOpen.value(DbOpen.java:19) at org.basex.query.func.StandardFunc.optimize(StandardFunc.java:82) at org.basex.query.expr.Arr.compile(Arr.java:43) at org.basex.query.expr.path.Path.compile(Path.java:129) at org.basex.query.expr.If.compile(If.java:58) at org.basex.query.func.StaticFunc.comp(StaticFunc.java:69) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) at org.basex.query.QueryContext.compile(QueryContext.java:312) at org.basex.query.QueryContext.iter(QueryContext.java:331) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:56) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:54) at org.basex.http.BaseXServlet.service(BaseXServlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:505) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:786) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:743) at java.lang.Thread.run(Thread.java:748) Could you help me to find a solution? Many thanks, Philippe

3 3

Re: [basex-talk] parsing error using the new http-client in BaseX 10.x http module
by Andreas Hengsbach | nexoma 07 Dec '22

07 Dec '22

Sorry, it was a simple dependency problem. I forgot to include tagsoup. Best regards Andreas

1 0

parsing error using the new http-client in BaseX 10.x http module
by Andreas Hengsbach | nexoma 07 Dec '22

07 Dec '22

Hi all, it seems that the new http client in basex 10.x behaves differently when evaluating the response. If, for example, an API that usually delivers JSON then delivers an HTML page on a 404, I run into a parser problem. [experr:HC0002] Conversion failed: Stopped at ., 1/1: [json:parse] (1:1): Unexpected JSON value: '<br />...'. The error page is correctly delivered with content type "text/html". How is it decided which parser to use? I would have expected the content type of the response to be used. Has anyone else observed this behaviour? This is how I used the http module: let $response := http:send-request(<http:request method='post' ><http:body media-type='application/json'/></http:request>, fn:concat($host, $apiKey), $body) return ( (: do someting :) ) The problem definitely does not occur with BaseX 9.x. Many thanks and best regards Andreas

1 0

BaseX GraalVM native-image
by dliakh＠gmail.com 03 Dec '22

03 Dec '22

Hello Everyone, Didn't anybydy try and is that possible to convert the BaseX JAR to a "native-image" (using GraalVM's convertor or any other tool maybe)? The reason: I have to use BaseX in scripts and Makefiles as an XQuery engine and have to call it often. The problem is the JVM startup time affects the performance significantly when it has to start multiple times. I tried just naïvely running the GraalVM's native-image convertor against the BaseX103.jar file and got errors with long backtraces (that I didn't quite understand to be honest). Did anybody try that, maybe? Best regards

5 6

RBaseX version 1.1.2
by Ben Engbers 02 Dec '22

02 Dec '22

Hi, Version 1.1.2 of RBaseX-client has been accepted by CRAN. Differences with version 1.1.1 are that 'Store' and 'Replace' have been replaced by 'put' and 'putBinary' and that now the tests have to been executed with Test/testBasex credentials. The daily download-average of RBaseX is 10. But since I haven't received any feedback yet, I don't know to what extent this package contributes to Basex's popularity. Ben Engbers

1 0

Server Performance
by Johannes Bauer 01 Dec '22

01 Dec '22

Hi all, we have two Linux server VMs where our BaseX application is running - Integration - Production The used database is about 5 GB including a fulltext index and is identical on both systems. The production VM is more potent in all aspects (CPU, RAM, Disk IO, ...). Dispite all of that we do not get any significantly better performance in the production system. On top of that we even have XQuery requests that sporadically take very long (> 1 minute) that would normally take only less than one second. Again these long requests only happen in the production environment. My first assumption was that maybe it is due to additional load on the server from other sources. But that was not the case. We have the spikes even when there is no load at all. Has anyone similar experiences or any ideas what could be the cause for this behaviour? Best Regards Johannes

3 3

right way to create a db in the middle of processing?
by Graydon Saunders 28 Nov '22

28 Nov '22

Hello -- So I've got a pattern where I want to: 1. perform some processing using proc:execute() on a directory tree of XML files (easy) 2. load the result of the processing (a parallel structure tree of XML files) into a new db (in principle, easy; db:create() does this) 3. extract information from the newly created db and write that to a file (easy) 4. use proc:execute() to run different processing on the file written in step 3 (easy, I think) 5. load the result (thankfully a single file) and process it with a query (easy, I can stuff that in a function) Ideally, this winds up as something invoked from a single query file as a sequence of functions because its eventual fate is to be part of an automated test that would ideally be a "run this one thing, look at the boolean result". I hang up on step 2; so far as I can tell, there isn't a way to say "go create a database and then make it usable to these other modules that are guaranteed not to happen until db:create() has completed" but this seems like such a common thing to want to do that I feel like I must be missing something. Thanks! Graydon

5 8

Logging in JSON format
by Huib Verweij 28 Nov '22

28 Nov '22

Hi, from https://docs.basex.org/wiki/Logging I understand all logging in BaseX uses a fixed text format. For our Kibana/Elastic Search logging solution in OpenShift it is recommended to use JSON as the logging format. Is it possible to make BaseX generate logs in JSON format? If not, does anyone have any experience importing the BaseX logs into Kibana/Elastic Search? Hartelijke groet, Huib Verweij.

2 1

Fulltext search with wildcards
by Johannes Bauer 23 Nov '22

23 Nov '22

Hi, I have another question regarding fulltext search performance with wildcards. Our fulltext index is rather big with 1.3 GB and about 500.000 entries. When I use the following search where there are no matches: *ft:search('db', 'CT020/.*/P', map{'wildcards':true()})* it takes about 10 seconds to get the empty result. The query requires a big amount of free memory. If I use this query here (that also has no matches): *ft:search('db', 'CT.*/20/P', map{'wildcards':true()})* it only takes about some milliseconds. Any ideas why the placement of the wildcard has such big impact on the performance? Best Regards Johannes

2 1

Working with custom stores
by Tim Thompson 22 Nov '22

22 Nov '22

Hello, Using the store module, is it possible to read and merge multiple custom stores into main memory, or to set a particular store as context for a query? Or, do I need to serialize the stores, e.g., as JSON and then create databases for them? Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research www.linkedin.com/in/timathompson timothy.thompson(a)yale.edu

2 7

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk