BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Schema 1.1 validation and Xerces cta-full-xpath-checking?
by Zimmel, Daniel 15 Feb '19

15 Feb '19

Hi, is there any chance BaseX will support the cta-full-xpath-checking option (see https://xerces.apache.org/xerces2-j/features.html)? Without it, schema 1.1 validation is limited. I could not find any switches to configure Xerces features, but did find someone mentioning it from two years ago: https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg08446.ht… Or have I missed something in the documentation? Regards, Daniel

3 5

Nullpointer exception using http:send-mail with authentication details, no send-authorization attribute
by Markus Wittenberg 15 Feb '19

15 Feb '19

Hi there, I get a Nullpointer exception (see below) using the http:send-mail method with authentication details (Basic Auth), but without the send-authorization attribute in the http:request element. According to the EXPath HTTP Client Module spec (http://expath.org/spec/http-client#d2e430) the send-authorization attribute is not mandatory, default value false should be used if it is missing. Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.1.1 Java: Oracle Corporation, 1.8.0_92 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.http.HttpClient.setContentType(HttpClient.java:259) at org.basex.util.http.HttpClient.sendRequest(HttpClient.java:83) at org.basex.query.func.http.HttpSendRequest.iter(HttpSendRequest.java:34) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:74) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:73) at org.basex.query.func.StaticFunc.invValue(StaticFunc.java:181) at org.basex.query.func.FuncCall.invoke(FuncCall.java:89) at org.basex.query.func.FuncCall.value(FuncCall.java:62) at org.basex.query.func.FuncCall.iter(FuncCall.java:67) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:335) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:56) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:54) at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:857) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:215) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1340) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1242) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:503) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) at java.lang.Thread.run(Thread.java:745) Best regards -- Markus Wittenberg Tel +49 (0)8382 911 07 24 Mail wittenberg(a)axxepta.de ---- axxepta solutions GmbH Lehmgrubenweg 17, 88131 Lindau Amtsgericht Berlin HRB 97544B Geschäftsführer: Karsten Becke, Maximilian Gärber

2 1

proc:execute
by Giuseppe G. A. Celano 14 Feb '19

14 Feb '19

Hi, I am trying to run a parser via proc:execute/system. While if I run it from the command line, it works, it does not, if I run it via BaseX. More precisely, I get the following error: Traceback (most recent call last): File "main.py", line 325, in <module> test_data = loader.load(params.test) File "/Users/mycomputer/Desktop/Basex9.1beta 2/utils.py", line 57, in load for line in f: File "/Users/mycomputer/anaconda/lib/python3.6/encodings/ascii.py", line 26, in decode return codecs.ascii_decode(input, self.errors)[0] UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 5390: ordinal not in range(128) Is there a way to avoid that? Thanks. Best, Giuseppe

3 5

Re: [basex-talk] Global locks
by James Ball 14 Feb '19

14 Feb '19

I think I’m probably doing something similar on a current project with but with some careful query writes and use of jobs I’ve been able to keep everything running within acceptable time. However while optimising my code it did get me thinking about possible improvements. Clearly it’s difficult (or even impossible) to determine all the databases that will be used ahead of running the query. But I wonder how many times the calling function already knows? Then I thought of the (# db:enforceindex #) that was introduced for cases where the query writer knows that the databases will have indexes. I wondered if something similar might be possible for databases. A pragma or a function wrapper that would allow the name of a database (or databases) to be supplied and that would restrict access only to that database for the rest of the query. Returning an error if the query tries to address another. I’m sure this wouldn’t be simple - but might be easier and more reliable than trying to find more optimisations to the locking algorithm. Just thinking aloud… Kindest regards, James > From: Christian Grün <christian.gruen(a)gmail.com> > Subject: Re: [basex-talk] Global locks > Date: 11 February 2019 at 12:27:37 GMT > To: Andy Bunce <bunce.andy(a)gmail.com> > Cc: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> > > > Hi Andy, > > The current behavior is correct indeed – but it might not be what one > expects. Currently, we are… > > a) collecting all static database references in the query and > b) assigning either read or write locks to these databases, depending > if the overall query is updating or not. > > The reason is that it’s often tricky to determine statically (i.e., > while parsing the query and before compiling and optimizing it) which > databases will be accessed for read or write operations without > analyzing the query in more detail. An arbitrary example: > > let $db := db:open('db1') > return insert node <new/> into $db/* > > We would need to follow the variable reference in order to find out if > db1 will be updated. In simple queries such as yours, however, this > might be possible; I’ll have some more thoughts on that. > > Cheers > Christian

3 5

jobs:list-details o/p
by Andy Bunce 13 Feb '19

13 Feb '19

Hi, Before BaseX 9 jobs:list-details would return the query string used in the jobs:eval (or the uri if that was used) - as per the current docs [1] Versions 9+ returns a "dummy" file name in this case. jobs:eval("2+4",(),map{"cache":true()}) jobs:list-details("job2") <job id="job2" type="QueryJob" state="cached" user="admin" duration="PT0.001S" reads="(none)" writes="(none)" time="2019-02-12T17:53:41.772Z">file:///C:/Users/andy/git/vue-poc/src/vue-poc/features/tasks/model.build/file</job> I found the old behavior useful, (although it missed recording the static-base-uri). /Andy [1] http://docs.basex.org/wiki/Jobs_Module#jobs:list-details

2 2

starts-with in a satisfies statement fails to fail
by George Sofianos 13 Feb '19

13 Feb '19

Hi, I have a specific piece of code which fails to run as expected. Unfortunately i didn't manage to create an MCVE so far. The part of code that should fail in my script is: some $i in $data satisfies starts-with($i, $string) Where $data is a list of strings, and $string is a sequence of two strings - example ("S1", "S2"). The Query executes without error, but the trace message is never visible. The part of the Query plan that executes successfully (while it shouldn't) is: <StaticFunc name="common:startsWith" type="xs:boolean" arg0="elements" arg1="string"> <GFLWOR type="xs:boolean" size="1"> <Let type="xs:string*"> <Var name="$string" id="178" type="xs:string*"/> <FnTrace name="trace(value[,label])" type="xs:string*"> <StaticFuncCall name="common:string" tailCall="false" type="xs:string*"> <VarRef> <Var name="$string" id="177" type="item()*" promote="true"/> </VarRef> </StaticFuncCall> <Str type="xs:string">STRING: </Str> </FnTrace> </Let> <Quantifier option="some" type="xs:boolean" size="1"> <GFLWOR type="xs:boolean*"> <For type="xs:string" size="1"> <Var name="$i" id="180" type="xs:string"/> <StaticFuncCall name="common:string" tailCall="false" type="xs:string*"> <VarRef> <Var name="$elements" id="176" type="item()*" promote="true"/> </VarRef> </StaticFuncCall> </For> <FnTrace name="trace(value[,label])" type="xs:boolean" size="1"> <FnStartsWith name="starts-with(string,sub[,collation])" type="xs:boolean" size="1"> <VarRef type="xs:string" size="1"> <Var name="$i" id="180" type="xs:string"/> </VarRef> <VarRef type="xs:string*"> <Var name="$string" id="178" type="xs:string*"/> </VarRef> </FnStartsWith> <Str type="xs:string">SATISFY: </Str> </FnTrace> </GFLWOR> </Quantifier> </GFLWOR> </StaticFunc> I'm not sure if you can find anything from the Query plan for why this is happening. This fails either with or without inlining. Regards, George

2 4

Version
by Bondeson, Carl 11 Feb '19

11 Feb '19

Is there a method in a Java client/server architecture to get the current version of BaseX (i.e. 9.1.2)? I could not find it anywhere. ClientSession.info is always blank. Thanks Carl R Bondeson IT Analyst 3 Department of Public Health Operation & Support Services Information Technology Phone: 860-509-7434 Carl.Bondeson(a)ct.gov<mailto:Carl.Bondeson@ct.gov> [cid:image001.jpg@01D16B2F.0AD71DC0][http://www.phaboard.org/wp-content/uploads/PHAB-SEAL-COLOR.jpg]

2 7

Database currupted bug when trying to re-insert documents
by Herbert Mertig 11 Feb '19

11 Feb '19

I stumbled over this while running some JUnit tests of our Applications which uses the embedded version of BaseX. It always seemed to happen when inserting, deleting and then inserting the same documents again. I attached 4 simple xquery files to reproduce it using basexgui, just follow these steps: 1. open basexgui 2. create an empty database 3. run insert_pigs.xq to insert the first document 4. run insert_plants.xq to insert the second document 5. run delete_pigs.xq to delete the first document 6. run delete_plants.xq to delete the second document now insert the same 2 documents in the opposite order 7: run insert_pigs.xq 8. run insert_plants.xq <-- this will trigger the error, the database is now garbage Some more observations: It does not trigger when using only 1 document. Not sure if it happens with more than 2, I think I have observed that as well. Sometimes closing the database and running optimize on it seems to fix it. Hope that helps to find and fiy the bug, its pretty nasty. BR Herbert

2 9

Global locks
by Andy Bunce 11 Feb '19

11 Feb '19

Running the following in the GUI (8.6.5) ``` let $db:="BEP" return count(collection($db)) ``` The info windows shows $db is inlined Compiling: - inline $db_0 - pre-evaluate collection("BEP") to document-node() sequence - pre-evaluate count((db:open-pre("BEP",0), ...)) to xs:integer - simplify gflwor Optimized Query: 9193 All good. Submitting a job ``` let $q:='let $db:="BEP" return count(collection($db))' return jobs:eval($q,(),map{"cache":true()})!(jobs:wait(.),jobs:list-details(.)) ``` returns: <job id="job90" type="ScheduledXQuery" state="cached" user="admin" duration="PT0.007S" reads="(global)" writes="(none)">let $db:="BEP" return count(collection($db))</job> Note @reads="(global)" But ``` let $q:='count(collection("BEP"))' return jobs:eval($q,(),map{"cache":true()})!(jobs:wait(.),jobs:list-details(.)) ``` <job id="job92" type="ScheduledXQuery" state="cached" user="admin" duration="PT0.006S" reads="BEP" writes="(none)">count(collection("BEP"))</job> Note @reads="BEP" Is this correct and/or of any consequence? /Andy

2 8

Global lock = false and parallel update processes to different DBs
by France Baril 06 Feb '19

06 Feb '19

Hi! I noticed that the latest version of BaseX lost this feature and nothing seems to replace it. I'm trying to improve performance of batch processes and I was counting on that feature a lot. Any change it will come back or that something equivalent will come? Case: .js: For $lang in $langs call basex updating function: . xqm updating function: get db:open($lang)/* process save to db:open('staging-' || $lang) This is a case where there is no chance of conflict because each thread saves to a different db. Any suggestion on how to apply parallel processing for this case is welcome. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 5

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk