- BaseX-Talk - mailman.uni-konstanz.de

fn:serialize#2 serialization different in BaseX and Saxon
by Andreas Mixich 25 Mar '19

25 Mar '19

Hello, This code: let $asString := '<html><head><meta name="foo" content="bar"/></head></html>' let $asElement := <html><head><meta name="foo" content="bar"/></head></html> return ( "method: html " ,"AS STRING:" ,serialize($asString,map{"method":"html"}) ,"AS ELEMENT:" ,serialize($asElement,map{"method":"html"}) ,"method: xhtml " ,"AS STRING:" ,serialize($asString,map{"method":"xhtml"}) ,"AS ELEMENT:" ,serialize($asElement,map{"method":"xhtml"}) ,"method: text: " ,"AS STRING:" ,serialize($asString,map{"method":"text"}) ,"AS ELEMENT:" ,serialize($asElement,map{"method":"text"}) ) when executed with Saxon, in oXygen, gives me: <?xml version="1.0" encoding="UTF-8"?>method: html AS STRING: &lt;html&gt;&lt;head&gt;&lt;meta name="foo" content="bar"/&gt;&lt;/head&gt;&lt;/html&gt; AS ELEMENT: <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> <meta name="foo" content="bar"> </head> </html> method: xhtml AS STRING: &lt;html&gt;&lt;head&gt;&lt;meta name="foo" content="bar"/&gt;&lt;/head&gt;&lt;/html&gt; AS ELEMENT: <html> <head> <meta name="foo" content="bar"></meta> </head> </html> method: text: AS STRING: <html><head><meta name="foo" content="bar"/></head></html> AS ELEMENT: With BaseX, however, I get: method: html AS STRING: <html><head><meta name="foo" content="bar"/></head></html> AS ELEMENT: <html> <head> <meta name="foo" content="bar"> </head> </html> method: xhtml AS STRING: <html><head><meta name="foo" content="bar"/></head></html> AS ELEMENT: <html> <head> <meta name="foo" content="bar"></meta> </head> </html> method: text: AS STRING: <html><head><meta name="foo" content="bar"/></head></html> AS ELEMENT: which has me baffled. * why is the result to the very last function empty? * how can I convert an XML node to an entity escaped string, _without_ passing it in as string, but as element() or node()? The background is, that I want to write a function, that takes an XML element()* and results in the node(s) escaped to xs:string*, so, basically, what Saxon does (though I still wonder, how the Saxon people then get an unescaped string of XML, as BaseX does). Thanks. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 1

Way to escape XML?
by Andreas Mixich 24 Mar '19

24 Mar '19

Hi, I must be missing the obvious, but is there a way to serialize element() or node() into xs:string with the XML getting entity escaped in BaseX? Something like: let $xml as element() := <xml>Hello World</xml> return serialize($xml, map{"method":"entity-escaped-string"} would result in <xml>Hello World</xml> -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 2

IllegalStateException from XsltTransformer
by Johannes Bauer 22 Mar '19

22 Mar '19

Hello, we have a BaseX web application with RESTXQ services. I was doing some load tests to see how it behaves in high load scenarios. Some tests did throw IllegalStateExceptions somewhere in the Saxon XSLT code (see stacktrace below). We use a XSLT stylesheet to transform the XML response of our services to an intermediate format that allows the transformation to JSON. (:~ : Transform XML to Json XML Schema (https://www.w3.org/TR/xslt-30/#schema-for-json). : @param $xml XML node : @return transformed XML :) declare function json:to-json-xml($xmlas element()) { xslt:transform($xml,'xml-to-json.xslt',map {},map {'cache' : true()}) }; Is there some concurrency problem with the xslt module? Best regards Johannes Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.1.2 Java: Oracle Corporation, 1.8.0_191 OS: Linux, amd64 Stack Trace: java.lang.IllegalStateException: The Controller is being used recursively or concurrently. This is not permitted. at net.sf.saxon.Controller.checkReadiness(Controller.java:1287) at net.sf.saxon.trans.XsltController.applyTemplates(XsltController.java:685) at net.sf.saxon.s9api.AbstractXsltTransformer.applyTemplatesToSource(AbstractXsltTransformer.java:347) at net.sf.saxon.s9api.XsltTransformer.transform(XsltTransformer.java:338) at net.sf.saxon.jaxp.TransformerImpl.transform(TransformerImpl.java:71) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:109) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:59) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:37) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:71) at org.basex.query.expr.List.value(List.java:155) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:73) at org.basex.query.expr.If.value(If.java:131) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:73) at org.basex.query.expr.If.value(If.java:131) at org.basex.query.expr.If.value(If.java:131) at org.basex.query.func.StaticFunc.invValue(StaticFunc.java:181) at org.basex.query.func.FuncCall.invoke(FuncCall.java:89) at org.basex.query.func.FuncCall.value(FuncCall.java:62) at org.basex.query.func.FuncCall.iter(FuncCall.java:67) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:335) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:56) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:54) at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) at javax.servlet.http.HttpServlet.service(HttpServlet.java:742) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.content42.services.filter.LoggingFilter.doFilter(LoggingFilter.java:44) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:650) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:342) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:800) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:806) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1498) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:748)

1 0

Known issue? DB file names with capital letters get corrupted on OS switch.
by France Baril 17 Mar '19

17 Mar '19

Hi, I recently moved from Mac to Linux and noticed that when using the webDAV connection, all files that have capital letters in their name become corrupted when open in Linux. Luckily, out of the thousands of files that we have, less than 2 dozens used capitalization. I still think this could become a large issue for someone someday, so I felt I should report it. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

supporting XML Catalog files in xslt:transform() (patch)
by Liam R. E. Quin 14 Mar '19

14 Mar '19

The enclosed patch -- would you prefer a github pull request? -- makes xslt:transform() aware of XML catalog files, as other XML parsing already is. The same CATFILE preference is used (via the query context). I refactored CatalogWrapper slightly so it could be reused. I also took away the line that sets verbosity to 0, as without it you can control verbosity via a system property, or using the CatalogManager.properties file. I tested this with xml-commons-resolver-1.2/resolver.jar and with the built-in resolver and both seem to work. I have not added tests. In addition, it'd be worth adding something to the documentation, especially about the xml.catalog.verbosity property (just verbosity in the .properties file). Possible breaking change: i also removed the line that sets prefer=public. I spent ages trying to get catalogs working before i dicovered this, as i was using a system identifier! The code could check to see if the corresponding system property is set (users can't override the API with system properties, frustratingly), but since catalogs already say prefer=public or prefer=system in them, and it'd have needed to have been the same to work, i don't think this change breaks anythign in practice. It may make some catalogs start to work that had not been working, so maybe it's worth a line in the release notes. Liam -- Liam Quin, https://www.delightfulcomputing.com/ Available for XML/Document/Information Architecture/XSLT/ XSL/XQuery/Web/Text Processing/A11Y training, work & consulting. Web slave for vintage clipart http://www.fromoldbooks.org/

4 13

Regex j-flag
by Andreas Hartmann 13 Mar '19

13 Mar '19

Hi The "j" flag for regular expressions introduced in version 9.1 doesn't seem to work in 9.1.2 anymore. For example, matches("Fenster", "\bfenst", "ij") produces [FORX0001] invalid regular flag 'j'. The same expression works in 9.1.1. Best Greetings, Andreas

2 1

Write functions in sequence
by Giuseppe G. A. Celano 12 Mar '19

12 Mar '19

Hi I wrote a single script which should do: write a file -> open this file -> write another different file. I put the write expressions in the right sequence, but it seems that the second one cannot happen because the file created by the first write function has not yet been created at the time the second function is invoked. Does anyone have a suggestion about this? Thanks. Best, Giuseppe

3 7

Serialization issue with HTTP response
by Marco Lettere 08 Mar '19

08 Mar '19

Hi all, we have to deal with a third-party REST service which in case of error conditions returns this mime type: /*application/problem+json; charset=utf-8*/. I wrote this RestXQ [1] to mock it. Just copy it into restxq.xqm... When I call it like [2] I get /*[XPTY0004] Cannot convert xs:base64Binary to xs:string: "IntcImFcIjpcImJcIn0i"*/. This is because the response is seen as a binary and this can be double checked calling with [3]. I felt (maybe wrongly) that specializations of the mimetype had been faced in BaseX implementation of http:request somewhere back in time but I couldn't find anything in the mail archives. The strange thing however is that I get the same error when calling like [4] with override-mime-type set to text/json or application/json which instead I was expecting to work. Is the behaviour in this scenario expected or does this hide some inconsistency? Thanks, as usual, for the support. Regards, Marco. [1] declare%rest:path("mc/dummy") %rest:GET %output:method("json") function page:dummy() { <rest:response> <http:response status="400"> <http:header name="Content-Type" value="application/problem+json; charset=utf-8"/> </http:response> </rest:response>, '{"a":"b"}' }; [2] json:parse( http:send-request(<http:request method="get"/>,"http://localhost:8984/mc/dummy")[2] ) [3] json:parse( convert:binary-to-string( http:send-request(<http:request method="get"/>,"http://localhost:8984/mc/dummy")[2] ) ) [4] json:parse( http:send-request(<http:request method="get" override-media-type="application/json"/>,"http://localhost:8984/mc/dummy")[2] )

2 5

Using HTTP Digest Authentication in a RESTXQ services
by Omar Siam 04 Mar '19

04 Mar '19

Hi list! I just experimented a bit to see if there is an obvious way to use HTTP digest authentication for some RESTXQ service I plan to write. I would prefer not to reimplement the HTTP digest logic in XQuery. I thought maybe there is a way to use the built in digest logic like for the REST endpoint. I don't seem to get that to work. Any suggestions? Best regards Omar Siam

2 5

RESTXQ and regexp
by Marco Lettere 04 Mar '19

04 Mar '19

Hello all, according to the docs this should be possible: (: Matches all paths with "app" as first, a number as second, and "order" as third segment :) declare %rest:path("app/{$code=[0-9]+}/order") function page:order($full-path) { ... }; (: Matches all other all paths starting with "app/" :) declare %rest:path("app/{$path=.+}") function page:others($path) { ... }; And it actually is... We are currently in the very unfortunate situation where we need the following: (: Matches anything followed by /input :) declare %rest:path("app/{$path=.+}/input") function page:inputs($path) { ... }; (: Matches all other all paths starting with "app/" :) declare %rest:path("app/{$path=.+}") function page:others($path) { ... }; Unfortunately this makes all the calls to be redirected to the page:others function ... is there a motivation behind it or could it be possible to work around that? Thanks, Marco.

3 3

If clause
by Giuseppe G. A. Celano 04 Mar '19

04 Mar '19

Hi, I see that in BaseX 9.1.2 an expression such as "if (3) then 4 " does not raise an error, even if the "else" part is missing. Is this correct? Ciao, Giuseppe

7 13

Class 'BaseXHTTP' missing?
by Jan Stapel 28 Feb '19

28 Feb '19

Hello, i just tried to run the Java REST-Examples found on GIT/the basex-doc. BaseXHTTP cannot be resolved to a type. I am using the current version. Am I missing something? best, Jan

2 1

Activating gzip compression
by Omar Siam 27 Feb '19

27 Feb '19

Hi, I tried both ways of enabling gzip compression for JSON and js (and others). I can't see it actually working. The GzipFilter method from the web.xml sample seems to be deprecated with a warning of "it is bug ridden" ... But then in a browser debugger I cannot see it actually zipping anything. I trief to enable this in my BaseX 9.1.2 instance using <filter> <filter-name>GzipFilter</filter-name> <filter-class>org.eclipse.jetty.servlets.GzipFilter</filter-class> <init-param> <param-name>mimeTypes</param-name> <param-value>text/html,text/xml,text/ecmascript,application/xhtml+xml,application/json,application/javascript,image/svg+xml</param-value> </init-param> </filter> <filter-mapping> <filter-name>GzipFilter</filter-name> <url-pattern>/*</url-pattern> </filter-mapping> The GzipHandler method seems to get loaded but then also in a browser debugger I cannot see it actually zipping anything. For the GzipHandler the documentation https://www.eclipse.org/jetty/documentation/current/gzip-filter.html talks about when it actually gets invoked and mentions: * No content-encoding is specified by the resource I found no way to not specify an encoding for whatever I return in RESTXQ. If I don't specify anything it's UTF-8. it shows up as "; character-set=UTF-8"I did not find a way to specify no encoding. Maybe unrelated but perhaps that is a problem. I modified webapp/WEB-INF/jetty.xml like this so it uses the GzipHandler (copied from the current jetty distribution): <Configure id="Server" class="org.eclipse.jetty.server.Server">  <Call name="addConnector"> ... </Call> <Call name="insertHandler"> <Arg> <New id="GzipHandler" class="org.eclipse.jetty.server.handler.gzip.GzipHandler"> <Set name="minGzipSize"><Property name="jetty.gzip.minGzipSize" deprecated="gzip.minGzipSize" default="2048"/></Set> <Set name="checkGzExists"><Property name="jetty.gzip.checkGzExists" deprecated="gzip.checkGzExists" default="false"/></Set> <Set name="compressionLevel"><Property name="jetty.gzip.compressionLevel" deprecated="gzip.compressionLevel" default="-1"/></Set> <Set name="inflateBufferSize"><Property name="jetty.gzip.inflateBufferSize" default="0"/></Set> <Set name="deflaterPoolCapacity"><Property name="jetty.gzip.deflaterPoolCapacity" default="-1"/></Set> <Set name="syncFlush"><Property name="jetty.gzip.syncFlush" default="false" /></Set> <Set name="excludedAgentPatterns"> <Array type="String"> <Item><Property name="jetty.gzip.excludedUserAgent" deprecated="gzip.excludedUserAgent" default=".*MSIE.6\.0.*"/></Item> </Array> </Set> <Set name="includedMethodList"><Property name="jetty.gzip.includedMethodList" default="GET" /></Set> <Set name="excludedMethodList"><Property name="jetty.gzip.excludedMethodList" default="" /></Set> </New> </Arg> </Call> </Configure> I hope there is a way to get this to work. Best regards Omar Siam

2 1

geo:distance() return units
by Jacob Borisov 26 Feb '19

26 Feb '19

Hello. Could anybody explain how to get a result from geo:distance() in kilometers or miles? Thanks.

2 3

Re: [basex-talk] BaseX-Talk Digest, Vol 110, Issue 29
by Shaun Flynn 25 Feb '19

25 Feb '19

Hello there Marco, This might be down to the choice of regex. Assume $path = "path" app/{$path=.+} Will match "app/path=1234" And "app/path=1234/input" Which I think would be matched by ".+" part of the expression, as "/input" would match ".+". Kind regards On Sat, 23 Feb 2019, 11:00 , <basex-talk-request(a)mailman.uni-konstanz.de> wrote: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. RESTXQ and regexp (Marco Lettere) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 22 Feb 2019 12:05:29 +0100 > From: Marco Lettere <m.lettere(a)gmail.com> > To: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] RESTXQ and regexp > Message-ID: <3f71e0bc-e16d-6c4d-6ee8-246a7cc7595c(a)gmail.com> > Content-Type: text/plain; charset=utf-8; format=flowed > > Hello all, > > according to the docs this should be possible: > > (: Matches all paths with "app" as first, a number as second, and > "order" as third segment :) > declare %rest:path("app/{$code=[0-9]+}/order") > ? function page:order($full-path) { ... }; > > (: Matches all other all paths starting with "app/" :) > declare %rest:path("app/{$path=.+}") > ? function page:others($path) { ... }; > > And it actually is... We are currently in the very unfortunate situation > where we need the following: > > (: Matches anything followed by /input :) > declare %rest:path("app/{$path=.+}/input") > ? function page:inputs($path) { ... }; > > (: Matches all other all paths starting with "app/" :) > declare %rest:path("app/{$path=.+}") > ? function page:others($path) { ... }; > > Unfortunately this makes all the calls to be redirected to the > page:others function ... is there a motivation behind it or could it be > possible to work around that? > > Thanks, > > Marco. > > > > End of BaseX-Talk Digest, Vol 110, Issue 29 > ******************************************* >

2 1

read/write database locks
by Johannes Bauer 21 Feb '19

21 Feb '19

Hi, I need some input on how best to implement an updating database operation. I use BaseX within a Web Application and have RESTXQ service endpoints. One such service collects information from multiple databases and creates a new document (with the collected infos) in another database. The list of affected databases is dynamic and will be determined by the RESTXQ module. I'm afraid that, due to the missing static database information in the query, the service will lock *all* databases and because I have an updating operation the locks will be write locks. Depending on the amount of databases and their size, the operation might take some time (maybe even up to some minutes). And I don't want to have write locks for such a long period of time. I've also tried another approach: I use a non updating service that collects the data and then calls another RESTXQ service per HTTP request that makes the db update. This way I only have read locks on *all* databases and then a short single write lock on the modified db. But this did not work. The write call deadlocked. The first service probably has not released the read locks yet when the second service is called. I also tried to set the QUERYINFO option to see some lock information for my module, but I didn't get any output. Do you have any best practice on how to approach such a task? Best regards Johannes

2 2

Stack Overflow: Try tail recursion
by Giuseppe G. A. Celano 20 Feb '19

20 Feb '19

I am writing a recursive function which is similar to the one here: https://stackoverflow.com/questions/27702718/to-add-values-in-cumulative-fo… Interestingly, local:sum() works if there are not many <book/>. However with 38000 book element I get the error "Stack Overflow: Try tail recursion". Any idea? Ciao, Giuseppe

5 6

Release client libraries as packages?
by Jakub Pavlík 20 Feb '19

20 Feb '19

Hi, as a programmer occasionally working with BaseX I find the current "way of life" of the client libraries rather inconvenient: 1. nowadays most programming languages have some sort of packaging system (PHP's composer, Ruby's gems, Python's pip etc.), but the official BaseX client libraries are not released to these and I have to copy the files "manually" to each project using them 2. the libraries are rather minimal, lacking proper documentation and test suite. (Yes, they are arguably small, but still.) Have you considered releasing them as packages (which would, at least for PHP, require a separate git repository)? Or do you prefer to have individuals who have use for such packages to create and maintain them themselves? Regards, Jakub

2 1

Docker Volumes Permission denied
by Marie Starck 19 Feb '19

19 Feb '19

Hello everyone, So I am looking to add Docker to a BaseX webapp that is currently running properly on my local. In order to do that, I ran docker run -ti -d --publish 1984:1984 --publish 8984:8984 --volume ~/Projects/Architextus/basex-xquery-server/data:/srv/BaseXData --volume ~/Projects/Architextus/basex-xquery-server/webapp:/srv/BaseXWeb --volume ~/Projects/Architextus/basex-xquery-server/repo:/srv/BaseXRepo basex/basexhttp:8.6.4 And while localhost:8984 shows me the regular BaseX introduction page, none of the rest endpoints work and I get this error when I try to access the webapp from my localhost: Stopped at /srv/BaseXWeb/xqm/g-holismo.xqm, 136/24: [bxerr:BXDB0002] Resource "/srv/BaseXData/DITA-AppResources/tbl.basex (Permission denied)" not found. Stack Trace: - /srv/BaseXWeb/xqm/g-holismo.xqm, 11/10 I checked the permissions on my docker container and it seems that the basex user only has permissions on WEB-INF but none of the volumes, BaseXData, BaseXRepo and BaseXWeb, those are shown as belonging to user 1000. Has anyone experienced this before? Thank you for any help or tip you could provide, Marie

2 4

Schema 1.1 validation and Xerces cta-full-xpath-checking?
by Zimmel, Daniel 15 Feb '19

15 Feb '19

Hi, is there any chance BaseX will support the cta-full-xpath-checking option (see https://xerces.apache.org/xerces2-j/features.html)? Without it, schema 1.1 validation is limited. I could not find any switches to configure Xerces features, but did find someone mentioning it from two years ago: https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg08446.ht… Or have I missed something in the documentation? Regards, Daniel

3 5

Nullpointer exception using http:send-mail with authentication details, no send-authorization attribute
by Markus Wittenberg 15 Feb '19

15 Feb '19

Hi there, I get a Nullpointer exception (see below) using the http:send-mail method with authentication details (Basic Auth), but without the send-authorization attribute in the http:request element. According to the EXPath HTTP Client Module spec (http://expath.org/spec/http-client#d2e430) the send-authorization attribute is not mandatory, default value false should be used if it is missing. Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.1.1 Java: Oracle Corporation, 1.8.0_92 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.http.HttpClient.setContentType(HttpClient.java:259) at org.basex.util.http.HttpClient.sendRequest(HttpClient.java:83) at org.basex.query.func.http.HttpSendRequest.iter(HttpSendRequest.java:34) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:74) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:73) at org.basex.query.func.StaticFunc.invValue(StaticFunc.java:181) at org.basex.query.func.FuncCall.invoke(FuncCall.java:89) at org.basex.query.func.FuncCall.value(FuncCall.java:62) at org.basex.query.func.FuncCall.iter(FuncCall.java:67) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:335) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:56) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:54) at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:857) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1655) at org.eclipse.jetty.websocket.server.WebSocketUpgradeFilter.doFilter(WebSocketUpgradeFilter.java:215) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1642) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1340) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1242) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:503) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) at java.lang.Thread.run(Thread.java:745) Best regards -- Markus Wittenberg Tel +49 (0)8382 911 07 24 Mail wittenberg(a)axxepta.de ---- axxepta solutions GmbH Lehmgrubenweg 17, 88131 Lindau Amtsgericht Berlin HRB 97544B Geschäftsführer: Karsten Becke, Maximilian Gärber

2 1

proc:execute
by Giuseppe G. A. Celano 14 Feb '19

14 Feb '19

Hi, I am trying to run a parser via proc:execute/system. While if I run it from the command line, it works, it does not, if I run it via BaseX. More precisely, I get the following error: Traceback (most recent call last): File "main.py", line 325, in <module> test_data = loader.load(params.test) File "/Users/mycomputer/Desktop/Basex9.1beta 2/utils.py", line 57, in load for line in f: File "/Users/mycomputer/anaconda/lib/python3.6/encodings/ascii.py", line 26, in decode return codecs.ascii_decode(input, self.errors)[0] UnicodeDecodeError: 'ascii' codec can't decode byte 0xe2 in position 5390: ordinal not in range(128) Is there a way to avoid that? Thanks. Best, Giuseppe

3 5

Re: [basex-talk] Global locks
by James Ball 14 Feb '19

14 Feb '19

I think I’m probably doing something similar on a current project with but with some careful query writes and use of jobs I’ve been able to keep everything running within acceptable time. However while optimising my code it did get me thinking about possible improvements. Clearly it’s difficult (or even impossible) to determine all the databases that will be used ahead of running the query. But I wonder how many times the calling function already knows? Then I thought of the (# db:enforceindex #) that was introduced for cases where the query writer knows that the databases will have indexes. I wondered if something similar might be possible for databases. A pragma or a function wrapper that would allow the name of a database (or databases) to be supplied and that would restrict access only to that database for the rest of the query. Returning an error if the query tries to address another. I’m sure this wouldn’t be simple - but might be easier and more reliable than trying to find more optimisations to the locking algorithm. Just thinking aloud… Kindest regards, James > From: Christian Grün <christian.gruen(a)gmail.com> > Subject: Re: [basex-talk] Global locks > Date: 11 February 2019 at 12:27:37 GMT > To: Andy Bunce <bunce.andy(a)gmail.com> > Cc: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> > > > Hi Andy, > > The current behavior is correct indeed – but it might not be what one > expects. Currently, we are… > > a) collecting all static database references in the query and > b) assigning either read or write locks to these databases, depending > if the overall query is updating or not. > > The reason is that it’s often tricky to determine statically (i.e., > while parsing the query and before compiling and optimizing it) which > databases will be accessed for read or write operations without > analyzing the query in more detail. An arbitrary example: > > let $db := db:open('db1') > return insert node <new/> into $db/* > > We would need to follow the variable reference in order to find out if > db1 will be updated. In simple queries such as yours, however, this > might be possible; I’ll have some more thoughts on that. > > Cheers > Christian

3 5

jobs:list-details o/p
by Andy Bunce 13 Feb '19

13 Feb '19

Hi, Before BaseX 9 jobs:list-details would return the query string used in the jobs:eval (or the uri if that was used) - as per the current docs [1] Versions 9+ returns a "dummy" file name in this case. jobs:eval("2+4",(),map{"cache":true()}) jobs:list-details("job2") <job id="job2" type="QueryJob" state="cached" user="admin" duration="PT0.001S" reads="(none)" writes="(none)" time="2019-02-12T17:53:41.772Z">file:///C:/Users/andy/git/vue-poc/src/vue-poc/features/tasks/model.build/file</job> I found the old behavior useful, (although it missed recording the static-base-uri). /Andy [1] http://docs.basex.org/wiki/Jobs_Module#jobs:list-details

2 2

starts-with in a satisfies statement fails to fail
by George Sofianos 13 Feb '19

13 Feb '19

Hi, I have a specific piece of code which fails to run as expected. Unfortunately i didn't manage to create an MCVE so far. The part of code that should fail in my script is: some $i in $data satisfies starts-with($i, $string) Where $data is a list of strings, and $string is a sequence of two strings - example ("S1", "S2"). The Query executes without error, but the trace message is never visible. The part of the Query plan that executes successfully (while it shouldn't) is: <StaticFunc name="common:startsWith" type="xs:boolean" arg0="elements" arg1="string"> <GFLWOR type="xs:boolean" size="1"> <Let type="xs:string*"> <Var name="$string" id="178" type="xs:string*"/> <FnTrace name="trace(value[,label])" type="xs:string*"> <StaticFuncCall name="common:string" tailCall="false" type="xs:string*"> <VarRef> <Var name="$string" id="177" type="item()*" promote="true"/> </VarRef> </StaticFuncCall> <Str type="xs:string">STRING: </Str> </FnTrace> </Let> <Quantifier option="some" type="xs:boolean" size="1"> <GFLWOR type="xs:boolean*"> <For type="xs:string" size="1"> <Var name="$i" id="180" type="xs:string"/> <StaticFuncCall name="common:string" tailCall="false" type="xs:string*"> <VarRef> <Var name="$elements" id="176" type="item()*" promote="true"/> </VarRef> </StaticFuncCall> </For> <FnTrace name="trace(value[,label])" type="xs:boolean" size="1"> <FnStartsWith name="starts-with(string,sub[,collation])" type="xs:boolean" size="1"> <VarRef type="xs:string" size="1"> <Var name="$i" id="180" type="xs:string"/> </VarRef> <VarRef type="xs:string*"> <Var name="$string" id="178" type="xs:string*"/> </VarRef> </FnStartsWith> <Str type="xs:string">SATISFY: </Str> </FnTrace> </GFLWOR> </Quantifier> </GFLWOR> </StaticFunc> I'm not sure if you can find anything from the Query plan for why this is happening. This fails either with or without inlining. Regards, George

2 4

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk