BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Load LibreOffice- and Word-documents?
by Ben Engbers 28 Jan '20

28 Jan '20

Hi, While we were discussing possible usecases for basex, a colleague asked me if it is also possible to load libreoffice and Word documents into Basex and then perform full-text analysis on them. In essence, these are both XML files, so it should be possible. Does anybody have experience with this? Ben

3 2

NullPointerException parsing trivial query using XQJ (CLI works)
by Andreas Sewe 28 Jan '20

28 Jan '20

Hi, I get a weird NPE/parse error when interfacing with BaseX 9.3.1 via XQJ and even occurs for the following minimal query: <html>{.}</html> In other words, I just want to interpolate the context item. The gist of the XQJ calls is the following: > XQPreparedExpression expression = connection.prepareExpression("<html>{.}</html>"); > expression.bindDocument(XQConstants.CONTEXT_ITEM, "<context/>", null, null); > XQResultSequence results = expression.executeQuery(); > results.writeSequence(System.out, null); This results in the following message > XQJQS001 - Invalid XQuery syntax, syntax does not pass static validation. and a long and unfortunately obfuscated stack trace: > java.lang.NullPointerException > at net.xqj.basex.bin.bz.a(Unknown Source) > at net.xqj.basex.bin.bv.c(Unknown Source) > at net.xqj.basex.bin.bC.bE(Unknown Source) > at net.xqj.basex.bin.bC.by(Unknown Source) > at net.xqj.basex.bin.bC.bu(Unknown Source) > at net.xqj.basex.bin.bC.bj(Unknown Source) > at net.xqj.basex.bin.bC.bi(Unknown Source) > at net.xqj.basex.bin.bC.bh(Unknown Source) > at net.xqj.basex.bin.bC.aY(Unknown Source) > at net.xqj.basex.bin.bC.aX(Unknown Source) > at net.xqj.basex.bin.bC.aW(Unknown Source) > at net.xqj.basex.bin.bC.aV(Unknown Source) > at net.xqj.basex.bin.bC.aU(Unknown Source) > at net.xqj.basex.bin.bC.aT(Unknown Source) > at net.xqj.basex.bin.bC.aS(Unknown Source) > at net.xqj.basex.bin.bC.aR(Unknown Source) > at net.xqj.basex.bin.bC.aQ(Unknown Source) > at net.xqj.basex.bin.bC.aP(Unknown Source) > at net.xqj.basex.bin.bC.aO(Unknown Source) > at net.xqj.basex.bin.bC.aN(Unknown Source) > at net.xqj.basex.bin.bC.aM(Unknown Source) > at net.xqj.basex.bin.bC.aL(Unknown Source) > at net.xqj.basex.bin.bC.aK(Unknown Source) > at net.xqj.basex.bin.bC.R(Unknown Source) > at net.xqj.basex.bin.bC.Q(Unknown Source) > at net.xqj.basex.bin.bC.N(Unknown Source) > at net.xqj.basex.bin.bC.bS(Unknown Source) > at net.xqj.basex.bin.bC.bR(Unknown Source) > at net.xqj.basex.bin.bC.bM(Unknown Source) > at net.xqj.basex.bin.bC.bL(Unknown Source) > at net.xqj.basex.bin.bC.bK(Unknown Source) > at net.xqj.basex.bin.bC.by(Unknown Source) > at net.xqj.basex.bin.bC.bu(Unknown Source) > at net.xqj.basex.bin.bC.bj(Unknown Source) > at net.xqj.basex.bin.bC.bi(Unknown Source) > at net.xqj.basex.bin.bC.bh(Unknown Source) > at net.xqj.basex.bin.bC.aY(Unknown Source) > at net.xqj.basex.bin.bC.aX(Unknown Source) > at net.xqj.basex.bin.bC.aW(Unknown Source) > at net.xqj.basex.bin.bC.aV(Unknown Source) > at net.xqj.basex.bin.bC.aU(Unknown Source) > at net.xqj.basex.bin.bC.aT(Unknown Source) > at net.xqj.basex.bin.bC.aS(Unknown Source) > at net.xqj.basex.bin.bC.aR(Unknown Source) > at net.xqj.basex.bin.bC.aQ(Unknown Source) > at net.xqj.basex.bin.bC.aP(Unknown Source) > at net.xqj.basex.bin.bC.aO(Unknown Source) > at net.xqj.basex.bin.bC.aN(Unknown Source) > at net.xqj.basex.bin.bC.aM(Unknown Source) > at net.xqj.basex.bin.bC.aL(Unknown Source) > at net.xqj.basex.bin.bC.aK(Unknown Source) > at net.xqj.basex.bin.bC.R(Unknown Source) > at net.xqj.basex.bin.bC.Q(Unknown Source) > at net.xqj.basex.bin.bC.P(Unknown Source) > at net.xqj.basex.bin.bC.d(Unknown Source) > at net.xqj.basex.bin.bC.b(Unknown Source) > at net.xqj.basex.bin.bC.a(Unknown Source) > at net.xqj.basex.bin.bC.a(Unknown Source) > at net.xqj.basex.bin.bJ.<init>(Unknown Source) > at net.xqj.basex.bin.bd.a(Unknown Source) > at net.xqj.basex.bin.H.<init>(Unknown Source) > at net.xqj.basex.bin.H.a(Unknown Source) > at net.xqj.basex.bin.u.a(Unknown Source) > at net.xqj.basex.bin.u.a(Unknown Source) > at net.xqj.basex.bin.w.prepareExpression(Unknown Source) > at net.xqj.basex.bin.w.prepareExpression(Unknown Source) Executing the same query using "bin/basex -i context.xml query.xq" outputs the expected result: > <html> > <context/> > </html> I have a minimal (Maven-based) test project, in case you want to reproduce the bug. I can also file the issue on GitHub, if that's the preferred method, but if I read <https://github.com/BaseXdb/basex/issues/new> correctly, then I should post here first. Best wishes, Andreas

2 3

Test for changes in the data structure
by benjamin.tobler＠sbb.ch 28 Jan '20

28 Jan '20

Dear all I am extracting some nodes from a xml document. The structure of the xml document can change over time. Therefore, I would like to install a mechanism, which is testing for changes of the data structure of the relevant nodes. The schema is described in multiple xsd documents but one xsd document is referring to all others (screenshot). [cid:image003.jpg@01D5D502.4E0C7DB0] I was testing the complete xml against the this xsd, which is referring to all other xsds, but I received the error message: "Validation could not be started: Java heap space" by using the function "validate:xsd". However, actually I only want to test the data structure of specific nodes and not the complete xml for changes. Is it possible to do this with BaseX? Thank you for your help! Best Regards Benjamin

2 1

saxon.jar on docker image
by France Baril 26 Jan '20

26 Jan '20

Hi I'm using the public 9.3.1 image. I've been able to set up most of my app, but I get an error when trying to apply an xsl. Cannot compile and the error mention that Xalan is used. I just added the saxon9.jar in /srv/basex/lib/custom the way I would have on my normal local installation. FROM basex/basexhttp:9.3.1 ... COPY ./image-setup-files/bx/saxon9.jar /srv/basex/lib/custom/saxon9.jar 17:04:57.447 172.17.0.1:39752 admin 400 Stopped at /srv/basex/webapp/Accounting_Bilans.xqm, 301/25: [xslt:error] ERROR: 'Could not compile stylesheet' FATAL ERROR: 'Error checking type of the expression 'funcall(lower-case, [parameter-ref(legal-entity/reference)])'.' :Error checking type of the expression 'funcall(lower-case, [parameter-ref(legal-entity/reference)])'. javax.xml.transform.TransformerConfigurationException: Error checking type of the expression 'funcall(lower-case, [parameter-ref(legal-entity/reference)])'. at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl.newTemplates(TransformerFactoryImpl.java:988) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:122) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:62) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:40) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:50) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:80) at org.basex.query.func.StaticFunc.invValue(StaticFu... 5305.15 ms -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

1 1

Shoud 'addraw' work as parameter with db:create?
by France Baril 25 Jan '20

25 Jan '20

Hi, I have this function that loads all the indexable content, but leaves the .png behind. Am I missing something? declare %rest:path("/demo/create-db") %rest:GET %rest:query-param('db', '{$db}', 'new-name') %rest:query-param('dir-src', '{$dir-src}', '') %output:method("html") %output:html-version("5.0") updating function democlean:create-db($db as xs:string, $dir-src as xs:string){ let $params := map {'updindex': true(), 'language': 'fr', 'addraw': true(), 'chop': false(), 'intparse': true(), 'createfilter': '*.xml, *.ditamap, *.dita'} return ( if (db:exists($db)) then db:drop($db) else (), if ($dir-src = '') then db:create($db, (), (), $params) else db:create($db, $dir-src, '/', $params), db:output(<div>DB ready</div>) ) } I also tried 'serializer: ''indent=no' as a parameter, which was unrecognized. I assume that since addraw is not unrecognized, it should work. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

How to escape/encode a search term using BaseX REST XQ
by Ivan Kanakarakis 24 Jan '20

24 Jan '20

Hello everyone, I am using BaseX 8.44 and the REST XQ interface (ie, http://docs.basex.org/wiki/RESTXQ). I have an endpoint that, when invoked with GET, it does a full text search (using "$db-nodes[text() contains text { $term } all]"), gets the results, constructs a JSON response and sends it back. That's all fine and works great. However, I am not sure how I should be doing the queries I describe bellow. _Note: the query is initiated by a SPA javascript client, thus when I say encode/uri-escape, what I mean is that I invoke the encodeURIComponent function (https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Ob…). _Note 2: for the sake of conversation let's consider the example endpoint declared as: %rest:GET %rest:path("/search/{$term}") 1. I want to search for "tea". That is the basic query. A single term, no problem. curl -s "https://example.com/search/tea" 2. I want to search for "tea time". Now, this query has a space in between the two words. What I expect to get back, is any node that contains both words (thus I have used "contains text" with "all"), even if they may be a few words apart. - Should I be sending an encoded/uri-escape version of this, ie, "tea%20time"? - Or, should I be replacing the space with "+", ie "tea+time"? - Or, some other advice? curl -s "https://example.com/search/tea%20time" curl -s "https://example.com/search/tea+time" 3. I want to search for "tea/time". This is even trickier. What I expect to get back, is any node that contains "tea/time", ie a search result for a single term. How do I do this? - If I do not do anything, the slash is treated as part of the URL, thus not matching a route. - If I encoded/uri-escape this term, I get "tea%2Ftime". But, when I invoke the endpoint I get the same as if there was a slash. - I am not sure how I should deal with the slash. How should I escape/encode this? curl -s "https://example.com/search/tea/time" curl -s "https://example.com/search/tea%2Ftime" Thank you,

3 5

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 22 Jan '20

22 Jan '20

2 1

HTTPS requests using the HTTP Client Module with self signed (invlaid) certificates
by Omar Siam 22 Jan '20

22 Jan '20

Hi, I just searched for a way to turn off certificate verification for the HTTP Client xquery module. Turns out I have to use Client/Server Architecture option IGNORECERT. Although that is somewhat logical I miss a clear statement in the docs. Thanks for the great software! Omar Siam

2 1

Server-side XQuery scripts understanding their "context"
by ERRINGTON Luke 22 Jan '20

22 Jan '20

Hi all, I'm trying to use the REST API to call server-side XQuery scripts. As I understand it, these scripts are not part of a database, but reside in the filesystem where BaseX is "installed" (or where RESTPATH points to). However, when I execute an XQuery I would like it to run on a particular database. Is there anyway to achieve this without passing the database as an argument to the query? For example, http://localhost:8984/rest?run=find.xq http://localhost:8984/rest/Test?run=find.xq ... both execute the same query, and that query needs to open a database to do its searching, so currently the database to open is hard-coded. It would be nice if the query could work out what database or "collection" was its context and automatically use that. Additionally, if I do http://localhost:8984/rest?run=Test/find.xq ... then I run the query that is in the Test folder, but this still does not have any context and so still needs to know to open the Test database. Is there a way to achieve this without having to pass the name of the database to every XQuery? Or am I not understanding things and is there a better way to do this sort of thing? Thanks, Luke

2 3

Help with a Query/Performance
by Tom Rauchenwald (UNIFITS) 22 Jan '20

22 Jan '20

Hi list, I'm struggling with a query. We have XML documents with a structure similar to this: <Container> <ContainerMetaData1>FOO</ContainerMetaData1> <ContainerMetaData2>FOO</ContainerMetaData2> <MessageA> <MessageAMetaData> <MessageMetaData1>FOO</MessageMetaData1> <MessageMetaData2>FOO</MessageMetaData2> </MessageAMetaData> <MessageADetail> <DetailData1>FOO</DetailData1> <DetailData2>FOO</DetailData2> </MessageADetail> <MessageADetail> <DetailData1>FOO</DetailData1> <DetailData2>FOO</DetailData2> </MessageADetail> </MessageA> <MessageB> <MessageBMetaData> <MessageMetaData1>FOO</MessageMetaData1> <MessageMetaData2>FOO</MessageMetaData2> </MessageBMetaData> <MessageBDetail> <DetailData1>FOO</DetailData1> <DetailData2>FOO</DetailData2> </MessageBDetail> </MessageB> <MessageC> <MessageCMetaData> <MessageMetaData1>FOO</MessageMetaData1> <MessageMetaData2>FOO</MessageMetaData2> </MessageCMetaData> <MessageCDetail> <DetailData1>FOO</DetailData1> <DetailData2>FOO</DetailData2> </MessageCDetail> </MessageC> </Container> Messages are bundled in a container (up to n times for each message), and each message has details (also up to n times). Container, Message contain data that is the same for all details (it's basically a grouping). I'd like to retrieve a Detail with all corresponding data associated with it, so basically a MessageADetail, MessageA (without all the other MessageADetails), Container (without all the other Messages). I know the position of the message (i.e., I know that I want the second MessageA for example), and I know the position of the Detail (i.e., I know that I want the 3rd Detail). The use case is to show the detail in context in a UI. The query to do this I came up with is (here I want to get the 2nd detail from the third MessageA): let $fh := (copy $x := /*:Container modify ( delete node $x/*:MessageA[position() != 3] , delete node $x/*:MessageA[3]/*:MessageADetail[position() != 2] , delete node $x/*:MessageB , delete node $x/*:MessageC ) return $x) return $fh This works well for small documents. For large documents it can take a couple of seconds to evaluate the query (our real-life documents do have more data/elements in Details and Message). I'm wondering if there's a better/more efficient way to do this. I tried formulating a query that doesn't do deletes, but I couldn't come up with a solution that performs better and is correct. Any pointers would be very much appreciated. Here's a function to generate sufficiently large test data: declare function local:sample($numberOfMessages, $numberOfDetails) { <Container> <ContainerMetaData1>FOO</ContainerMetaData1> <ContainerMetaData2>FOO</ContainerMetaData2> {for $i in 1 to $numberOfMessages return <MessageA> <MessageAMetaData> <MessageMetaData1>FOO {$i}</MessageMetaData1> <MessageMetaData2>FOO {$i}</MessageMetaData2> </MessageAMetaData> {for $j in 1 to $numberOfDetails return <MessageADetail> <DetailData1>FOO {$j}</DetailData1> <DetailData2>FOO {$j}</DetailData2> </MessageADetail> } </MessageA> } <MessageB> <MessageBMetaData> <MessageMetaData1>FOO</MessageMetaData1> <MessageMetaData2>FOO</MessageMetaData2> </MessageBMetaData> <MessageBDetail> <DetailData1>FOO</DetailData1> <DetailData2>FOO</DetailData2> </MessageBDetail> </MessageB> <MessageC> <MessageCMetaData> <MessageMetaData1>FOO</MessageMetaData1> <MessageMetaData2>FOO</MessageMetaData2> </MessageCMetaData> <MessageCDetail> <DetailData1>FOO</DetailData1> <DetailData2>FOO</DetailData2> </MessageCDetail> </MessageC> </Container> }; db:create('tr-test', local:sample(20, 100000), 'test.xml') Thanks, Tom Rauchenwald

3 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk