- BaseX-Talk - mailman.uni-konstanz.de

Optimization issue? - maps and count
by Johannes Echterhoff 06 Dec '19

06 Dec '19

All, The following query: let $lookupSequence := ('a','b') let $map := map {'c': 'x'} let $mapLookupEvaluation := $map?($lookupSequence) return ( 'Evaluation of the map lookup is: ' || string-join($mapLookupEvaluation,", "), 'count($mapLookupEvaluation) is: ' || count($mapLookupEvaluation) ) Results in: Evaluation of the map lookup is: count($mapLookupEvaluation) is: 2 I would have expected 0 instead of 2. Am I missing something? Best regards, Johannes

2 1

Issue with years-from-duration!?
by France Baril 06 Dec '19

06 Dec '19

Hi, The following function returns P4511D: 0 but I expect P4511D: 12 Bug or bad usage? let $d1 := xs:date('2007-07-31') > let $d2 := xs:date('2019-12-06') > let $duration := $d2 - $d1 > let $years := years-from-duration($duration) > return $duration || ': ' || $years -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 5

BaseX 9.3: The Winter Edition; {position()>1] vs. [./position()>1
by Alexander Witzigmann 05 Dec '19

05 Dec '19

the results of equivalent semantics: e.g. //row[position()>1] is no more equal to in latest 9.3 release to //row[./position()>1] the later results in not correct result. Alex

2 2

WG: Anführungszeichen bei der Serialisierung
by benjamin.tobler＠sbb.ch 05 Dec '19

05 Dec '19

Guten Tag Ich möchte ein xml zu einem csv file wandeln. Dazu verwende ich die serialize function von BaseX. Um die Strings der einzelnen Felder würde ich gerne Anführungszeichen hinzufügen. Dazu verwende ich die Option 'quotes' : 'yes'. Leider funktioniert dies nicht. Ich habe Ihnen einen Beispielcode angehängt. Dieser generiert die Ausgabe: John;Travolta. Ich hätte aber gerne die Ausgabe: "John";"Travolta". Gibt es diese Möglichkeit? Vielen Dank für Ihre Hilfe! Lieber Grüsse Benjamin Tobler

2 2

Reg : Collection Performence
by chandra Sekhar 04 Dec '19

04 Dec '19

Dear Basex Team, We are using basex7.9,here we are facing performance issue when we are trying to add XML documents to collection database. *scenario *: We are adding nearly one lakh xml documents to the collection,In my application we should run xquery on one lakh xmls,that reason we are adding xmls to same collection,but total xml size also very less. In this situation my our collection server taking more time to add documents to collection database. *one lakh xml size *: 4GB *Please suggest any option to improve performance* Regards, Chandrasekhar

2 1

Join
by Giuseppe G. A. Celano 29 Nov '19

29 Nov '19

Hi, I have the following query: count( for $r in doc("hib_parses.xml")//row let $i := doc("hib_lemmas.xml")//row[field[@name="lemma_lang_id"][. = "3"]] where $r/field[@name="lemma_id"] = $i/field[@name="lemma_id"] return $r ) I have noticed that the where clause needs to be changed into $r/field[@name="lemma_id"]/text() = $i/field[@name="lemma_id"]/text() in order to get a result (otherwise the query seems to never end). I am wondering whether this is a BaseX issue, in that I would assume that the two kinds of where clause are equivalent (because of atomization). I have also noticed that /data() does not work either. Thanks! Best, Giuseppe

2 3

BaseX 9.3: The Winter Edition
by Christian Grün 29 Nov '19

29 Nov '19

Hello to our loyal readers of our list, We are glad to announce version 9.3 of BaseX, our XML framework, database system and XQuery 3.1 processor: http://basex.org/ The focus has been put on in-depth optimizations of complex XQuery code and faster processing of RESTXQ web applications: RESTXQ - seamless streaming of custom responses to the client - Request Module: bind attributes to current request - better support for the OPTIONS and HEAD methods - trace output is now stored in the database logs - enforce premature HTTP response with web:error - optional GZIP compression of HTTP responses - server-side forwarding with web:forward USER INTERFACES - GUI: project view: skip directories with .ignore file - GUI: project view: do now follow symbolic links - DBA: user panel updated to show user info - DBA: faster processing of log entries STORAGE - hot fix for replacing single documents with namespaces - improved XQuery processing of binary resources - ADDCACHE: faster caching of single documents - WITHDB: less locking when using fn:doc XQUERY FUNCTIONS - user:info/user:update-info: process user-specific data - db:open-id, db:open-pre: support for multiple ids - file:descendants: return descendant file paths - inspect:type: return type of a value as string - db:alter-backup: rename database backups - xslt:transform: support for catalog files XQUERY PERFORMANCE - merge of adjacent/redundant steps in paths and predicates - removal of redundant switch, typeswitch and catch clauses - interruption of side-effecting code (Files Modul etc.) - fn:count: pre-evaluation of zero-or-one arguments - faster processing of alternative steps: a/(b,c) - rewriting of paths to simple map expressions - inlining of values in simple map expressions - flattening of nested simple map expressions - rewriting of lists to union expressions - removal of superfluous predicates For a more comprehensive list of added and updated features. please check out our documentation: http://docs.basex.org/. Your feedback is welcome as usual. Have fun with the new release, Your BaseX Team

3 2

I have been given control of xqDoc from Darin McBeath
by Loren Cahlander 22 Nov '19

22 Nov '19

Hello folks, June of 2018, I updated the xqDoc codebase to be able to handle the additions to the language for XQuery 3.1 and most of the vendor specific language extensions. I updated the parser to Antlr 4. Darin McBeath, the creator of xqDoc, asked me if I wanted to take over the domain. I accepted. I will be updating the website http://xqDoc.org and would like to get the community’s input. What changes would people like to see in the website? xqDoc’s GitHub is officially at http://github.com/xqdoc Thank you, Loren Cahlander

2 3

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 20 Nov '19

20 Nov '19

1 0

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 20 Nov '19

20 Nov '19

3 5

executing windows command
by Dieter Zanzinger 20 Nov '19

20 Nov '19

Hello all, I tried to execute a windows command with proc:execute(). See my module: ——— module namespace _ ='process'; declare %rest:path('treez/proc') function _:process() { prof:dump( proc:execute('C:\Program Files\Microsoft Office 15\root\office15\winword.exe','/q') ) }; declare %rest:path('treez/proc_dir') function _:process2() { proc:execute('dir','\’) ———— While function process() works as expected and opens winword, the function process2() (example from the docs) leads to following error: <result> <error> Cannot run program "dir": CreateProcess error=2, Das System kann die angegebene Datei nicht finden </error> </result> Any hints? As process() works and opens winword, I prosume that the error does not come from my installation (Win10, Tomcat 9.0, BaseX 9 - war version). Starting Tomcat as admin does not change anything. Best, Dieter Zanzinger Finanzgericht München

2 1

Exception shown on fn:doc with XML document
by Stefan Pöschel 18 Nov '19

18 Nov '19

Hello, the XPath function "fn:doc" in BaseX can also be used to open a database (instead of an XML document). However when I open an XML document and have debug messages enabled, an exception is shown that seems to be related to an (unsuccessful) attempt to open a database (meanwhile the fn:doc command itself succeeds): ----- org.basex.core.BaseXException: Database 'test.xml' was not found. at org.basex.core.cmd.Open.open(Open.java:92) at org.basex.query.QueryResources.data(QueryResources.java:405) at org.basex.query.QueryResources.doc(QueryResources.java:207) at org.basex.query.func.fn.Docs.doc(Docs.java:61) at org.basex.query.func.fn.FnDoc.item(FnDoc.java:17) at org.basex.query.func.StandardFunc.optimize(StandardFunc.java:82) at org.basex.query.expr.Arr.compile(Arr.java:43) at org.basex.query.func.StaticFunc.comp(StaticFunc.java:69) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) at org.basex.query.QueryContext.compile(QueryContext.java:312) at org.basex.query.QueryContext.iter(QueryContext.java:331) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:63) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:53) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:505) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804) at java.lang.Thread.run(Thread.java:748) ----- Please find attached a minimal test XQM and a corresponding XML document. Both files have to be stored in the "webapp" subfolder of the folder from which BaseX is called. With the option "WITHDB = false" in ".basex", the exception doesn't occur (which is not surprising). However I think that the exception shouldn't show up in the debug output here at all, as the fn:doc command actually succeeds (and as it "pollutes" the output). I use BaseX 9.2.4 on Linux; the used cmdline is "basexhttp -d". Thanks and best regards, Stefan -- Stefan Pöschel IRT - Institut für Rundfunktechnik GmbH - https://www.irt.de ------------------------------------------------------------ Research and Development Institute of ARD, ZDF, DRadio, ORF and SRG/SSR Floriansmühlstr. 60, 80939 München, Germany Registration court Munich Commercial, Register No. B 5191 Managing Director: Michael Hagemeyer

2 4

Is there an API that provides XQuery compilation results?
by Peter Villadsen 15 Nov '19

15 Nov '19

When I use the GUI application I can see some error description (even if it a little terse) when my queries are incorrect. For instance I might get: Stopped at tableFields.xq, 27/50: [XQST0118] Different start and end tag: <Artifact>...</Artiact>. If I submit a query like <Artifact></Artiact> However, I cannot seem to find an API that brings me that information? I tried: xquery:parse("<B></C>", map {'pass':true()}) but that did not get the result I expected. Also, while we're at at it, it would be nice to also get the optimized query. Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

3 2

Re: [basex-talk] REPLACE vs STORE
by Christian Grün 14 Nov '19

14 Nov '19

> Thank you for your answer. Do you plan something like that in future? We face the problem we need to upload tens thousands of files in 4 hours per week. We are able to do it with replace with folder, but current store per file is too slow. :-( Have you already tried the XQuery way? If so, and if it’s too slow, feel free to share your code with us. > Odesláno z mého chytrého telefonu Samsung Galaxy. > > -------- Původní zpráva -------- > Od: Christian Grün <christian.gruen(a)gmail.com> > Datum: 14.11.19 18:30 (GMT+01:00) > Komu: Radim Havlicek <radim-havlicek(a)post.cz> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Předmět: Re: [basex-talk] REPLACE vs STORE > > Hi Radim, > > The STORE command is restricted to single files [1]. XQuery and > db:store (e.g. combined with file:list) gives you more flexibility > here. > > Hope this helps, > Christian > > [1] http://docs.basex.org/wiki/Commands#STORE > > > > > On Thu, Nov 14, 2019 at 10:53 AM <radim-havlicek(a)post.cz> wrote: > > > > Hello, > > I would like to store new reports into existing database folder (with other existing files already) after opening. > > > > Help: > > REPLACE > > Syntax REPLACE [path] [input] > > XML Syntax <replace path='...'>[input]</replace> > > > > STORE > > Syntax STORE (TO [path]) [input] > > XML Syntax <store (path='...')>[input]</store> > > > > But actually I encountered this problem: > > > open mydb > > Database 'mydb' was opened in 3.0 ms. > > > replace /Report/ c:/Share/REPORTS/ > > 903 resource(s) replaced in 11077.73 ms. > > > store to /Report/ c:/Share/REPORTS/ > > Resource "C:/Share/REPORTS/" not found. > > > > What am I doing wrong? Is it possible to use store to instead of replace to just add files to existing ones? > > > > Thanks in advance for your answer, > > > > Radim Havlicek

1 0

REPLACE vs STORE
by radim-havlicek＠post.cz 14 Nov '19

14 Nov '19

Hello, I would like to store new reports into existing database folder (with other existing files already) after opening. Help: REPLACE Syntax REPLACE [path] [input] XML Syntax <replace path='...'>[input]</replace> STORE Syntax STORE (TO [path]) [input] XML Syntax <store (path='...')>[input]</store> But actually I encountered this problem: > open mydb Database 'mydb' was opened in 3.0 ms. > replace /Report/ c:/Share/REPORTS/ 903 resource(s) replaced in 11077.73 ms. > store to /Report/ c:/Share/REPORTS/ Resource "C:/Share/REPORTS/" not found. What am I doing wrong? Is it possible to use store to instead of replace to just add files to existing ones? Thanks in advance for your answer, Radim Havlicek

2 1

Feature request: leveraging db:open-id and db:node-id
by France Baril 14 Nov '19

14 Nov '19

Hi, any chance we could make the db indexed ids match the xml doc ids? - db:open-id() could match the id at the root of then documents (when one is provided) - db:node-id() could match other nodes match internal ids (when they are provided). It would make indexing and querying a lot more efficient for any type of navigation/linking purposes. Options: - I'd suggest that this could be an option that can be turned on/off for each doc level ids and node level ids - I'd suggest that node id has the option to be unique within the db or within a document when the value for the entire db would then have to become something like doc-id#node-id to stay unique within the db Then I can easily imagine also expending to db:save-id to reduce the workload of having to pass through base-uri() once the doc exists in the db under its path let $db-name := 'en-us' let $doc := db:open-id($db-name, $doc-id) let $new-doc := copy, modify, return copy db:replace-id('en-us', $doc-id, $new-doc) instead of let $db-name := 'en-us' let $doc := db:open($db-name)/*[@id=$doc-id] let $new-doc := copy, modify, return copy let $path := substring-after($doc/base-uri(), $db-name) return db:replace($db-name, $path, $new-doc) Is that something that can be considered?

2 4

I am looking for the fastest way to sort 2.4 Mio tags by two attribute ascending and descending
by Omar Siam 14 Nov '19

14 Nov '19

Hi, I have a custom index that looks like this (one db, different files): <_:dryed xmlns:_="https://www.oeaw.ac.at/acdh/tools/vle/util" db_name="z881_qdb-TEI-02n" order="none"> <_:d pre="15627" db_name="z881_qdb-TEI-02n" xml:id="z881_qdbn-d16e2" vutlsk="tsįttr Ziter [Subst]" vutlsk-archiv="HK 881, z8810118.sch#1"/> <_:d pre="15673" db_name="z881_qdb-TEI-02n" xml:id="z881_qdbn-d16e21" vutlsk="tsįttr Ziter [Subst]" vutlsk-archiv="HK 881, z8810118.sch#1"/> ... </_:dryed> <_:dryed xmlns:_="https://www.oeaw.ac.at/acdh/tools/vle/util" db_name="f227_qdb-TEI-02n" order="none"> <_:d pre="467" db_name="f227_qdb-TEI-02n" xml:id="f237_qdb-d1e29398" vutlsk="(aus)faren [Verb]" vutlsk-archiv="HK 327, f227#944.1 = fare0126.eck#1.1"/> <_:d pre="591" db_name="f227_qdb-TEI-02n" xml:id="f237_qdb-d1e29438" vutlsk="(aus)faren [Verb]" vutlsk-archiv="HK 327, f227#945.1 = fare0126.eck#2.1"/> ... </_:dryed> There are about 2.4 Mio _:d tags in this db. I need to sort them by the @vutlsk* attributes alphabetically in ascending and descending order. With the code I have now: declare namespace _ = "https://www.oeaw.ac.at/acdh/tools/vle/util"; let $sorted-ascending := subsequence(for $d in collection('_qdb-TEI-02__cache')//*[@order="none"]/_:d order by $d/@vutlsk ascending return $d/(@ID, @xml:id)/data(), 1, 10000) let $sorted-descending := subsequence(for $d in collection('_qdb-TEI-02__cache')//*[@order="none"]/_:d order by $d/@vutlsk descending return $d/(@ID, @xml:id)/data(), 1, 10000) let $sorted-ascending-archiv := subsequence(for $d in collection('_qdb-TEI-02__cache')//*[@order="none"]/_:d order by $d/@vutlsk-archiv ascending return $d/(@ID, @xml:id)/data(), 1, 10000) let $sorted-descending-archiv := subsequence(for $d in collection('_qdb-TEI-02__cache')//*[@order="none"]/_:d order by $d/@vutlsk-archiv descending return $d/(@ID, @xml:id)/data(), 1, 10000) return (db:replace("_qdb-TEI-02__cache", 'ascending_cache.xml', <_:dryed order="ascending" ids="{string-join($sorted-ascending, ' ')}"/>), db:replace("_qdb-TEI-02__cache", 'descending_cache.xml', <_:dryed order="descending" ids="{string-join($sorted-descending, ' ')}"/>), db:replace("_qdb-TEI-02__cache", 'ascending-archiv_cache.xml', <_:dryed order="ascending" label="archiv" ids="{string-join($sorted-ascending-archiv, ' ')}"/>), db:replace("_qdb-TEI-02__cache", 'descending-archiv_cache.xml', <_:dryed order="descending" label="archiv" ids="{string-join($sorted-descending-archiv, ' ')}"/>)) This takes 30 s to about a minute depending on the subsequence I choose. I did experiments with doing multithreading and not. Multiple jobs or fork-join make it worse. Worst case I need to do it every time I save a change to the original DBs for which I maintain that index. Any ideas how to speed this up? Best regards Omar Siam

2 5

Re: [basex-talk] http:send-request - problem with response
by Christian Grün 13 Nov '19

13 Nov '19

Hi Bogdan (cc to the list), Thanks for digging deeper. I noticed that the standard Java function that we used returned only one value per header field, and dropped the others [1]. I managed to fix this in the latest stable snapshot; could you give it a try [2]? BaseX 9.3 will be released end of November. Cheers, Christian [1] http://files.basex.org/releases/latest/ [2] https://github.com/BaseXdb/basex/issues/1751 On Wed, Nov 13, 2019 at 4:26 PM Bogdan Bogucki <bbogucki(a)hussar.pl> wrote: > > Hi Christian, > Lack of many redirection is not a big problem. I can handle it manually. > Problem is not complete response header form first request. > > Browser make 3 redirection I am talking about first. > > Please take a look. > > > Response header from browser (first request) - contains three fields Set > Cookies: > > set-cookie __cfduid=daf54110b2a87d66c2a53…; domain=.pracuj.pl; HttpOnly > > set-cookie _yaic=13; expires=Fri, 31-Dec-9999 23:59:59 GMT; path=/ > > set-cookie _urnadiam=A; domain=.pracuj.pl…3:00:00 GMT; path=/; HttpOnly > > but response header form http:send-request contains only last one: > > <http:header name="Set-Cookie" value="_urnadiam=B; domain=.pracuj.pl; > expires=Tue, 31-Dec-2019 23:00:00 GMT; path=/; HttpOnly"/> > > I need information from previous set-cookie fields to make manual > redirection passing information about sessions to next requests. > > Regards > > Bogdan Bogucki > > W dniu 29.10.2019 o 03:06, Christian Grün pisze: > > Hi Bogdan, > > > > The current http:send-request implementation is based on the default > > Java HttpURLConnection, which does not resolve redirects that use > > different protocols [1]. This is the reason why your request will not > > be fully processed (as it e.g. happens when you use the browser). > > > > It seems that your initial request to the https protocol returns a 302 > > redirect to a (now unsafe) http URL, which returns another redirect to > > https. I don’t know who maintains the discussed web site, but it could > > be worth contacting the admins and asking them if they could update > > and simplify their redirect policy. > > > > Hope this helps, > > Christian > > > > [1] https://stackoverflow.com/a/1884427/1018790 > > > > > > > > > > On Fri, Oct 25, 2019 at 1:52 PM Bogdan Bogucki <bbogucki(a)hussar.pl> wrote: > >> > >> Hello, > >> > >> I encounter problem with http:send-request function. I need handle multiple forward requests (3) with cookies. > >> > >> First request returns cookies information which are required with next requests. Output from http:send-request dosen't contains all fields which are returned by server. > >> > >> Response from browser is flowing: > >> cache-control > >> private > >> cf-cache-status > >> DYNAMIC > >> cf-ray > >> 52b3cedc5b9bcc9f-WAW > >> content-type > >> text/html; charset=utf-8 > >> date > >> Fri, 25 Oct 2019 11:21:37 GMT > >> expect-ct > >> max-age=604800, report-uri="ht….com/cdn-cgi/beacon/expect-ct" > >> location > >> http://www.pracuj.pl/praca/jav…eloper-warszawa,oferta,7171988 > >> server > >> cloudflare > >> set-cookie > >> __cfduid=daf54110b2a87d66c2a53…; domain=.pracuj.pl; HttpOnly > >> set-cookie > >> _yaic=13; expires=Fri, 31-Dec-9999 23:59:59 GMT; path=/ > >> set-cookie > >> _urnadiam=A; domain=.pracuj.pl…3:00:00 GMT; path=/; HttpOnly > >> x-aspnet-version > >> 4.0.30319 > >> x-aspnetmvc-version > >> 5.2 > >> X-Firefox-Spdy > >> h2 > >> x-powered-by > >> ASP.NET > >> x-ua-compatible > >> IE=edge > >> > >> > >> Request: > >> > >> http:send-request( > >> <http:request method='get' follow-redirect='false'> > >> <http:header name="User-Agent" value="Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:69.0) Gecko/20100101 Firefox/69.0"/> > >> <http:header name="Accept" value="text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8"/> > >> <http:header name="Accept-Languag" value="pl,en-US;q=0.7,en;q=0.3"/> > >> <http:header name="DNT" value="1"/> > >> <http:header name="Connection" value="keep-alive"/> > >> <http:header name="Upgrade-Insecure-Requests" value="1"/> > >> <http:body media-type='application/x-www-form-urlencoded; charset=UTF-8'/> > >> </http:request>, 'https://www.pracuj.pl/praca/java-developer-warszawa,oferta,7171988') > >> > >> Response form http:send-request is: > >> > >> <http:response xmlns:http="http://expath.org/ns/http-client" status="302" message="Found"> > >> <http:header name="Transfer-Encoding" value="chunked"/> > >> <http:header name="CF-RAY" value="52b3d0de097fb839-WAW"/> > >> <http:header name="Server" value="cloudflare"/> > >> <http:header name="Connection" value="keep-alive"/> > >> <http:header name="Date" value="Fri, 25 Oct 2019 11:23:00 GMT"/> > >> <http:header name="X-AspNetMvc-Version" value="5.2"/> > >> <http:header name="X-UA-Compatible" value="IE=edge"/> > >> <http:header name="CF-Cache-Status" value="DYNAMIC"/> > >> <http:header name="Cache-Control" value="private"/> > >> <http:header name="X-AspNet-Version" value="4.0.30319"/> > >> <http:header name="Set-Cookie" value="_urnadiam=B; domain=.pracuj.pl; expires=Tue, 31-Dec-2019 23:00:00 GMT; path=/; HttpOnly"/> > >> <http:header name="Expect-CT" value="max-age=604800, report-uri="https://report-uri.cloudflare.com/cdn-cgi/beacon/expect-ct…"/> > >> <http:header name="X-Powered-By" value="ASP.NET"/> > >> <http:header name="Content-Type" value="text/html; charset=utf-8"/> > >> <http:body media-type="text/html"/> > >> </http:response> > >> > >> Two set-cookie fields is missing. > >> > >> How should I invoke http:send-request to receive proper result ? > >> > >> Regards > >> > >> Bogdan

2 1

proc:system
by Giuseppe G. A. Celano 13 Nov '19

13 Nov '19

Hi, When I try to run proc:system("/usr/local/bin/tesseract") I get the error [proc:code0001] Similarly: proc:system("tesseract") returns [proc:error] Cannot run program "tesseract": error=2, No such file or directory Similarly: proc:system("tesseract", (), map {"dir" : "/usr/local/bin/"}) returns [proc:error] Cannot run program "tesseract" (in directory "/usr/local/bin"): error=2, No such file or directory The command "tesseract" works at the command line. I suspect there may be a problem with permissions: is there a way to overcome this error? Thanks. Best, Giuseppe

2 5

Docker query
by Joseph Szili 13 Nov '19

13 Nov '19

Hello all, I'm trying to use the docker image for 9.x but when I surf to http://localhost:8984/dba/ per the documentation ... I get the following response in the browser No function found that matches the request. Using this command in linux (Ubuntu 19.04) ›$ docker run -d \ --name basexhttp \ --publish 1984:1984 \ --publish 8984:8984 \ --volume "$HOME/Projects/basex-dev/data":/srv/basex/data \ basex/basexhttp:latest container log >>>>>>>>>> /srv/basex/.basex: writing new configuration file. BaseX 9.3 beta [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @248ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.21.v20190926; built: 2019-09-26T16:41:09.154Z; git: 72970db61a2904371e1218a95a3bef5d79788c33; jvm 1.8.0_212-b04 [main] INFO org.eclipse.jetty.util.TypeUtil - JVM Runtime does not support Modules [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0 [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 600000ms Server was started (port: 1984). java.io.FileNotFoundException: /srv/basex/data/.logs/2019-11-08.log (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at org.basex.server.LogFile.create(LogFile.java:31) at org.basex.server.Log.write(Log.java:128) at org.basex.server.Log.writeServer(Log.java:70) at org.basex.BaseXServer.<init>(BaseXServer.java:122) at org.basex.http.HTTPContext.init(HTTPContext.java:101) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1287) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:599) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:425) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:751) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:742) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:744) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:361) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1443) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1407) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:821) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:276) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:407) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:106) at org.eclipse.jetty.server.Server.doStart(Server.java:371) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:120) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) [main] INFO org.eclipse.jetty.server.handler.ContextHandler - Started o.e.j.w.WebAppContext@545997b1{BaseX: The XML Database and XQuery Processor,/,file:///srv/basex/webapp/,AVAILABLE}{/srv/basex/webapp} [main] INFO org.eclipse.jetty.server.AbstractConnector - Started ServerConnector@3c756e4d{HTTP/1.1,[http/1.1]}{0.0.0.0:8984} [main] INFO org.eclipse.jetty.server.Server - Started @678ms HTTP STOP Server was started (port: 8985). java.io.FileNotFoundException: /srv/basex/data/.logs/2019-11-08.log (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at org.basex.server.LogFile.create(LogFile.java:31) at org.basex.server.Log.write(Log.java:128) at org.basex.server.Log.writeServer(Log.java:70) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:150) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) HTTP Server was started (port: 8984).

3 2

file:list and symbolic links
by Marco Lettere 09 Nov '19

09 Nov '19

Dear all, what is the rationale behind the fact that file:list has been rewritten to not following symbolic links [1]? We had some jobs related code that relied on symlinks and stopped working after moving to new version of BaseX. Is there any work around? By using children or the new descendants functions maybe? Thanks for your support. Marco. [1] https://github.com/BaseXdb/basex/blob/bbb62d1ec3e10b4fa1cc48bd4e16911fa73e4…

2 3

Backups
by Christoph Gaukel 09 Nov '19

09 Nov '19

Hi, the following handling of backups is surprising: * db:alter changes the name of the database but does not alter the names of the corresponding backups * db:drop deletes both, the database and the corresponding backups I would prefer, if there was an option in db:drop to keep the backups, which would allow to restore a deleted database from their backups. Is it possible to add options to db:drop, which allow that? For me, the behavior of db:alter looks like a bug. There is another minor handling, i would like to have changed: * db:info($db)/resourceproperties/inputdate is a UTC dateTime with a time zone offset * db:backups($db)/@date is a local dateTime without a time zone offset If I compare these two, it works correctly if the local time zone offset is the same as for the creation of the backup E.g.: if ( not(db:backups($db)) or max(db:backups($db)/@date/(. cast as xs:dateTime)) < db:info($db)/resourceproperties/inputdate/. cast as xs:dateTime ) then db:create-backup($db) else () Adding a time zone offset +hh:mm or -hh:mm to db:backups($db)/@date would solve this. Thanks, Christoph

2 2

"Out of Memory" when inserting data from one DB to another
by BIRKNER Michael 30 Oct '19

30 Oct '19

Hi to all, I get an "Out of Memory" error (using the BaseX GUI on Ubuntu Linux) when I try to insert quite a lot of data into a BaseX database. The use case: I have a database (size is about 2600 MB, 13718400 nodes) with information in <record> elements that should be added to <record> elements in another database. The <record>s have a 1 to 1 connection identified by an ID that is available in both databases. An example (simplified) of the DB with the information I want to add to the other DB: <collection> <record> <id>1</id> <data>Some data</data> <data>More data</data> <data>More data</data> ... </record> <record> <id>2</id> <data>Some data</data> <data>More data</data> <data>More data</data> ... </record> <record> <id>3</id> <data>Some data</data> <data>More data</data> <data>More data</data> ... </record> ... many many more <record>s </collection> Here an example (simplified) of the DB to which the above <data> elements should be added: <collection> <record> <id>1</id> <mainData>Main data</mainData> <mainData>More main data</mainData> <mainData>More main data</mainData> ...  </record> <record> <id>2</id> <mainData>Main data</mainData> <mainData>More main data</mainData> <mainData>More main data</mainData> ...  </record> <record> <id>3</id> <mainData>Main data</mainData> <mainData>More main data</mainData> <mainData>More main data</mainData> ...  </record> ... many many more <record>s </collection> This is the XQuery I use to insert the given <data> elements from the <record> in one database to the corresponding <record> in the other database. It results in an "Out of Memory" error: let $infoRecs := db:open('db-with-data')/collection/record let $mainRecs := db:open('db-to-insert-data')/collection/record for $infoRec in $infoRecs let $id := data($infoRec/id) let $mainRec := $mainRecs[id=$id] let $dataToInsert := $infoRec/*[not(name()='id')] return insert node ($dataToInsert) into $mainRec I assume that the error is a result of the large amount of data that is processed. My question is if a strategy exists to work with such an amount of data without getting an "Out of Memory" error? Thanks very much to everyone in advance for any hint and advice. If you need more information about DB setup or options just let me know. Best regrads, Michael Dieses Mail ist ausschließlich für die Verwendung durch die/den darin genannten AdressatInnen bestimmt und kann vertrauliche bzw rechtlich geschützte Informationen enthalten, deren Verwendung ohne Genehmigung durch den/ die AbsenderIn rechtswidrig sein kann. Falls Sie dieses Mail irrtümlich erhalten haben, informieren Sie uns bitte und löschen Sie die Nachricht. UID: ATU 16209706 I https://wien.arbeiterkammer.at/datenschutz

2 2

http:request parsing question
by Bridger Dyson-Smith 29 Oct '19

29 Oct '19

Hi all - I was hoping that someone on the list could help with my thinking about parsing the http:response values from a request; I've tried the following, but I'm not thinking about this correctly. declare namespace oai = "http://www.openarchives.org/OAI/2.0/"; declare namespace h = "http://expath.org/ns/http-client"; http:send-request(<http:request method='get' href=' http://export.arxiv.org/oai2?verb=Identify'/>)//@status/data() returns '200', but trying http:send-request(<http:request method='get' href=' http://export.arxiv.org/oai2?verb=Identify'/>)/h:response/@status fails. I'm guessing (but am not sure) that the combination of the <http:response> with the body of the response is causing my problem, but I'm not sure how to wiggle my way around it. Note: this is not in a RESTXQ context (yet), but for my simple trials is there a way to get at the http -namespace elements? Thank you for your time and trouble. Best, Bridger

3 5

Binding a variable
by Ben Engbers 29 Oct '19

29 Oct '19

Hi, When experimenting with my RBaseX-package (I had hoped to submit it to CRAN today), I use the following pattern: 1 Define a query 2 Create a query-object 3 Bind variables (optional) 4 Execute the query When used this pattern on the following query, everything functions as expected: declare variable $name external; for $i in 1 to 3 return element { $name } { $i } The following query is also functioning: paste("declare variable $greet external;", "declare variable $friend external;", "declare variable $into external;", "let $greet := 'Greetings, my '", "let $friend := 'friend'", "for $i in 1 to 3", "let $friend_num := $greet || $friend || $i", "return insert nodes element { $friend } { $friend_num }", "into root", sep = " ") When I modify "into root" to "into $p" and bind $p to root Bind(query_obj, "$p", "root") I get the following error: [XPST0008] Undeclared variable $p The Bind-function returns with code \00, indicating that it is executed without errors. Does this mean that there is a bug in my code or am I violating XQuery-syntax? Ben Engbers

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk