- BaseX-Talk - mailman.uni-konstanz.de

xquery for position
by George Sofianos 01 Dec '16

01 Dec '16

Hi, I'm having some issues with finding the position of a value in a for loop. My query is complex so I can't write it in an example here (at least for the moment). I think the XQuery optimizer messes up with it. The result I get from the for loop is something like this for every return entry: <element>2113 - 11953 - 8760</element> where 2113 is the stuck $pos, 11953 is the count $count, and 8760 is the number of values in the sequence I'm looping on. Any Ideas? Can I disable part of the optimizer and see if that is the problem ? p.s1 I'm already using declare option db:inlinelimit '0'; because I've noticed some time ago it helps with compiling the XQuery files (without this, I have cases of very slow or freezing compilations). p.s2 I've also had issues this with Saxon involving $pos.

2 2

Running REST service while in embedded mode?
by Mike Maul 01 Dec '16

01 Dec '16

Is it possible to run basex in embedded mode and also start REST service in another thread?

2 2

C# Client - Updating query
by Chris Speare 29 Nov '16

29 Nov '16

Hi all, Trying to use the C# client available from https://github.com/BaseXdb/basex/tree/master/basex-api/src/main/c%23 to perform an update query, however I must be missing the obvious - query runs and no exceptions are raised, however the XML remains un-changed. Code snippet (as this is held on a different machine): String base_update_query = @"xquery version '3.0'; let $invoice := db:open('{0}')/CommercialDocument[Customer/@id={1}] return replace value of node $invoice/InvoiceNumber with '{2}'"; .... Session session = new Session("localhost", 1984, "admin", "my_pass"); Query q = session.Query( String.Format( base_update_query, String.Concat("billing_run_", billing_run_id), customer_id, invoice_number ) ); .... >From the BaseX logs I then see entries: QUERY[1] xquery version '3.0'; let $invoice := db:open('billing_run_506')/CommercialDocument[Customer/@id=437] return replace value of node $invoice/InvoiceNumber with '28443' so I know the query reached the server, and the response seems to be "not error" as no exception is being raised - however the XML document hasn't been updated. Yet if I run the same query in either the client or web client it works (document updates) - provided I switch the query to "updating" not read-only. Is there a flag I've missed, or is .Query of Session the wrong method to use Kind regards Chris Speare The information contained in the email and any files transmitted with it is confidential and intended for the addressee only. If you have received this email in error please accept our apologies and notify the originator. Any disclosure, copying, distribution or any other use of this communication is strictly prohibited and may be unlawful. We reserve the right to monitor and intercept communications for lawful business purposes. Wireless Innovation Ltd , Unit D2, Churcham Business Park, Churcham, Gloucestershire, GL2 8AX, Great Britain. Company Registration Number 5240202, Place of Registration Companies House Cardiff.

2 4

XQuerry Help on Collections
by Mike Maul 29 Nov '16

29 Nov '16

I'm struggling a bit with XQuery especially in terms of collections. How would one take q query like for $x in doc('src/main/resources/xml/input.xml')//li return data($x) and apply it to a database with a collection of documents? What I'm after is something like: for $x in doc(*)//li return data($x) Also how are namespaces referenced/specified in queries? Finally if anyone as any good XQuery resources would appreciate if if you could pass them along...

2 1

No namespace for multiple commands in POST?
by Arjan Loeffen 27 Nov '16

27 Nov '16

I'm trying to REST POST a sequence of commands in accordance with http://docs.basex.org/wiki/Commands#XML_Syntax I get the error response: *cvc-elt.1: Cannot find the declaration of element 'commands'.* Is there a namespace for <commands> wrapper element? I'd expect it to be http://basex.org/rest but the same message is returned on the qualified name: *cvc-elt.1: Cannot find the declaration of element 'basex:commands'.* Using Basex 8.5.3 Thanks in advance, -- Arjan Loeffen, Armatiek BV 06-12918997

2 1

docker images broken?
by Maximilian Gärber 25 Nov '16

25 Nov '16

Hi, I tried the image on a new server and I get: basex_1 | Creating /srv/BaseXWeb/WEB-INF/web.xml basex_1 | java.nio.file.NoSuchFileException: /srv/BaseXWeb/WEB-INF/web.xml basex_1 | at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) is the image broken? Regards, Max

1 1

Large text files
by Tim Thompson 25 Nov '16

25 Nov '16

Hello, I have a large file[1] (3.5G unzipped) in the n-triples RDF format that I would like to work with in BaseX. When I try to read in the file using file:read-text(), I get the following error: Error: Version: BaseX 8.6 beta 8fa97ca Java: Oracle Corporation, 1.8.0_73 OS: Linux, amd64 Stack Trace: java.lang.NegativeArraySizeException at java.util.Arrays.copyOf(Arrays.java:3236) at org.basex.util.TokenBuilder.addByte(TokenBuilder.java:247) at org.basex.util.TokenBuilder.add(TokenBuilder.java:176) at org.basex.io.in.TextInput.cache(TextInput.java:143) at org.basex.io.in.TextInput.content(TextInput.java:132) at org.basex.query.value.item.StrStream.materialize(StrStream.java:71) at org.basex.query.value.item.StrStream.string(StrStream.java:44) at org.basex.query.expr.ParseExpr.toToken(ParseExpr.java:273) at org.basex.query.expr.ParseExpr.toEmptyToken(ParseExpr.java:261) at org.basex.query.func.fn.FnSubstring.item(FnSubstring.java:22) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:44) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:99) at org.basex.query.scope.MainModule$1.next(MainModule.java:122) at org.basex.query.QueryContext.cache(QueryContext.java:648) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:116) at org.basex.core.cmd.AQuery.query(AQuery.java:87) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:255) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:479) at org.basex.gui.GUI.access$3(GUI.java:433) at org.basex.gui.GUI$7.run(GUI.java:421) When I try to create a text database using the GUI, I get an error stating that the file could not be parsed. Is it possible to work with text files that are this large using BaseX? Thank you, Tim [1] Available for download here: http://www.bne.es/es/Inicio/Perfiles/Bibliotecarios/DatosEnlazados/Descarga… (http://datos.bne.es/datadumps/autoridades.nt.bz2) -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library

3 3

Re: [basex-talk] questions webfrontend icw BaseX-queryserver bachend
by Christian Grün 25 Nov '16

25 Nov '16

Hi Rob (cc to the list), > Thanx fort the quick reply. It sure helps but the db:output suggestion is not doing what I have in mind. > > - rest versus restxq. In that case I'll use the rest namespace. > - so it is a matter of choice. "Separation of concerns" would be my guideline in this. > - Yep, I want to return the save data to the client as a confirmation of the data that has been stored. This data is also enriched with f.e. an unique code. My problem with "db:output" is that the argument of the function is evaluated before the pending updates have been processed and I would like this evaluation take place on the updated data, like some kind of "reread"-functionality. I could not make this work with db:output. Am I overlooking something here? You are completely right, it is not possible to access the result of an update within the same query (because the pending updates will always be executed after query evaluation). This is what can be done instead: • You can use db:output(web:redirect(...)) to call another RESTXQ function that will generate the user feedback. This pattern is a good one for web applications anyway, because the result URL will be different from the updating URL. • An alternative is to create the result in main-memory and then a) write it to the database and b) pass it on to the client. Here is an arbitrary example: declare %updating %rest:POST %rest:path('/city/$city/$population') function local:update($city, $population) { let $city := db:open('factbook')//city[name = $city] let $updated-city := $city update { replace value of node population with $population } return ( replace node $city with $updated-city, db:output($updated-city) ) }; Does this help? Christian

2 1

questions webfrontend icw BaseX-queryserver bachend
by Rob Stapper 24 Nov '16

24 Nov '16

Hi, I'm working on this POC of a XML-database application with a web based frontend in Basex. I have a few questions: - what is the difference between the rest- and the restxq- prefix? Do they refer to different namespaces? - should I call database-functions in the backend- server through a client-server connection? If I call the database functions directly from my restxq-functions it just works. But is this a correct configuration in a multi-user environment? - in case of adding or changing data in the database, is it possible to retrieve the saved data form the dababase in the same session and return it to the webpage? The saved data is enriched with f.e. an unique identification that I want to return to the webpage. TIA for yout reply. Rob Stapper

2 1

"No function found that matches the request, " basexhttp, OS X El Capitan, and brew
by lambert strether 20 Nov '16

20 Nov '16

I first installed basex using the brew script recommended under "Other Distributions" here: http://basex.org/products/download/all-downloads/ basexgui worked fine, but when I ran basexhttp and went to localhost:8984 (and 127.0.0.1:8984) I got the following error: "No function found that matches the request" Rather than debug that, I uninstalled the brew installation and downloaded the BaseX 8.5.3.zip to my Home directory (/Users/...). Everything worked flawlessly out of the box, including basexhttp. Mac users: Don't worry about no *.dmg file. In my experience, the zip file should be fine (assuming your system requirements are fine, like an up-to-date Java). * * * Every communication from this account is off the record, unless explicitly put on the record.

1 0

Re: [basex-talk] Restxq handling accept-encoding
by Kendall Shaw 18 Nov '16

18 Nov '16

I should clarify that I’m asking about content negotiation. %rest:produces is described as constraining based on the Accept header. Should I explicitly look for Accept-Encoding and produce binary data that is in one of the requested compressed formats, or is there something in basex’s restxq implementation that does this? Kendall From: <basex-talk-bounces(a)mailman.uni-konstanz.de> on behalf of Kendall Shaw <kendall.shaw(a)workday.com> Date: Tuesday, November 15, 2016 at 4:58 PM To: BaseX <basex-talk(a)mailman.uni-konstanz.de> Subject: [basex-talk] Restxq handling accept-encoding To return compressed text data, should I explicitly look for Accept-Encoding and use java to deflate or gzip output of convert:binary-to-string(db:retrieve(…))? Kendall

2 4

Restxq handling accept-encoding
by Kendall Shaw 15 Nov '16

15 Nov '16

To return compressed text data, should I explicitly look for Accept-Encoding and use java to deflate or gzip output of convert:binary-to-string(db:retrieve(…))? Kendall

1 0

Testing one data directory per tenant
by Maximilian Gärber 14 Nov '16

14 Nov '16

Hi, I am testing how to change DBPATH dynamically to enable a simple form of multi tenancy (running one basex instance with separated data directories, so locking for example does not affect all tenants). Basically, I just keep/reuse several Context objects which have other options set [1] String dbpath = ctx.soptions.get(StaticOptions.DBPATH); String userDbPath = dbpath + "\\" + usr; ctx.soptions.put(StaticOptions.DBPATH, userDbPath); So far, I did not experience any issues, anything that speaks against doing this? Regards, Max [1] https://github.com/axxepta/basex-multitenant/blob/master/src/test/java/de/a…

2 1

Exporting large table from RDBMS
by Marco Lettere 14 Nov '16

14 Nov '16

Hi all, I'm currently facing the issue of exporting a large table stored in a MySQL instance to a csv that has then to be zipped and served through a web service. I'd love to use XQuery and the Basex functionality for doing it because it feels perfectly natural. The problem is that the XQuery script that performs the SQL Query and transformation to CSV crashes with an Out of Memory exception. I know how to increase memory and so on but I'd like to find a stable solution that is as less as possible dependent from the system requirements. Currently the only idea is to page the operation and (maybe exploiting parallel execution) build an intermediate result on disk files that will be assembled before delivery. Isn't there any more elegant solution based somehow on the streaming functionality or anything like this? Thanks for any advice you can provide. Regards, Marco.

3 7

xquery result limit
by George Sofianos 12 Nov '16

12 Nov '16

Hi, I've found this very good answer to limiting results in xquery. http://stackoverflow.com/a/8900472/1951487 I like that it works, but I was wondering if you can explain what happens in the background? Thanks, George

3 11

error when caling http service with latest Basex version ( Basex 8.6 beta baadd29)
by Rob Stapper 12 Nov '16

12 Nov '16

When calling the http-srvice through my browser with: http://robstapper.ddns.net:8984, I get an error-message from the service, see below, with the latest Basex version: Basex 8.6 beta baadd29. HTTP ERROR 500 Problem accessing /. Reason: Server Error Caused by: java.lang.NoSuchMethodError: org.basex.query.QueryContext.parse(Ljava/lang/String;Ljava/lang/String;Lorg/ basex/query/StaticContext;)Lorg/basex/query/Module; at org.basex.http.restxq.RestXqModule.qc(RestXqModule.java:120) at org.basex.http.restxq.RestXqModule.parse(RestXqModule.java:49) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:189) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:175) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:175) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:151) at org.basex.http.restxq.RestXqModules.find(RestXqModules.java:65) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:39) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137 ) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java :231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java :1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java: 193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java: 1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135 ) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:1 16) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpCo nnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpC onnection.java:971) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplet e(AbstractHttpConnection.java:1033) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:231) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java :82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint. java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.j ava:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java: 608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5 43) at java.lang.Thread.run(Unknown Source) _____ Powered by Jetty://

2 1

expath-pkg.xml on the server-side not recognized
by Rob Stapper 11 Nov '16

11 Nov '16

Hi, It's been a while. Doing other stuff. But in my spare time I'm still using Basex. I'm fiddling around with client-server concepts over http and I find that on the server-side, the expath-pkg.xml is ignored. Modules in repo can't be addressed by means of expath-pkg. I wonder if this is by design or is it something that should work. TIA for your reply. Rob Stapper

2 1

Starting long running jobs from a command script (bxs) block other command scripts
by Jan Dölle 08 Nov '16

08 Nov '16

Hi, I'm starting a job within a command script (startup.bxs). The job is a worker running the whole life of the application. It is not possible to run an other command script (shutdown.bxs) as long the job hasn't terminated. Calling xquery-scripts (shutdown.xq) will be possible anyway. Any Idea what's blocking the shutdown.bxs command script? Thank in advanced Jan --- startup.bxs: <commands> <xquery> Q{java:java.lang.System}setProperty("xq.machine.shutdown", "false") </xquery> <xquery><![CDATA[ jobs:eval( '( hof:until( function($f) { xs:boolean(Q{java:java.lang.System}getProperty("xq.machine.shutdown") = "true") }, function($f) { trace( concat( prof:current-ms(), " Job: ", jobs:current() ) ), prof:sleep(1000) }, () ), trace( concat( prof:current-ms(), " Job: ", jobs:current(), " shutdown" ) ) )' ) ]]></xquery> <jobs-list/> <xquery>trace("Hello")</xquery> </commands> shutdown.bxs (not able to run after startup.bxs): <commands> <jobs-list/> <xquery> Q{java:java.lang.System}setProperty("xq.machine.shutdown", "true") </xquery> </commands> shutdown.xq (will work): Q{java:java.lang.System}setProperty("xq.machine.shutdown", "true") -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

2 2

Accessing and using paths in database
by Bridger Dyson-Smith 08 Nov '16

08 Nov '16

Hi all, I've been looking through the documentation but not seeing (probably overlooking!) something on accessing paths in a database. If I create a db from the following directory structure: top-level/ dir-a/ sub-1/ file.xml sub-2/ file.xml dir-b/ sub-1/ file.xml sub-2/ file.xml dir-c/ ...etc... ...etc... is there a way to selectively process based on the path `top-level/dir-a`? I've been attempting some things along the following: for $doc in fn:collection('test-db') return switch(db:path($doc)) case fn:matches(.,'dir-a') return <something/> detault case <something-else/> but db:path returns a sequence. I've also tried something similar with $paths in db:open('test-db', $paths) but have had some difficulties with that as well. I've noticed a section on the Document Index [1], but I'm not sure how to access it. Honestly, I'm not sure if that's even the best approach to handling the vague idea I have bouncing around in my head. From a "large" database with many paths, I'd like to be able to selectively apply certain queries to some and other queries to the remainder. I hope that makes some sense. Thank you in advance for any pointers. Best, Bridger [1] http://docs.basex.org/wiki/Indexes#Document_Index

2 1

Java and XQuery
by meumapple 04 Nov '16

04 Nov '16

Since BaseX is written in Java, I was wondering if ,given a XQuery script, one could get the corresponding "Java translation". Thanks! Giuseppe

3 3

Bookmarks in PDF documentation
by Alex R. Loayza 03 Nov '16

03 Nov '16

Hello, BaseX's option to download the documentation in PDF format is great. I love being able to annotate the PDF docs. However, the PDF file comes with no bookmarks for the chapters, which count upwards 100. Several versions back, when I downloaded the docs, I took the effort to manually create the bookmarks. Without them, I have to do lengthy searches across the full docs to find what I'm looking for. As new releases of BaseX come, one wants the new docs. But alas, they come again with no bookmarks. That's why I'd like to suggest including automatically generated bookmarks for parts and chapters in the PDF documentation (see attached screenshot). This would make much easier to look for information in it. Hope you agree with me! Best regards, Alex

2 1

Backup / Recovery problem across versions
by Alex R. Loayza 03 Nov '16

03 Nov '16

Hello, I have an installation of BaseX 8.3 on Windows 8. Recently, I installed BaseX 8.5 on Ubuntu. I made a backup of my 8.3 installation and restored it on the 8.5 installation. Restoring went through with no issues. However, when I try to access documents on 8.5, for a few documents the doc() function works well and I get the document requested, but for others (most of them) I get the following error message: "Database path 'path/to/myDocument' yields no documents" I'm sure I'm using the right paths on doc(). Was there any special setting I should have taken care of while restoring the backup, or is it that backup / restore is not the correct process to migrate data from different versions of BaseX on differents OSs? Thanks in advance. Alex

2 1

Web sockets and BaseX
by France Baril 02 Nov '16

02 Nov '16

Has anyone implemented a solutions that uses web sockets with BaseX? I've been doing some work with socket.io and node.js, but all the research I've done on Jetty points to the need to create .java files that manage the connection on the server side. Does that mean I'd need a BaseX module to manage that? Since Jetty seems to support web sockets, do you forsee any other issues specific to BaseX? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 3

broken pipe in parallel queries
by George Sofianos 01 Nov '16

01 Nov '16

I'm having some issues with running some queries in parallel. If I run the script on one file, I get the expected result (the execution time is about 40 seconds for this specific script). If I run the same script on many XML files, at the same time, I get a broken pipe error. I'm using a java BasexClient to execute the queries, and I'm trying to execute the script on about 50 files at the same time (the .basex parallel configuration is the default). Could this be related to basex? It could also be a network issue so I'm still investigating. 10/28/2016 4:10:21 PM Suppressed: java.net.SocketException: Broken pipe 10/28/2016 4:10:21 PM at java.net.SocketOutputStream.socketWrite0(Native Method) 10/28/2016 4:10:21 PM at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113) 10/28/2016 4:10:21 PM at java.net.SocketOutputStream.write(SocketOutputStream.java:159) 10/28/2016 4:10:21 PM at org.basex.io.out.BufferOutput.flush(BufferOutput.java:60) 10/28/2016 4:10:21 PM at org.basex.io.out.BufferOutput.write(BufferOutput.java:54) 10/28/2016 4:10:21 PM at org.basex.io.out.PrintOutput.write(PrintOutput.java:66) 10/28/2016 4:10:21 PM at org.basex.io.out.ServerOutput.write(ServerOutput.java:31) 10/28/2016 4:10:21 PM at java.io.OutputStream.write(OutputStream.java:116) 10/28/2016 4:10:21 PM at org.basex.io.out.BufferOutput.flush(BufferOutput.java:60) 10/28/2016 4:10:21 PM at org.basex.io.out.PrintOutput.flush(PrintOutput.java:141) 10/28/2016 4:10:21 PM at org.basex.io.serial.OutputSerializer.close(OutputSerializer.java:82) 10/28/2016 4:10:21 PM at org.basex.server.ServerQuery.execute(ServerQuery.java:143) 10/28/2016 4:10:21 PM ... 2 more

2 2

map:merge new semantics for 8.6
by Marc van Grootel 31 Oct '16

31 Oct '16

Hi, Any reason why the deault semantics for map:merge in 8.6 changed in a backwards incompatible manner? Is this because of some XQuery/XPath spec thing? A while ago I switched to 8.6-SNAPSHOT just to be on the latest and greatest and I starting seeing weird things in my code. Initially I didn't bother to look at the docs as I didn't expect map:merge to have changed. At some point I even thought map:merge was broken in this snapshot. I often use map:merge for handling function options and I add the defaults first and then user options. With 8.6 this default behaviour has changed and I would have to switch this around or explicitly ask for 'use-last'. I can do but only by adding map { 'duplicates': 'use-last' }. This means I will have code <= 8.5 and I need to have different code for > 8.5. Was this intentional? If not then I would vote for re-instating default behaviour (use-last). Cheers, --Marc

2 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk