BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5269 discussions

Exporting large table from RDBMS
by Marco Lettere 14 Nov '16

14 Nov '16

Hi all, I'm currently facing the issue of exporting a large table stored in a MySQL instance to a csv that has then to be zipped and served through a web service. I'd love to use XQuery and the Basex functionality for doing it because it feels perfectly natural. The problem is that the XQuery script that performs the SQL Query and transformation to CSV crashes with an Out of Memory exception. I know how to increase memory and so on but I'd like to find a stable solution that is as less as possible dependent from the system requirements. Currently the only idea is to page the operation and (maybe exploiting parallel execution) build an intermediate result on disk files that will be assembled before delivery. Isn't there any more elegant solution based somehow on the streaming functionality or anything like this? Thanks for any advice you can provide. Regards, Marco.

3 7

xquery result limit
by George Sofianos 12 Nov '16

12 Nov '16

Hi, I've found this very good answer to limiting results in xquery. http://stackoverflow.com/a/8900472/1951487 I like that it works, but I was wondering if you can explain what happens in the background? Thanks, George

3 11

error when caling http service with latest Basex version ( Basex 8.6 beta baadd29)
by Rob Stapper 12 Nov '16

12 Nov '16

When calling the http-srvice through my browser with: http://robstapper.ddns.net:8984, I get an error-message from the service, see below, with the latest Basex version: Basex 8.6 beta baadd29. HTTP ERROR 500 Problem accessing /. Reason: Server Error Caused by: java.lang.NoSuchMethodError: org.basex.query.QueryContext.parse(Ljava/lang/String;Ljava/lang/String;Lorg/ basex/query/StaticContext;)Lorg/basex/query/Module; at org.basex.http.restxq.RestXqModule.qc(RestXqModule.java:120) at org.basex.http.restxq.RestXqModule.parse(RestXqModule.java:49) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:189) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:175) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:175) at org.basex.http.restxq.RestXqModules.cache(RestXqModules.java:151) at org.basex.http.restxq.RestXqModules.find(RestXqModules.java:65) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:39) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137 ) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java :231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java :1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java: 193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java: 1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135 ) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:1 16) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpCo nnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpC onnection.java:971) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplet e(AbstractHttpConnection.java:1033) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:231) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java :82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint. java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.j ava:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java: 608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5 43) at java.lang.Thread.run(Unknown Source) _____ Powered by Jetty://

2 1

expath-pkg.xml on the server-side not recognized
by Rob Stapper 11 Nov '16

11 Nov '16

Hi, It's been a while. Doing other stuff. But in my spare time I'm still using Basex. I'm fiddling around with client-server concepts over http and I find that on the server-side, the expath-pkg.xml is ignored. Modules in repo can't be addressed by means of expath-pkg. I wonder if this is by design or is it something that should work. TIA for your reply. Rob Stapper

2 1

Starting long running jobs from a command script (bxs) block other command scripts
by Jan Dölle 08 Nov '16

08 Nov '16

Hi, I'm starting a job within a command script (startup.bxs). The job is a worker running the whole life of the application. It is not possible to run an other command script (shutdown.bxs) as long the job hasn't terminated. Calling xquery-scripts (shutdown.xq) will be possible anyway. Any Idea what's blocking the shutdown.bxs command script? Thank in advanced Jan --- startup.bxs: <commands> <xquery> Q{java:java.lang.System}setProperty("xq.machine.shutdown", "false") </xquery> <xquery><![CDATA[ jobs:eval( '( hof:until( function($f) { xs:boolean(Q{java:java.lang.System}getProperty("xq.machine.shutdown") = "true") }, function($f) { trace( concat( prof:current-ms(), " Job: ", jobs:current() ) ), prof:sleep(1000) }, () ), trace( concat( prof:current-ms(), " Job: ", jobs:current(), " shutdown" ) ) )' ) ]]></xquery> <jobs-list/> <xquery>trace("Hello")</xquery> </commands> shutdown.bxs (not able to run after startup.bxs): <commands> <jobs-list/> <xquery> Q{java:java.lang.System}setProperty("xq.machine.shutdown", "true") </xquery> </commands> shutdown.xq (will work): Q{java:java.lang.System}setProperty("xq.machine.shutdown", "true") -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

2 2

Accessing and using paths in database
by Bridger Dyson-Smith 08 Nov '16

08 Nov '16

Hi all, I've been looking through the documentation but not seeing (probably overlooking!) something on accessing paths in a database. If I create a db from the following directory structure: top-level/ dir-a/ sub-1/ file.xml sub-2/ file.xml dir-b/ sub-1/ file.xml sub-2/ file.xml dir-c/ ...etc... ...etc... is there a way to selectively process based on the path `top-level/dir-a`? I've been attempting some things along the following: for $doc in fn:collection('test-db') return switch(db:path($doc)) case fn:matches(.,'dir-a') return <something/> detault case <something-else/> but db:path returns a sequence. I've also tried something similar with $paths in db:open('test-db', $paths) but have had some difficulties with that as well. I've noticed a section on the Document Index [1], but I'm not sure how to access it. Honestly, I'm not sure if that's even the best approach to handling the vague idea I have bouncing around in my head. From a "large" database with many paths, I'd like to be able to selectively apply certain queries to some and other queries to the remainder. I hope that makes some sense. Thank you in advance for any pointers. Best, Bridger [1] http://docs.basex.org/wiki/Indexes#Document_Index

2 1

Java and XQuery
by meumapple 04 Nov '16

04 Nov '16

Since BaseX is written in Java, I was wondering if ,given a XQuery script, one could get the corresponding "Java translation". Thanks! Giuseppe

3 3

Bookmarks in PDF documentation
by Alex R. Loayza 03 Nov '16

03 Nov '16

Hello, BaseX's option to download the documentation in PDF format is great. I love being able to annotate the PDF docs. However, the PDF file comes with no bookmarks for the chapters, which count upwards 100. Several versions back, when I downloaded the docs, I took the effort to manually create the bookmarks. Without them, I have to do lengthy searches across the full docs to find what I'm looking for. As new releases of BaseX come, one wants the new docs. But alas, they come again with no bookmarks. That's why I'd like to suggest including automatically generated bookmarks for parts and chapters in the PDF documentation (see attached screenshot). This would make much easier to look for information in it. Hope you agree with me! Best regards, Alex

2 1

Backup / Recovery problem across versions
by Alex R. Loayza 03 Nov '16

03 Nov '16

Hello, I have an installation of BaseX 8.3 on Windows 8. Recently, I installed BaseX 8.5 on Ubuntu. I made a backup of my 8.3 installation and restored it on the 8.5 installation. Restoring went through with no issues. However, when I try to access documents on 8.5, for a few documents the doc() function works well and I get the document requested, but for others (most of them) I get the following error message: "Database path 'path/to/myDocument' yields no documents" I'm sure I'm using the right paths on doc(). Was there any special setting I should have taken care of while restoring the backup, or is it that backup / restore is not the correct process to migrate data from different versions of BaseX on differents OSs? Thanks in advance. Alex

2 1

Web sockets and BaseX
by France Baril 02 Nov '16

02 Nov '16

Has anyone implemented a solutions that uses web sockets with BaseX? I've been doing some work with socket.io and node.js, but all the research I've done on Jetty points to the need to create .java files that manage the connection on the server side. Does that mean I'd need a BaseX module to manage that? Since Jetty seems to support web sockets, do you forsee any other issues specific to BaseX? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk