- BaseX-Talk - mailman.uni-konstanz.de

Trying to get started with IntelliJ and BaseX
by Bridger Dyson-Smith 25 Feb '15

25 Feb '15

Hi all, I'm unsure of how many IntelliJ users there are here, but I'm hitting some embarrassingly simple problems and I hope someone can provide some guidance. I'm trying to use BaseX 8.0 as a data source for a simple query [1]. However I'm unable to apply the query against a database. I've added BaseX as an XQuery data source: *File* > *Settings* > *Other Settings* > *XQuery Data Sources* > "*+*" (*add a data source*) > Name: BaseX80-tei Host: localhost Port: 1984 Database name: tei-dump Username: admin Password: admin I've added a *Run* *Configuration*: Run > Edit Configurations > "+" (add a configuration) > XQuery Main Module > Name: name-query Configuration: Main file: /usr/home/bridger/src/basex/80/basex/repo/name.xq Data source: BaseX80-tei (from above) Java Configuration: VM options: blank Program arguments: blank Working directory: /usr/home/bridger/src/basex/80/basex Use classpath of module: basex When I try to run the configuration, I get a Java exception [2]. I'm fairly sure that this is user/operator error, but I'm not quite sure what I've done wrong. Thank you for reading. Cheers, Bridger [1] names.xq <results> { for $n in //*:name return $n } </results> [2] Java exception: /usr/local/openjdk7/bin/java -Didea.launcher.port=7532 -Didea.launcher.bin.path=/usr/home/bridger/bin/idea/bin -Dfile.encoding=UTF-8 -classpath /usr/home/bridger/.IntelliJIdea14/config/plugins/intellij-xquery/lib/intellij-xquery-rt.jar:/usr/home/bridger/.IntelliJIdea14/config/plugins/intellij-xquery/lib/xqj-api-1.0.jar:/usr/home/bridger/.IntelliJIdea14/config/plugins/intellij-xquery/lib/xqj2-0.2.0.jar:/usr/home/bridger/.IntelliJIdea14/config/plugins/intellij-xquery/lib/basex-xqj-1.3.0.jar:/usr/local/openjdk7/jre/lib/compilefontconfig.jar:/usr/local/openjdk7/jre/lib/management-agent.jar:/usr/local/openjdk7/jre/lib/javazic.jar:/usr/local/openjdk7/jre/lib/resources.jar:/usr/local/openjdk7/jre/lib/jce.jar:/usr/local/openjdk7/jre/lib/charsets.jar:/usr/local/openjdk7/jre/lib/jsse.jar:/usr/local/openjdk7/jre/lib/rt.jar:/usr/local/openjdk7/jre/lib/ext/zipfs.jar:/usr/local/openjdk7/jre/lib/ext/localedata.jar:/usr/local/openjdk7/jre/lib/ext/dnsns.jar:/usr/local/openjdk7/jre/lib/ext/sunpkcs11.jar:/usr/local/openjdk7/jre/lib/ext/sunjce_provider.jar:/usr/local/openjdk7/jre/lib/ext/sunec.jar:/usr/home/bridger/bin/idea/lib/idea_rt.jar com.intellij.rt.execution.application.AppMain org.intellij.xquery.runner.rt.XQueryRunnerApp /usr/home/bridger/.IntelliJIdea14/system/tmp/xquery-run8080433949304952694.xml Exception in thread "main" javax.xml.xquery.XQException: XQJNC001 - Connection refused Root Cause: java.net.ConnectException: Connection refused at net.xqj.basex.BaseXXQDataSource.getConnection(Unknown Source) at org.intellij.xquery.runner.rt.xqj.ConnectionFactory.getConnection(ConnectionFactory.java:36) at org.intellij.xquery.runner.rt.xqj.XQJRunnerApp.run(XQJRunnerApp.java:57) at org.intellij.xquery.runner.rt.XQueryRunnerApp.runConfigForOutputStream(XQueryRunnerApp.java:35) at org.intellij.xquery.runner.rt.XQueryRunnerApp.main(XQueryRunnerApp.java:30) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134) at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at net.xqj.basex.BaseXXQDataSource.getConnection(Unknown Source) at org.intellij.xquery.runner.rt.xqj.ConnectionFactory.getConnection(ConnectionFactory.java:36) at org.intellij.xquery.runner.rt.xqj.XQJRunnerApp.run(XQJRunnerApp.java:57) at org.intellij.xquery.runner.rt.XQueryRunnerApp.runConfigForOutputStream(XQueryRunnerApp.java:35) at org.intellij.xquery.runner.rt.XQueryRunnerApp.main(XQueryRunnerApp.java:30) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134)

4 5

Executing Xquery update from java - hangs
by Ketill Fenne 25 Feb '15

25 Feb '15

Hi! I am executing all Xqueries through the same runQuery method in Java, and I am running the latest jar-files (8.0.1): XQDataSource ds = new BaseXXQDataSource(); xqc = ds.getConnection(); XQExpression xqe = xqc.createExpression(); rs = xqe.executeQuery(query); The query is (in this case): for $doc in (collection('Users/customer_1'))/* return (replace value of node $doc/@name with ("My new customer name")) The update works fine in BaseX Gui, and I suspect the problem is that it does not return anything, and my code expects XQResultSequence. I have tried adding db:output to return part of the query with no luck. Do you have any suggestions? Kind regards Ketill Fenne

2 1

function:module
by Emmanuel Chateau 25 Feb '15

25 Feb '15

Hi, In the result of a function:inspect(), it seems that the @name of the function element is not a prefixed name when using the "declare default namespace" in a function module whereas it is prefixed name for the others. Is it me who miss something, or it should always be the same ? Thanks, Emmanuel

2 4

Performance of PUL commit
by Marco Lettere 25 Feb '15

25 Feb '15

It's me again .... sorry. ;-) One question that puzzles me in these last hours .. This is the scenario on 2 DBs (same server) with the following sizes: 136746 docs ~1 Gb 194608 docs ~0.5 Gb declare %rest:path('{$project}/some/url/') %rest:POST('{$body}') %rest:consumes("application/xml") function _:insert($project, $body) { prof:time( __:insert_impl($project, $body), false(), "POST ACCOUNT") }; The function insert() is an RestXQ entry point for document insertion. It delegates to the actual implementing function. Insertion occurs continuosly. The implementing function performs queries for checking uniqueness of what is inserted and then posts the actual update which is a db:add or db:replace (BTW does this make a difference from a performance point of view?????). Insertion might occur either on one or on both the DBs. The time T output by the profile:time is a steady amount of time. This means that queries and update schedule is working in constant time. The time reported by Jetty (and perceived at the client) is a T + d. The issue is that this d may vary from something around few hundreds of milliseconds to something which is 4 or 5 times T itself. And this happens in waves. When it's slow, it's slow for few minutes and then it gets better for a few minutes and then back again ... When staring at the tcpdump it's evident that all the time is spent between the ack of the request and the sending of the response. Thus network overhead is negligible. This makes me think that the overhead is in the commit of the PUL. Is this possible? I'm using basex 8.0 official. Openjdk 7 and monitoring through JMX doesn't show anything particularly critical. Any clues on what I have to better look into? Thanks and sorry for bothering ... M.

2 11

BaseX 8.0.1: Minor Patches
by Christian Grün 25 Feb '15

25 Feb '15

Hi there, We have just released a first post-Prague version of BaseX, which includes some minor optimizations and fixes (nothing critical): XQUERY - Faster execution of single, index-based results - Iterative evaluation of steps with multiple predicates FIXES - WebDAV locking - Archive Module - Adaptive serialization of arrays and maps - Digest Authentication - Save command-line history In future, we will try our best to release bug fixes more regularly. This way, you can stay up-to-date without the need to check for new versions five times a day. Have fun, Christian [1] http://basex.org/downloads

2 1

Re: [basex-talk] Modelling Checkin-Checkout using locks
by Christian Grün 24 Feb '15

24 Feb '15

I have added a GitHub issue on your locking request [1]. In the meanwhile, it's probably best to use RESTXQ (XQuery) and check if a resource is locked before returning it to a user. [1] https://github.com/BaseXdb/basex/issues/1083 On Mon, Feb 23, 2015 at 6:28 PM, <zopyxfilter(a)gmail.com> wrote: > Andreas Jung wrote: >> Christian Grün wrote: >>>> oops, this was intended for the exist-db guys...but the question >>>> are similar...anyone used BaseX with a checkout-checkin scenario? >>> First of all: I'm also interested to hear more about this from our >>> users.. >> >>> Talking about locking functions, we plan to generalize our WebDAV >>> locking feature to a general database locking mechanism. The WebDAV >>> locks already contain information on the user who created the lock, >>> a timeout, the scope (shared vs. exclusive), the lock id, etc., and >>> this info could be extended by the lock time and other (maybe even >>> application specific) info. Do you have some examples for data that >>> could be specific to an application? >> >> In our SGML CMS you were able to checkout parts of a bigger document >> for example a chapter. In this case we needed additional information >> inside the checked-out document - perhaps not on the lock itself - >> we used processing instructions for that as far as I recall. >> >> Being able to store arbitrary key-value pairs on a lock would be >> sufficient. Otherweise I would store such application specific >> data as an additional XML file containing these informations. > > At least needs to be some support for lock token in order detect > lock/unlock conflicts. > > Andreas

2 1

Xquery issue
by Rob Stapper 24 Feb '15

24 Feb '15

Hi guys, While debugging a xquery-program I saw something strange behavior( to me anyway). I reproduced it in the attached xquery-snipped. Looking at the evaluation data in the query-info screen of the basexGUI after running the program, one can see that function $f($a) is evaluated more than ones. The result is ok but I wondered if this would reduce the performance. I'm running version 8.01 beta d13ddc7 in local GUI-mode. Regards, Rob Stapper --- Dit e-mailbericht is gecontroleerd op virussen met Avast antivirussoftware. http://www.avast.com

3 3

Comparing Two Iter Objects.
by ankit kumar 24 Feb '15

24 Feb '15

Hi, I want to compare equality for two Iter objects. Each contains a set of DBNodes in unordered manner. I have created a wrapper for Iter object. Can you please help me in defining equals and hashcode method for the wrapper. Thanks Ankit

2 3

DBNode Not Overriding equals() and hashcode() method.
by ankit kumar 24 Feb '15

24 Feb '15

Hi, I am trying to maintain a Set of DBNode Object But, it was not working properly because DBNode is not overriding the equals() and hashcode() methods. Due to this reason i am facing difficulty to maintain similar DBNode. Looking forward for help. Thanks & Regards Ankit Kumar

2 1

CLI issue with 8.0.1
by Marco Lettere 24 Feb '15

24 Feb '15

Hello all, I'm unable to execute the example from documentation: bin/basex -b$v=example "declare variable $v external; $v" IT gives this exception: Stopped at ., 1/19: [XPST0003] Expecting '$', found 'e'. Any clues? Regards, MArco.

3 3

Modelling Checkin-Checkout using locks
by Andreas Jung 23 Feb '15

23 Feb '15

Hi there, I am currently thinking about ways how to model a reliable checkout-checkin scenario with XML documents. In an older SGML CMS system that we build, we implemented the procedure roughly like that: - user chooses a document in the CMS and clicks on CHECKOUT - CHECKOUT copy the document to a private area of the user - CHECKOUT will lock the original file (reads allowed, write forbidden) - user edits the the copied content - user performs either a CHECKIN which will copy the private copy of the file into its original location and release the lock - or user will cancel the checkout (removing the copy and releasing the lock) I see that exist-db has support for read and exclusive locks (inside the util: module). Can they be used to implement such a scenario? Is it possible to associate (arbitrary metadata) with locks like lock time, user who created the lock, app specific data? Is it possible to introspect all current locks on the database? Is there something like a lock token (in WebDAV) does one needs to release a lock? Andreas

2 3

http:send-request / Digest - problem
by Hans-Juergen Rennau 23 Feb '15

23 Feb '15

Dear BaseX team, I have problems to get the http:send-request going when using Digest authentication. I get a response as if the password were wrong, although I think it isn't. Request: <http:request method='post' send-authorization='true' username='foofoo' password='secret' auth-method="Digest"> <http:body media-type='text/xml' method='xml'>{$useMsg}</http:body> </http:request> Response: <http:response xmlns:http="http://expath.org/ns/http-client" status="401" message="Unauthorized"> <http:header name="Server" value="Apache/2.2.22 (Ubuntu)"/> <http:header name="WWW-Authenticate" value="Digest realm="traveltainment", qop="auth", nonce="1424448664077:8d932e72fb644113f4fb1a76f942cf1d", opaque="pcyalPBREdBtyQHIHRxOQPgGANZiOjeW""/> <http:header name="Connection" value="close"/> <http:header name="Vary" value="Accept-Encoding"/> <http:header name="Content-Length" value="954"/> <http:header name="Date" value="Fri, 20 Feb 2015 16:11:04 GMT"/> <http:header name="Content-Type" value="text/html;charset=utf-8"/> </http:response> Interestingly, a JMeter test using the same URL, user name and password works correctly. (I used copy & paste to transfer the credentials from the JMeter GUI into the XQuery code, and the credentials are just what some documentation tells me; tried of course also typing them in manually.) Using WireShark, I observed the messages sent by JMeter and BaseX, respectively. BaseX does send two requests, as it is supposed to do; but the authorization data sent by the second one are in two respects different from the data sent by JMeter: JMeter sends a field: algorithm="MD5", which BaseX does not, and the cnonce is much longer. (See below for the authorization strings.) I use Java 8, and I suspect the problem is connected with that. I heard rumours that Digest authentication with Java 8 might require a little adaptation of the code. Did you try the module using Java8? Cheers,Hans-Juergen PS: (1) Authentication sent by BaseX, failing: User-Agent:Java/1.8.0_31 Authorization:Digest username=foofoo, realm=traveltainment,nonce=1424448664069:b6ed9add48830631ae90ad27cfcb5c5e,uri=/TTXml-1.6/Dispatcher/Search/Package/RegionList,qop=auth,nc=00000001,cnonce=9b2ff1ce6900217dd6be667aa6f99e12,response=4e35b40dd4ba7d62cd6123d9adebc046,opaque=pcyalPBREdBtyQHIHRxOQPgGANZiOjeW Authorization:Digest username=foofoo,realm=traveltainment,nonce=1424449896135:5fa18cec34de1a15d8ce2a36df77bd6a,uri=/TTXml-1.6/Dispatcher/Search/Package/RegionList,qop=auth,nc=00000001,cnonce=5be8fce766d843e8ea29936b73ed94c7,response=3757d8fb6cfc4c997030541c58e72d61,opaque=pcyalPBREdBtyQHIHRxOQPgGANZiOjeW (2) Authentication sent by JMeter, successfully (please note the "algorithm" field; also note the much shorter cnonce): User-Agent:Apache-HttpClient/4.2.6 (java 1.5) Autorization:Digest username="foofoo", realm="traveltainment",nonce="1424448476861:032a9011541d271a429d737844ec860a",uri="/TTXml-1.6/Dispatcher/Search/Package/RegionList",response="df6416855e49a0f28cff8020c30ad3a7",qop=auth,nc=00000001,cnonce="c4b43ae817866fb5",algorithm="MD5",opaque="pcyalPBREdBtyQHIHRxOQPgGANZiOjeW" Authorization:Digest username="foofoo", realm="traveltainment", nonce="1424450034667:82c9d9977a208442a7926a948e163e45", uri="/TTXml-1.6/Dispatcher/Search/Package/RegionList",response="74712ad74209c954bfb6e545b5f8670b",qop=auth,nc=00000001,cnonce="788dbfb1ed7a77ef",algorithm="MD5",opaque="pcyalPBREdBtyQHIHRxOQPgGANZiOjeW"

2 6

Re: [basex-talk] BaseX-Talk Digest, Vol 62, Issue 31
by Jothivel S 23 Feb '15

23 Feb '15

Hi Christian, I just query the root element like "/root" from the xml(database). When I was getting the out of memory, the thread did hold more than ~200MB in size. but actual xml size is ~1.2 MB. And that 200MB file have some encrypted data like "òª©" and the same code got repeated many times(probably this would cause the 200 MB). Is there any issue with it? Also I am using the same context for read and write. That is single context is used for read and write operation parallely and read and write operation for the same database is synchronized. please let me know if you need more information in this regard. Thanks,Jothivel On Friday, 20 February 2015 6:58 PM, Christian Grün <christian.gruen(a)gmail.com> wrote: Hi Jothivel, > I am getting out of memory error when i do the execute query operation. Sorry, I need more information on your particular query. Unfortunately, we cannot provide free support for older versions. What happens with Version 8.0? > 2. without migrating the basex 7.6 to 8.0, is it possible to avoid the > increase of size. Yes, as I said in my previous mail, we have worked on that in the meanwhile. Hope this helps, Christian PS: Please always write to the basex-talk mailing list; this way, others can benefit from the feedback as well.

2 5

Re: [basex-talk] impressed! and already trying to run before I can walk
by Niels Grundtvig Nielsen 23 Feb '15

23 Feb '15

Some years ago … running anything interesting on a Linux platform was a geekish activity involving compilation, dependency-hunting and many other time-consuming activities that put quite a few people off. In the interim, non-technical Linux users (like me!) have become used to packages that do all this black magic for them. So I was a bit disappointed when unzipping the Ubuntu installation files gave me nothing I could run and no clear instructions (at least at my level) for what I had to do with the contents of the archive. Can someone, please, give me clear, simple instructions that cover: - what extra programs I may need to install before being able to compile/installe BaseX - what I have to do, step by step, to compile/installe BaseX Of course, an even better answer would be "run this install script" … :-} Thanks in advance for help and advice. On Wed, Feb 4, 2015 at 1:48 PM, Niels Grundtvig Nielsen < communicator.ngn(a)gmail.com> wrote: > The next big test for me is, will BaseX install as easily on my Ubuntu box > at home as it did on a Windows PC at work … hope so, because the interface > is a much better match for the sort of things I want to do with an XML > database than the/an other free option I tried. > > On Tue, Feb 3, 2015 at 1:16 PM, Menashè Eliezer <meliezer(a)ogs.trieste.it> > wrote: > >> Hi Niels, >> Just confirming BaseX is very good. I've confronted its performance and >> support to the biggest open source alternative, which I won't mention its >> name here. >> >> With kind regards, >> Menashè >> >> On 02/02/2015 02:48 PM, Bridger Dyson-Smith wrote: >> >> Hi Niels, >> >> BaseX has some very nice documentation in the wiki [1]. The WIkibooks >> XQuery document can be helpful[2] and Priscilla Walmsley's XQuery book is >> an absolutely fantastic reference. >> >> Hope that's helpful. >> Cheers, >> Bridger >> >> [1] http://docs.basex.org/wiki/XQuery >> [2] http://en.wikibooks.org/wiki/XQuery >> >> On Mon, Feb 2, 2015 at 8:42 AM, Niels Grundtvig Nielsen < >> communicator.ngn(a)gmail.com> wrote: >> >>> BaseX already looks/feels like a program I am going to enjoy using, >>> even with the general challenge that I don't know enough about xQuery. I >>> would welcome suggestions for anywhere to find a friendly introduction! >>> >>> My first specific challenge is trying to under the syntax for replace. >>> In the code, I've managed to retrieve a single xml document where <title> >>> contains "35. Andan" … I made a copy/paste error, and in this document the >>> value of title should be '35. Andantino' instead of '35. Andantino mesto'. >>> My experiment is obviously incorrect, so I'd welcome tips on what's wrong >>> with it. >>> >>> //score[contains(title, '35. Andan')]//title >>> replace value of (title) with '35. Andantino' >>> >>> Thanks in advance! >>> >> >> >> >

4 4

unsubscribe
by Scholte, Hans 23 Feb '15

23 Feb '15

1 0

BaseX User Meetup: Slides and Videos
by Christian Grün 22 Feb '15

22 Feb '15

Dear all, It was great to meet many of you live in Prague! The slides and videos of our BaseX User Meetup are now online: http://files.basex.org/publications/xmlprague/2015.html Have fun, Christian BaseX Team

1 0

Jetty / HTTP exception
by Marco Lettere 22 Feb '15

22 Feb '15

Hi to all, when looking into the logs for all sort of things we noticed that we get a lot of exceptions with the stacktrace shown in [1]. We are heavily using RestXQ to insert documents at a rather high pace. It doesn't compromise the functioning of the system which looks to be behaving correctly. Nevertheless we have the feeling that when it happens we get a slowing down of the delivery of the response to the client. I say feeling because this has yet to be proved. Anyone knows what this exception is about and whether it can be avoided somehow? Maybe tuning Jetty configuration? Thanks a lot, Marco. [1] java.io.IOException: Closed at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:140) at org.eclipse.jetty.server.HttpOutput.write(HttpOutput.java:117) at org.basex.http.restxq.RestXqResponse.create(RestXqResponse.java:104) at org.basex.http.restxq.RestXqModule.process(RestXqModule.java:97) at org.basex.http.restxq.RestXqFunction.process(RestXqFunction.java:104) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:29) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) java.lang.IllegalStateException: Committed at org.eclipse.jetty.server.Response.resetBuffer(Response.java:1130) at org.basex.http.HTTPContext.status(HTTPContext.java:254) at org.basex.http.BaseXServlet.service(BaseXServlet.java:71) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745)

2 4

WebDAV PUT inside the root folder creates a collectioni rather than a resource
by Andreas Jung 22 Feb '15

22 Feb '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, me again :-) This is the root of my BaseX installation: dav:/webdav/> ls Listing collection `/webdav/': succeeded. Coll: BaseX80 0 Feb 15 17:20 Coll: all 0 Feb 22 17:22 Coll: lib 0 Feb 15 17:21 Coll: my-onkopedia 0 Feb 15 17:24 Coll: onkopedia-p 0 Feb 15 17:32 Coll: onkopedia 0 Feb 21 16:00 Coll: scripts I upload a a file 'README.rst' using cadaver and BaseX creates a collection 'README' instead of a resource: dav:/webdav/> put README.rst Uploading README.rst to `/webdav/README.rst': Progress: [=============================>] 100.0% of 2772 bytes succeeded. dav:/webdav/> ls Listing collection `/webdav/': succeeded. Coll: BaseX80 0 Feb 15 17:20 Coll: README 0 Feb 22 17:34 Coll: all 0 Feb 22 17:22 Coll: lib 0 Feb 15 17:21 Coll: my-onkopedia 0 Feb 15 17:24 Coll: onkopedia-p 0 Feb 15 17:32 Coll: onkopedia 0 Feb 21 16:00 Coll: scripts 0 Feb 20 20:25 dav:/webdav/> I assume that resources should be allowed within the root folder. Andreas -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJU6gVpAAoJEADcfz7u4AZjF64LwLGdkp7w+Dwniz/8MYGlWX+R ngO1Dwmcev75PN9I9KQzMEYlQxzVLajYP9DoCAsziBgSLqZZJQyxInhh1KdoZvPO od4ESTCVhAGbnSjws4tiZ0gUFMkrkf8yJu+JgRGBBpOskon3/9HjbnBoKJIzQTsU /6Cm81gszNy12lkDDqoEjGtXzCnu1bl5vHrLESmoQ/Mrb1lx/qAXOrcpnR7RKJSu aG0CcmhZKRWZK+ipwT6FaV7HJDZYu/twOnpES8howKDmJk1e03HW6lmf54Wwo4MM hcvjYmN+PnFzNj/WKAZJHWr+6lwWdiUp3EkTX2t4GqfyeMfflaX1J/prhc/FKGIA nWF+qQKh6ogtxpHhiWIizxDfN3ppiB6Nz1f51m1ePB+ea3qg3cVghqw5KQLWncwK nXSHwcrUHzbIqvyawFTyhTQLdTs/CIEniT1fFB4u572blnNHHw2P8LqftEOovyZP NATSv1cw3LxPYrLxK+RL1Z3yIcU104Q= =cI7q -----END PGP SIGNATURE-----

2 3

WebDAV Lock error
by Andreas Jung 22 Feb '15

22 Feb '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, some more WebDAV issues (tested against the 8.1 snapshot from yesterday). - - connecting with cadaver and locking a file twice causes a HTTP 500 error on the cadaver side and BaseX fails with this exception: [qtp2029686239-17] INFO com.bradmcevoy.http.HttpManager - PROPFIND :: http://dev1.veit-schiele.de:8984/webdav/scripts/backup.xql - http://dev1.veit-schiele.de:8984/webdav/scripts/backup.xql [qtp2029686239-16] INFO com.bradmcevoy.http.HttpManager - LOCK :: http://dev1.veit-schiele.de:8984/webdav/scripts/backup.xql - http://dev1.veit-schiele.de:8984/webdav/scripts/backup.xql [qtp2029686239-16] ERROR com.bradmcevoy.http.StandardFilter - process java.lang.NullPointerException at com.bradmcevoy.http.webdav.LockHandler.respondWithToken(LockHandler.java:274) at com.bradmcevoy.http.webdav.LockHandler.processRefresh(LockHandler.java:256) at com.bradmcevoy.http.webdav.LockHandler.processExistingResource(LockHandler.java:112) at com.bradmcevoy.http.webdav.LockHandler.process(LockHandler.java:86) at com.bradmcevoy.http.StandardFilter.process(StandardFilter.java:52) at com.bradmcevoy.http.FilterChain.process(FilterChain.java:40) at com.bradmcevoy.http.HttpManager.process(HttpManager.java:228) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:43) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Unknown Source) . 2nd problem: locking the same file twice works when I disconnect and reconnect with cadaver: ..... dav:/webdav/scripts/> lock backup.xql Locking `backup.xql': succeeded. dav:/webdav/scripts/> Connection to `dev1.veit-schiele.de' closed. Suxmac:~ ajung$ cadaver http://dev1.veit-schiele.de:8984/webdav Authentication required for BaseX on server `dev1.veit-schiele.de': Username: admin Password: dav:/webdav/> cd scripts dav:/webdav/scripts/> lock backup.xql Locking `backup.xql': succeeded. It is nice that the 2nd lock call works however this indicates that locking does not work at all since a lock should persist across connections. Andreas -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJU6FRtAAoJEADcfz7u4AZjmOILv0B5T2l3tMIhLzCOljWLMw7R aC8H0dqOo/KtBV750eNAGpzmxGpFSd59SB35C2lrBOleCOIjI9fm/JzhCa0Mw2/J m1lLRAn9uK9i0uq7B7TKVlXf4N6vatZ8eecVs9KPBs0PB7D/G/GBl6ws9MfVY8QX g3OEa3A+Wi/FlMy0VDuVysYtvfs9CqGWe1etemYSA1u9z1dMN54ZkQKWKuoEi7mZ 9WPUNSF6A9kw5u6ACaTt2Qx7chzPreRckw9JmipVmv4xdZL1xWkW8yZGADL5jf94 egb0qzWrYSjSkrV/4lNkCgDoW0/+IebXq1lDC2/nQtwgyumi0jyNzWy9jKtziM6G WqUt1XM+A1buttMQ5+Z3WGZ1QdCd2yhoOT75bQTkhjuDBZTCiQwHabYgIPgfWHZX BNYE90SrBdRYIR/9n0q2+aG0oPEKlMWeDCVMAS35Q9naczYdl6jtVAJuiJ7KsvU4 QAQ3as+p2rAuUF2S1RXdIZ6m3VGL0Uw= =xLzv -----END PGP SIGNATURE-----

2 2

Fwd: Re: schema validation
by Dirk Kirsten 21 Feb '15

21 Feb '15

After Christians mail I realized I pressed the wrong reply button, so I sent I forward my response to the mailing list. But good to see Christian says basically the same :) Cheers, Dirk -------- Forwarded Message -------- Subject: Re: [basex-talk] schema validation Date: Fri, 20 Feb 2015 11:06:53 +0100 From: Dirk Kirsten <dk(a)basex.org> To: pmenso57(a)comcast.net Hi Paul, no, not directly. You would have to update via your own update functions by using our validation module. You could invoke all updates through such functions, e.g. by using RESTXQ. BaseX itself is not schema-aware. Cheers, Dirk On 02/20/2015 03:33 AM, pmenso57(a)comcast.net wrote: > Hi all. > > Is it possible to enforce schema validation on update in BaseX? > > Regards, > Paul Mensonides > -- Dirk Kirsten, BaseX GmbH, http://basexgmbh.de |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

2 2

Lock issue while editing a .xql script over WebDAV
by Andreas Jung 20 Feb '15

20 Feb '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, the following bug occurs while re-editing a .xql script. - - start cadaver against the WebDAV port - - inside cadaver: edit some.xsql and save an empty file - - re-edit the same file again and this LOCK related issue pops up Cheers Andreas [qtp43256131-15] INFO com.bradmcevoy.http.HttpManager - PROPFIND :: http://localhost:8984/webdav/scripts/foo.xql - http://localhost:8984/webdav/scripts/foo.xql [qtp43256131-15] INFO com.bradmcevoy.http.HttpManager - PROPFIND :: http://localhost:8984/webdav/scripts/foo.xql - http://localhost:8984/webdav/scripts/foo.xql [qtp43256131-15] INFO com.bradmcevoy.http.HttpManager - OPTIONS :: http://localhost:8984/webdav/scripts/foo.xql - http://localhost:8984/webdav/scripts/foo.xql [qtp43256131-20] INFO com.bradmcevoy.http.HttpManager - LOCK :: http://localhost:8984/webdav/scripts/foo.xql - http://localhost:8984/webdav/scripts/foo.xql com.bradmcevoy.http.exceptions.BadRequestException [qtp43256131-20] ERROR com.bradmcevoy.http.StandardFilter - process java.lang.NullPointerException at com.bradmcevoy.http.webdav.LockHandler.processNewLock(LockHandler.java:234) at com.bradmcevoy.http.webdav.LockHandler.processExistingResource(LockHandler.java:110) at com.bradmcevoy.http.webdav.LockHandler.process(LockHandler.java:86) at com.bradmcevoy.http.StandardFilter.process(StandardFilter.java:52) at com.bradmcevoy.http.FilterChain.process(FilterChain.java:40) at com.bradmcevoy.http.HttpManager.process(HttpManager.java:228) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:43) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Unknown Source) -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJU4NDtAAoJEADcfz7u4AZjrYYLvA5ssGdFWLFhxjcH+h+2HzUd Q/GXKDuHoz1cpzBxYahaur2VbAuVysTWbb1Cr5PkOQMtXgqoNh0IbP/FDprk8VZW mqtpIVfPqSEhYtsxzr+5lo2iuppco+K5WOo16UV4+R2tRKi9yOtq5vwhp8mNOBZ1 Ottv6Q2iBON6G1DBg6qStNGBJWl1AD+HWEgvc6p0SKL8IWUnp+iaalowK00AFb6y Ie2xXZd/5iF9ukSKEs2TeSXyXF6Hx6dZqKRDUFjDZSdvIqcR4w3Z/3AQdseM3oh4 gdPMTM7HVen5mqX0DNookE4OPQY2yurNMHWrhAiHNdAisU0PkjdqZ9wjN2zl8rMy 7NnSiZwkCRL3Fk0SP2F8YrQTMFhZTUaJbIwOHclHIUZw/Jl6ULOJTQSVu34YCjBK cmwe7h9k2TBsq/LchHYLWwjtppoUNKmlMkbaKvH+7cSdwMumX7Vg2M5GApZ7xeYD 0ZjV2xXCil+Y4eyNE/Dwk+QKFO4rxp8= =rjkk -----END PGP SIGNATURE-----

2 3

Design pattern ...
by Marco Lettere 20 Feb '15

20 Feb '15

Hi all, I start from the following condition: - 2 dbs (let's say A and B) with around 200K documents each - every document in B refers to exactly one document in A (many to one is possible) - I have to apply a filter on every document of A and depending on the boolean outcome "move" the document to anoter db A'. - According to this the correlated documents of B need to be "moved" to a database B'. - The solution should be made automatic in the mid term What is the best design pattern and tool (I use the GUI by now) for this finding the right compromise for limiting "Out of memory (huge PUL)", "too much time", "complexity introduced by chunking" and "absence of a _db:move-document_ operation for moving one document in one single operation? Every suggestion is more then warmly welcome! Thanks and best regards, Marco

2 2

schema validation
by pmenso57＠comcast.net 20 Feb '15

20 Feb '15

Hi all. Is it possible to enforce schema validation on update in BaseX? Regards, Paul Mensonides

2 1

Performance on batch processes with http requests.
by France Baril 19 Feb '15

19 Feb '15

Hi, I have an item that I would like to bring to attention. We have developed a web controller to let users manages translation processes for BaseX content. Our process is something like this: - Users select content to translation (1 to 500 small files) + languages to translation to (1 to 32 selections). - For each language, for each files: - The system transforms the content to xliff and sets the segments to translate="yes" if they have changed since the last translation for this language. Content is saved because we'll need to query it, we redirect to the next task. - File without new segment to translate, content is processed and saved to the target languages (because attributes might have changed and/or segments might have been deleted). The xliff-file is deleted, we redirect to the next task because we'll need the new information for the next query. - We query the server to offer the users stats on items to translate. This is a simplification of the process, but it shows the logics. Redirects occur after each step for each language. We have grouped operations to limit commits/redirects to a minimum. We apply them: - After each language to avoid running out of memory. - Before each operation that needs to query files based on the changes from the previous steps. We have also split groups of tasks into smaller groups where too many tasks have led us to run out of memory in the past. Our request would be for a way to force changes to commit without having to redirect. Refreshing the browser has a big impact on performance. Or maybe you have suggestions to improve batch processing when using a web interface for process management. Thank you in advance for you input! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 4

Repo and development workflow
by Marc van Grootel 19 Feb '15

19 Feb '15

Hi, As part of the basex-gradle-starter scripts [1] I am now looking at how to deal with the repo. Until now I have always developed by putting modules under webapp. It allows to just edit a file and query away. I like to have the same workflow during development and take advantage of having modules not depend on a fixed import path. When working with the repo modules have to be installed first. Just copying them under the repo doesn't make basex aware of them. Of course I could arrange it so that I run a build task that does this via repo:install but that involves the extra step of copying files from the install location into the repo instead of just registering the files that are already in the repo location. I would like to have, for example, a 'src' directory with the repo module directory structure. Is there a way to say to basex that my repo lives in 'src' and that it auto registers what it finds there. Say a command like repo:register('dir') or maybe even an auto-register option. Once a module is already installed editing and saving is enough for basex to pick up the change. No issue there. Of course for production I probably want to compile the code to jar or xar in order to install it and share it. But during development I would like to be able to just have the code be picked up so that I can edit, save and query. I am not sure if what I'm asking is a feature or if I just have to do things differently. BTW one more thing I noticed. When I sometimes get into a situation where individual empty directories are also recognized as packages (but I cannot delete them from the GUI package manager). With repo:list() I then see something like this. <package name="org." type="Internal"/> <package name="org.basex." type="Internal"/> <package name="org.xokomola." type="Internal"/> <package name="org.xokomola.xq.Hello" type="Internal"/> [1] https://github.com/theapsgroup/basex-gradle-starter --Marc

2 8

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk