- BaseX-Talk - mailman.uni-konstanz.de

Losing username/password info
by Charles Duffy 03 Apr '12

03 Apr '12

Howdy -- I have a number of different installed instances of BaseX (7.2 release, current snapshot, local build, etc), each with a .basex file pointing against the same DBPATH. I've frequently noticed when switching between trees that "admin" account switches back to its default password, and my more limited user accounts disappear and need to be recreated. Are these stored somewhere other than DBPATH?

2 3

Locking and long-running update operations
by Charles Duffy 03 Apr '12

03 Apr '12

I have a set of expensive cached data which requires about ~20 minutes to refresh/recalculate. However -- while this recalculation is running (via a single XQUF operation), read queries against the same database are unable to operate. My expectation is that the old, pre-update data will remain continually available until the update commits. If this expectation is incorrect, what is the suggested mechanism for running such expensive updates without impacting availability?

2 2

Problem with XQJ-Implementation (method XQResultSequence.getSequenceAsStream)
by Isidre Guixà 03 Apr '12

03 Apr '12

Hi I am experiencing the BaseX API XQJ and I compare to other XQJ NXD and I find the following problem. Suppose we have the next XML file in database "test": <?xml version="1.0" encoding="ISO-8859-1"?> <bookstore param="hao"> <book> <title>Book01</title> </book> <book> <title>Book02</title> </book> </bookstore> If I execute: XQDataSource xqs = ... XQConnection conn = xqs.getConnection(); XQExpression xqe = conn.createExpression(); String cad= "collection('test')//title"; XQResultSequence xqrs = xqe.executeQuery(cad); XMLStreamReader result = xqrs.getSequenceAsStream(); System.out.println("Iteration on XMLStreamReader..."); for(; result.hasNext(); result.next()) System.out.println(getEventString(result)); xqrs = xqe.executeQuery(cad); System.out.println("Using a Transformer..."); Source resultXML = new StAXSource(xqrs.getSequenceAsStream()); StreamResult resultSR = new StreamResult(System.out); TransformerFactory factory = TransformerFactory.newInstance(); Transformer tr = factory.newTransformer(); tr.setOutputProperty(OutputKeys.INDENT, "yes"); tr.setOutputProperty(OutputKeys.OMIT_XML_DECLARATION, "no"); tr.setOutputProperty("{http://xml.apache.org/xslt}indent-amount","2"); tr.transform(resultXML, resultSR); where static String getEventString(final XMLStreamReader reader) { switch(reader.getEventType()) { case XMLStreamConstants.START_ELEMENT: return "START_ELEMENT:\t\"" + reader.getLocalName() + "\""; case XMLStreamConstants.END_ELEMENT: return "END_ELEMENT:\t\"" + reader.getLocalName() + "\""; case XMLStreamConstants.START_DOCUMENT: return "START_DOCUMENT"; case XMLStreamConstants.END_DOCUMENT: return "END_DOCUMENT"; case XMLStreamConstants.CHARACTERS: return "CHARACTERS:\t\"" + reader.getText() + "\""; } return ""; } I get: Iteration on XMLStreamReader... START_ELEMENT: "title" CHARACTERS: "Book01" END_ELEMENT: "title" END_DOCUMENT START_ELEMENT: "title" CHARACTERS: "Book02" END_ELEMENT: "title" END_DOCUMENT Using a Transformer... <?xml version="1.0" encoding="UTF-8"?> <title>Book01</title> It's not good! When I use a Transformer I should get something similar to: <?xml version="1.0" encoding="UTF-8"?> <result> <title>Book01</title> <title>Book02</title> <result> That is, if result sequence length is greater than 1, getSequenceAsStream should wrap the sequence in a containing result element, so to not break JAXP Transformers and XMLStreamReader events. Is there any solution in BaseX ? Thanks a lot! Isidre Guixà

3 2

Concurrency problems with REST API
by Tobias Hofer 01 Apr '12

01 Apr '12

Hi, I'm using the REST API of BaseX 7.2 and run into concurrency problems. If I add new documents in parallel then the server will stop working after adding a few documents. My command template looks like: <?xml version="1.0" encoding="UTF-8"?> <command xmlns="http://basex.org/rest"><text><![CDATA[ ADD TO $KEY$ <node id="$KEY$" /> ]]></text></command> I call the REST API using curl: for ((i=0; i<10; i++)); do (cp tx-template tx$i; replace '$KEY$' $i -- tx$i; curl -i -X POST -H "Content-Type: application/xml" -T tx$i "admin:admin@localhost:8984/rest/QDEV") & done After four or less insert the following error occurs: HTTP/1.1 400 Bad Request Content-Type: text/plain; charset=utf-8 Content-Length: 2247 Server: Jetty(6.1.26) java.lang.NullPointerExceptionjava.lang.NullPointerExceptionjava.lang.NullPointerExceptionorg.xml.sax.SAXParseException: cvc-type.3.1.2: Element 'command' is a simple type, so it must have no element information item [children].org.xml.sax.SAXParseException: cvc-type.3.1.2: Element 'command' is a simple type, so it must have no element information item [children].Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.2 Java: Sun Microsystems Inc., 1.6.0_26 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException org.basex.core.cmd.Add.run(Add.java:92) org.basex.core.Command.run(Command.java:345) org.basex.core.Command.exec(Command.java:324) org.basex.core.Command.execute(Command.java:76) org.basex.server.LocalSession.execute(LocalSession.java:134) org.basex.server.LocalSession.execute(LocalSession.java:126) org.basex.server.Session.execute(Session.java:51) org.basex.http.rest.RESTCommand.run(RESTCommand.java:40) org.basex.http.rest.RESTPost.run(RESTPost.java:129) org.basex.http.rest.RESTServlet.run(RESTServlet.java:14) org.basex.http.BaseXServlet.service(BaseXServlet.java:38) javax.servlet.http.HttpServlet.service(HttpServlet.java:820) org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:401) org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) org.mortbay.jetty.handler.HandlerList.handle(HandlerList.java:49) org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) org.mortbay.jetty.Server.handle(Server.java:326) org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) Now, the server cannot be accessed any more. Any further call will return "Database 'MYDB' is currently opened by another client. A restart helps. The error does not happen if the commands are executed in sequence. Please help. Regards, Tobias Hofer

2 1

possible bug? or opportunity for documentation enhancement? [2d sending]
by C. M. Sperberg-McQueen 01 Apr '12

01 Apr '12

[2d posting - this time with the promised attachment] I got some error messages today which seem to indicate a problem, either in BaseX or in (my understanding of) the documentation. Since the error messages (in the attached log) suggest contacting you about it, I am doing so. The document at http://www.w3.org/TR/xsd-unicode-blocknames/ includes a table of Unicode block names created by querying a database consisting of XML representations of the various versions of the Unicode Database. Today I noticed that a new version of the Unicode Database was issued in January, and so I downloaded the XML data and added the document to my existing BaseX database of Unicode information. The command seemed to run successfully, but when I ran my old query, I got an error message saying "Data access out of bounds". I installed version 7.2 then, which gave the same error message. Rebuilding the database from scratch allowed me to run the query without any problems, so I don't actually have a problem at the moment. But I'm sending this problem report in the hopes that it may help you diagnose either a problem with dynamic adds to a database or perhaps a problem with the server command language documentation (it's entirely possible that I did something wrong when adding the new document to the database). If there is any information I can provide that would be helpful, please let me know. best, Michael Sperberg-McQueen -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

possible bug? or opportunity for documentation enhancement?
by C. M. Sperberg-McQueen 30 Mar '12

30 Mar '12

I got some error messages today which seem to indicate a problem, either in BaseX or in (my understanding of) the documentation. Since the error messages (in the attached log) suggest contacting you about it, I am doing so. The document at http://www.w3.org/TR/xsd-unicode-blocknames/ includes a table of Unicode block names created by querying a database consisting of XML representations of the various versions of the Unicode Database. Today I noticed that a new version of the Unicode Database was issued in January, and so I downloaded the XML data and added the document to my existing BaseX database of Unicode information. The command seemed to run successfully, but when I ran my old query, I got an error message saying "Data access out of bounds". I installed version 7.2 then, which gave the same error message. Rebuilding the database from scratch allowed me to run the query without any problems, so I don't actually have a problem at the moment. But I'm sending this problem report in the hopes that it may help you diagnose either a problem with dynamic adds to a database or perhaps a problem with the server command language documentation (it's entirely possible that I did something wrong when adding the new document to the database). If there is any information I can provide that would be helpful, please let me know. best, Michael Sperberg-McQueen -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

1 0

Module import times and caching
by Charles Duffy 30 Mar '12

30 Mar '12

import module namespace reporting="http://dyfis.net/reporting"; 1+1 Timing: - Parsing: 4.33 ms - Compiling: 4205.89 ms <<< (!) - Evaluating: 7.55 ms - Printing: 6.39 ms - Total Time: 4224.18 ms ...after some analysis and optimization this is down to ~115ms, but that's still a fairly high floor for query execution time of anything using this module (which almost everything I write does). Said module includes several lines of the form declare variable $reporting:foo_db := db:open("foo", "db") ...and a lot of function declarations, some of which are fairly complex. Have there been thoughts to a module cache, even if enabled only via pragma? It would be nice to be able to reuse the optimizer's results and variable definitions (even if we completely expired the cache on writes to any database referenced during the module's compilation phase).

1 0

Java interop - Unexpected FORG0006 ("Invalid arguments")
by Charles Duffy 30 Mar '12

30 Mar '12

Howdy -- I have a thin wrapper around the 3rd-party svnkit library. At present, it provides two functions: module namespace svnkit = "http://dyfis.net/svnkit-wrapper"; declare namespace j="java:net.dyfis.svnkit_wrapper.SvnWrapper"; declare function svnkit:cat($path as xs:string) as xs:string { j:cat($path) }; declare function svnkit:cat($path as xs:string, $rev as xs:integer) as xs:string { j:cat($path, $rev) }; SvnWrapper (written in Clojure) provides both versions of cat as static methods: (ns net.dyfis.svnkit-wrapper.core (:gen-class :name net.dyfis.svnkit_wrapper.SvnWrapper :methods [#^{:static true} [cat [java.lang.String] java.lang.String] #^{:static true} [cat [java.lang.String int] java.lang.String]])) svnkit:cat($path) works fine. svnkit:cat($path, $revno) results in the following: [FORG0006] Invalid arguments: SvnWrapper.cat(xs:string, xs:integer) found. SvnWrapper.cat(xs:string, xs:integer) is exactly what I *expect* it to find, so the error doesn't make a great deal of sense to me. Any hints?

2 3

BaseX XQuery vs. python / lxml performance
by Ronny Möbius 30 Mar '12

30 Mar '12

Hi, we use now for a couple of years XML files for organizing the schedule of lectures in our institute. The amount data for one semester is about one megabyte. For presenting the schedule on the web we use currently python in combination with the C-based lxml XPath implementation. Only basic selecting nodes happens on the layer of lxml, but the most of intelligence is implemented in filtering python lists and lists of dictionaries. We read the xml data from hard disk and parse them into lxml objects. >From time to time we thought about storing the data in a XML database as this seems intuitive. One main point is, that we need some sort of transaction management, because different applications may manipulate the files simultaneously. Now I gave BaseX a try and implemented one basic output of our online schedule in XQuery. Soon I noticed, that all of the intelligence should be managed inside XQuery as it should return the full-prepared html for presenting online. Unfortunately we now have the impression, that we did not gain speed - to the contrary the query itself needs more execution time than the whole corresponding ready interface (including the user interface etc.) I'm now interested in your general opinion about this: Is it surprising, that the XQuery implementation than the lxml/python one (For me it is, as I thought the indices etc. created when importing the data should decrease computational affords in searching the tree)? Is there some catch in my approach? May the reason be bad designing the query? I would appreciate to hear from you, Ronny

5 7

Updates failing due to "opened by another client" on a system running only basexhttp
by Charles Duffy 30 Mar '12

30 Mar '12

Howdy -- I recently had an update run via the REST interface fail due to the database being "opened by another client". This would be unsurprising were it taking place on a workstation where a concurrent process such as basexgui might have been running, but the host in question was a server, with its basexhttp instance controlled by system init scripts, running as a dedicated user, and otherwise unlikely to be interfered with by a separate process. There are, however, multiple concurrent REST clients using that same HTTP server. As basexhttp should be the only service directly accessing the underlying database on this host, this surprises me -- my expectation is that the transaction monitor would defer any execution of an update until a full lock could be grabbed, preventing it from interfering with other read or update actions happening within the same process. Is this expectation valid? If not, what do I need to do to be able to apply updates to a database with minimal disruption to readers?

4 5

Declarations for external variables not enforced
by Charles Duffy 30 Mar '12

30 Mar '12

Howdy -- Using the REST interface, I'm currently able to do the following: <rest:query xmlns:rest="http://basex.org/rest"> <rest:text>$foo</rest:text> <rest:variable name="foo" value="bar"/> </rest:query> ...and get back "bar" as a result. Note the lack of a "declare variable $foo external" line. I haven't read the spec to determine permissibility of this behavior, but it does come in handy at times (particularly, for permitting maximally terse one-liners). Is this something likely to go away in the future? Thanks!

4 3

Out-of-band logging from XQuery functions
by Charles Duffy 29 Mar '12

29 Mar '12

Howdy -- Is any mechanism available for queries to log errors out-of-band without modifying their return values? Something like a wrapper around log4j would be perfect; right now I'm using file:append(), but as this requires my queries to know where the system administrator wants things to be logged to (which should be an entirely separate concern), it's very far from ideal.

2 2

wie geht es dir$
by areaurbana 29 Mar '12

29 Mar '12

1 0

Using stemming via the BaseX API
by Michael Wilson 27 Mar '12

27 Mar '12

I’m working on a hobbyist project of mine, and am having trouble with stemming when running queries from a java app (I’m using the BaseX API to search XML japanese dictionary files via a custom swing/GUI application). Specifically, I receive the error message: “[FTST0009] No tokenizer available for language 'Japanese'.” I do have the etc/ja folder present. This problem does not occur when I run the same query from the BaseX GUI. I replicated the same class path I observed in the basexgui.bat file: I added basex.jar, igo-0.4.3.jar, lucene-stemmers.3.4.0.jar, xml-resolvers-1.2.jar, tagsoup-1.2.jar to the Path environment variable, but it didn’t help. Does anyone have any ideas on how I can make stemming work from my application? I appreciate any insights or solutions.

3 2

CSV, text equivalents to json:parse() and parse-xml()?
by Charles Duffy 27 Mar '12

27 Mar '12

Howdy -- For JSON and XML, mechanisms to generate an in-memory document from an xs:string() exist. For CSV or text inputs, however, I'm unclear on how to do this without declaring options and invoking db:add() -- not ideal when the content being handled is intended only for transient, one-time-only processing. Pointers? (If there exists a mechanism to invoke any available parser without necessarily creating a new database, this would be ideal). Thanks!

2 1

Mechanism to serialize maps in output?
by Charles Duffy 27 Mar '12

27 Mar '12

Howdy -- Right now, trying to inspect a map (ie. returning one from a query) results in FOTY0012. This is unfortunate from the perspective of allowing users to examine the objects their logic creates. Has thought been given to defining a serialization-friendly way of representing maps, perhaps as XML entities under their own namespace?

4 3

Usin Basex for Desktop Application
by Sandeep Yohans 27 Mar '12

27 Mar '12

Hello Sir/Madam, I am interested in using BaseX for my Desktop Application which I am developing using Java SE. Is it possible to use BaseX in a Desktop Application (Standalone Application) which will be installed on a computer with no internet connection or intranet? Looking forward to hear from you. -- Sandeep Yohans Developer AIR Infotech Nagpur - India www.airinfotech.in

2 1

How I can use Basex as embedded python datastorage?
by Andrey Ganyushkin 26 Mar '12

26 Mar '12

Hi All How I can use Basex as embedded python datastorage? It's possible? I can't find the answer to this question. -- BEST REGARDS, Andrey Ganyushkin

3 4

BaseX has been updated on Filecluster.com
by FileCluster Support 24 Mar '12

24 Mar '12

Dear Developer, You have received this email because we have updated BaseX and this was the contact email for the application. Your application update status BaseX has been updated on FileCluster.com to the 7.2.1-SNAPSHOT version. You can check out your application on our site at: http://www.filecluster.com/Business-Office/Database-Management/Download-Bas… If you want to let your users know about your software page on FileCluster.com, to rate it and review it, you can also use this banner to link it: Promote your software As a software website, it`s our duty to help the developers promote their software. Fortunatelly, our software promotions are cost free, for more informations please visit our promotion page. Submit your press releases We are also accepting press releases from software developers. All you have to do is to submit your press release and we will take care of the rest. Useful developer links All the essential links you need as a developer on FileCluster.com: Link to us - download banners or text links for linking to FileCluster.com Submit your software - Submit your software via PAD or manually Submit your press release - submit your press releases using our online form Contact Us - contact our editors Promote your software - our promotions page If you do not wish to receive any further notifications or confirmations from FileCluster.com, please send us an email and request a contact removal (email removal). Keep in mind that this means you will not receive ANY contact from us, including: software promotions, update confirmations or security alerts (antivirus and spyware test results). Regards, Renta Cezar - Senior Editor FileCluster Labs www.filecluster.com

1 0

BaseX 7.2: The EDBT Release
by Christian Grün 24 Mar '12

24 Mar '12

Dear subscribers, after some busy weeks, we are glad to announce BaseX 7.2, the EDBT Release! The latest version offers the following new features: * support for the new RESTXQ API for building XQuery web services [1] * improved support for running BaseX as web application [2] * XQuery: higher order functions added to speed up Top-K queries [3] * proxy server settings added [4] * advanced TagSoup options added for importing HTML files [5] * XQuery: faster traversal of full-text index entries via ft:tokens() [6] * Command-line: embedded readline and history support via JLine [7] * XQuery 3.0: annotation added, updated EQName syntax (Q{uri}name) * opened databases are now pinned OS-wide to reduce write conflicts * HTML5 serialization of query results * a printable version of our Wiki documentation As usual, more infos can be found on our homepage [8]. All your feedback is welcome. If you will be attending the EDBT Conference next week, we are looking forward to seeing you there, Christian, BaseX Team 2012 [1] http://docs.basex.org/wiki/RESTXQ [2] http://docs.basex.org/wiki/Web_Application [3] http://docs.basex.org/wiki/Higher-Order_Functions_Module#hof:top-k-by [4] http://docs.basex.org/wiki/Options#PROXYHOST [5] http://docs.basex.org/wiki/Parsers#Options [6] http://docs.basex.org/wiki/Full-Text_Module#ft:tokens [7] http://jline.sourceforge.net/ [8] http://basex.org/

2 1

BaseX Antivirus Scan Report on FileCluster.com
by FileCluster Security 23 Mar '12

23 Mar '12

Dear Developer,BaseX has been downloaded and tested by Filecluster Labs on 23 Mar 2012 with today's best antivirus engines: BitDefender Antivirus, Kaspersky Antivirus, NOD32 and Avira Antivirus. The report shows that BaseX has been found clean of any viruses or malware and has been flagged as safe to install. You can find the detailed antivirus scan reports at this page: http://www.filecluster.com/Antivirus-Report/BaseX.html. (if the page isn't working, please allow between 5-30 mins for the cache to refresh) Please keep in mind that we will constantly scan your software with each version update or on-demand, if necessary. We have also displayed a clean award within FileCluster to assure our visitors that BaseX is clean and safe to install.If you feel that this report could add value to your visitors as well, you can use any of the banners presented within the report page. Future development of this feature will depend on feedback, so any suggestions or general feedback are greatly appreciated. Also, mentioning this report onto your blog, news page or press releases is highly appreciated, encouraging us to improve the scanner and extend it even further. If you wish to unsubscribe from receiving such notifications, please contact us via email and let us know. Keep in mind that by unsubscribing, you will never receive any emails from FileCluster again, such as promotions, security reports, community feedback and so on. Don't hesitate to contact us for any issues regarding our security service. Best Regards, Jamie P. - FileCluster Security www.filecluster.com

1 0

Java functions, packages, and ADMIN privileges
by Charles Duffy 22 Mar '12

22 Mar '12

Howdy -- The ability to call arbitrary Java code from XQuery being accessible only to users with ADMIN privileges is generally sensible for obvious reasons. However, it would be useful for users with ADMIN privileges to be able to install packages in such a way as to make classes contained therein accessible to less-privileged users. Does such a mechanism already exist? If not, thoughts on feasibility?

2 3

webdav issue using oxygen
by Maximilian Gärber 22 Mar '12

22 Mar '12

Hi, following the steps on http://docs.basex.org/wiki/Integrating_oXygen for accessing resources via webdav, I guess it should be possible to change and save xml files. Doing so, actually empties the db and adds a "RAW" xml resource to it. This happens with the latest Snapshot (7.2). Any other Oxygen users out there? Regards, Max

2 1

Ask about BaseX event for more than one context
by truc.cam＠emotive.de 22 Mar '12

22 Mar '12

Dear BaseX team, Please see the attachment. When I use events for 2 contexts, just the first one can notify.If the notification of the 2rd context happens, the result should be "1 2 3 4". If I replace "xquery2.execute(context2)" by "xquery2.execute(context1)", I will receive right result. But this is not what I want to do. Thanks in advance. Best regards

2 1

REST API now returning exceptions as HTML?
by Charles Duffy 21 Mar '12

21 Mar '12

Howdy -- Historically, the BaseX REST API has handled exceptions by returning only the exception content itself. I just ran a build against current SVN, and received the following: <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/> <title>Error 400 Stopped at line 1, column 75: [XPST0017] Unknown Java function 'net.dyfis.svnkit_wrapper.SvnWrapper.cat(...)'.</title> </head> <body><h2>HTTP ERROR 400</h2> Problem accessing /rest. Reason: <pre> Stopped at line 1, column 75: [XPST0017] Unknown Java function 'net.dyfis.svnkit_wrapper.SvnWrapper.cat(...)'.</pre><hr />Powered by Jetty:// </body> </html> Is this now desired/documented/ongoing behavior?

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk