- BaseX-Talk - mailman.uni-konstanz.de

STORE Command
by Maximilian Gärber 19 Oct '15

19 Oct '15

Hi, any way to add multiple binary files at once? <store path="source/_img/">../source/_img/*.*</store> would be nice. Regards, Max

2 3

restxq multipart/mixed application/octet-stream
by Dolejsi Jiri 19 Oct '15

19 Oct '15

When i send multipart/mixed document with 2.part application/octet-stream with value 0xFF0xFF Into the following function, it writes into file character ?. I am using BaseX 8.3 declare %rest:path("test") %rest:PUT("{$doc}") function nib:insert-doc($doc as item()*) as empty-sequence() { let $data := $doc[2] return file:write-text("d:\abc.bin", $data) }; ________________________________ Odes?latel tohoto e-mailu informuje adres?ta, ?e ?TK vy?aduje k platnosti pr?vn?ho jedn?n? p?semnou formu s v?jimkou jedn?n? realizovan?ho prost?ednictv?m elektronick?ch syst?m? ?TK (Fotobanka, Videobanka, Protext, NewsMarket, Infobanka). D?le informuje adres?ta, ?e smlouva s ?TK nem??e b?t uzav?ena, pokud nen? v?slovn? shoda o v?ech jej?ch n?le?itostech. ?TK si vyhrazuje pr?vo ukon?it jedn?n? o uzav?en? smlouvy kdykoli, a to z jak?hokoliv d?vodu nebo i bez uveden? d?vodu. Obsahuje-li tento e-mail nab?dku, ?TK vylu?uje p?ijet? nab?dky s dodatkem ?i odchylkou. Pokud je tento mail kvitanc? ve smyslu ? 1949, odst. 1 z?k. ?. 89/2012 Sb., ?TK v?slovn? sd?luje, ?e kvitance o zaplacen? jak?koliv spl?tky dluhu neznamen?, ?e byla sou?asn? zaplacena jak?koliv ??st t?ho? dluhu splatn? d??ve, a kvitance o spl?tce jistiny neznamen?, ?e bylo zaplaceno tak? p??slu?enstv? pohled?vky.

2 1

xml-to-json vs json:serialize
by Marco Lettere 16 Oct '15

16 Oct '15

Hi all, I have a bit of difficulty in understanding the rationale behind the XML to Json (and vice-versa) conversions. I must admit I'm a bit confused on when to use which format and how those map to serialization/parsing rules. In particular I'm wondering whether it's really necessary to use both the formalisms (and functions) in the following example. My feelings are that using only the standard (?) XQuery 3.1 representation would be much clearer and would enable a cleaner service chaining mechanism. Has anyone 2 minutes left to explain to me the model behind this sort of things? I really appreciate your support! Regards, Marco. module namespace jt = "urn:json:test"; declare %rest:path("jsonsrv") %output:method("text") %output:media-type("application/json") function jt:service() { xml-to-json( <map xmlns="http://www.w3.org/2005/xpath-functions"> <string key="a">12345678</string> </map>) }; declare %rest:path("testreq") %output:method("text") %output:media-type("application/json") function jt:test() { let $response := http:send-request( <http:request href="http://localhost:9984/jsonsrv" method="POST"> <http:body media-type="application/x-www-form-urlencoded" method="text"/> </http:request>) return json:serialize($response[2]) };

4 6

Location for import modules
by Paul Swennenhuis 15 Oct '15

15 Oct '15

Hi, I installed BaseX 8.3 as Tomcat webapp on a Ubuntu server. Everything works fine, including the DBA interface (very much appreciated, thanks for that!) Except one thing: I can't get the import of XQuery modules right. When I import a module in a .xq file, like this: import module namespace lib="My Library" at "library.xq"; BaseX gives me a "[XQST0059] Could not retrieve module '/library.xq' " error. Earlier I installed BaseX on a EC2 instance at Amazon, and there I found that import modules had to be placed in /usr/share/tomcat7 to be found. But that directory does not exist on this server, and even when I create it and place library.xq there it is still not found. I tried placing library.xq in the RESTPATH directory, in the REPOPATH directory, in the home directory of BaseX, but all in vain. I only get it to work when I place library.xq in the root of the server. And that is obviously not something I want to do. Or, alternatively, when I place it in [some directory] and then change the import line to import module namespace lib="My Library" at "[some directory]/library.xq"; In other words, when I change the relative path to an absolute one. But I'd have to do that for all of my XQuery files (a lot!) and, worse, I'd have to change it again if I deploy the .xq files on another server. So, to summarize: in which directory/directories does BaseX try to locate import modules? And what would I have to do to change the default location(s)? Thanks in advance. Paul

2 4

Best way to upgrade from 8.2.3 to 8.3?
by Chuck Bearden 14 Oct '15

14 Oct '15

Hi all, Is there a recommended best way to upgrade the BaseX software while retaining the data? Perhaps to generate backups of the databases, then restore them to the new instance? I mostly run in standalone CL mode. Thanks, Chuck

2 3

Http: database creation
by meumapple 13 Oct '15

13 Oct '15

Hi, I have developed with RESTXQ a web application that compares texts (the user specifies the urls of two texts in a form and the computation is performed with their submission). It works but it is too slow if the texts are relatively long (before the actual comparison I pre-process the texts deleting and adding nodes via transform expressions). I am not sure what the cause is, but I was wondering whether everything would be faster if I created a database with the texts and then applied the queries. If so, how is it possible to a allow one click submission (via RESTXQ or REST) to create a DB and then open it and perform queries on it, since the database creation -if I am not wrong- cannot be associated with other operations within the same query? Thanks. J.

2 1

Strange behaviour running unit test suites
by Marc van Grootel 11 Oct '15

11 Oct '15

Hi, Just noticed this on 8.3 I have multiple unit test suites in a test folder. When I run `basex -t test` or `basex -t test/` all suites are run (no errors) But when I try to run hem with something like `basex -t test/*.xqm` the test runner stops after the first suite with the following message: Stopped at /Users/marcvangrootel/data/fold-webapp/webapp/origami/test/test-data.xqm, 6/8: [XPST0003] Library modules cannot be evaluated. Can anyone confirm this behaviour? --Marc

2 2

archive:extract-to out of memory
by Lizzi, Vincent 11 Oct '15

11 Oct '15

I've been using the new method archive:extract-to almost since it became available in BaseX, and it generally works very well. I've run into trouble with an out of memory error a few times trying to extract .zip files that are fairly large. For example, the .zip file I'm looking at now is 268 Mb. The out of memory error seems to actually be thrown on the file:read-binary method, which must be passed as input to archive:extract-to. Increasing the amount of memory available to BaseX by increasing -Xmx from 512 to 768 helps, but that doesn't seem like a good solution. For example, using the latest BaseX (BaseX831-20150929.165521.zip), a 268 Mb .zip file, a smaller 65 Mb .zip file, and the following code: declare namespace _ = "test"; declare function _:unzip1($zip as xs:anyURI) as xs:anyURI { let $tempDir := file:create-temp-dir('basex', 'unzip') return ( archive:extract-to($tempDir, file:read-binary($zip)), xs:anyURI($tempDir) ) }; declare function _:unzip2($zip as xs:anyURI) as xs:anyURI { let $tempDir := file:create-temp-dir('basex', 'unzip') return ( let $entries := zip:entries($zip) for $e in $entries//zip:entry let $path := string-join(($e/parent::zip:dir/@name, $e/@name), '/') return ( file:create-dir(file:parent($tempDir || $path)), file:write-binary($tempDir || $path, zip:binary-entry($zip, $path)) ), xs:anyURI($tempDir) ) }; declare function _:unzip3($zip as xs:anyURI) as xs:anyURI { let $tempDir := file:create-temp-dir('basex', 'unzip') return ( for $f in file:read-binary($zip) return archive:extract-to($tempDir, $f), xs:anyURI($tempDir) ) }; let $zip := xs:anyURI('C:\temp\bigfile.zip') let $unzipped := _:unzip2($zip) (: change this to test 1 2 3 :) return $unzipped When given a small .zip file _:unzip1, _:unzip2, and _:unzip3 extract all files from the .zip. _:unzip1 and _:unzip3 seem to complete in less time than _:unzip2. When given a large .zip file, _:unzip2 and _:unzip3 work but _:unzip1 produces an out of memory error. However, when I use the _:unzip1, _:unzip2 or _:unzip3 code in a larger program, which does some processing on the unzipped file, I still get an out of memory error and can see that not all files were extracted. Any help would be appreciated. Thanks, Vincent

2 1

Hitting index for multi-db query
by Marco Lettere 11 Oct '15

11 Oct '15

Hello all, I have to query all the databases on one server for docs matching a query. I do it with this query for example: db:list() ! db: open(.)/entry[@about='abc'] This query never hits the available attribute index. I could rewrite the query to something like db:list() ! attribute(., 'abc', 'about')/.. and in this case it takes advantage of the index of course. The problem is that I have to implement more queries which have much more generic predicate structures where I probably won't be able to use indexes explicitly. Is there any possibility to rewrite this query in order to use the indexes implicitly? Thanks, Marco.

2 3

Java from XQuery
by meumapple 09 Oct '15

09 Oct '15

Hi All, It is not clear to me if I can run from XQuery a .jar file (it is a simple linguistic parser). Any idea about that? Thanks. Joseph

3 7

ADD command
by Julien Charon 09 Oct '15

09 Oct '15

Hi, I have some trouble using the ADD command, but maybe I'm not understanding the command correctly. We have a java application that runs basex (7.7) embedded. I'm using the Add class/command to add an XML file to the database. After that, I'd like to delete that XML file from the local file system because I assume it has somehow be imported or copied to my database. However, from within my java application, I am not able to delete the file (File.delete() will always return false and the file won't be deleted). I tried the same thing with basex GUI: create a DB, add multiple files, delete those files (while DB is still open), do some queries (which works fine), close the DB, reopen it, do some queries again (which still works fine). Do I miss or misunderstand something? Do I need to release the XML file resource when using the java API? Any help would be appreciated. Mit freundlichen Grüßen / With kind regards, Julien Charon Avitech GmbH Engineering AxL Tel.: +49 (0)7541/282-177 Fax: +49 (0)7541/282-199 e-mail: julien.charon(a)avitech.aero<mailto:julien.charon@avitech.aero> ________________________________________________ Avitech GmbH Principal Office: Bahnhofplatz 1 | 88045 Friedrichshafen | Germany Court Registration: Amtsgericht Ulm | HRB 728293 Geschäftsführer/Managing Director: Antonio Maria Gonzalez Gorostiza http://avitech.aero<http://avitech.aero/> This message may contain confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system.

2 2

Origami presentation XML Amsterdam
by Marc van Grootel 04 Oct '15

04 Oct '15

Hi, Anyone on the list coming to Amsterdam the 6th of November? We may have some beers together. I will (finally) be presenting on the Origami templating library. I'm still working on it over on Github (in the unstable branch). After a pause in development it was almost completely rewritten. I intend to cut a new release just before the conference. Here's the anouncement I made for the conference website. XQuery 3.1 is still a candidate for recommendation by the W3C. Nevertheless there are already various implementations ready for use today. The introduction of maps and arrays, and the availability of functional weaponry such as fold and apply may change the way you write XQuery applications. You can still wield the trusty weapons of XPath and the FLWOR expression while, at the same time, adopting a more functional style of programming. Origami is an ongoing exploration of templating in XQuery and it makes heavy use of this functional style. It started with a quest for a more XSLT-like transformation capability and recently took a nice turn with the adoption of a flavor of micro-XML, with a heavy reliance on maps and arrays. Origami's unfolding design tries to honour principles of simplicity and composability. With Origami I aim to decomplect, or disentangle, several aspects common to templating problems and offer them in a powerful library using a couple of simple abstractions. With some practical code examples I will demonstrate how to use Origami to implement different templating styles. --Marc

2 1

BaseX 8.3 basexhttp - Class path contains multiple SLF4J bindings
by Neven Jovanović 03 Oct '15

03 Oct '15

Hello, in a fresh installation of BaseX 8.3, when running the basexhttp script (./bin/basexhttp -S from the basex directory) on Linux Mint Debian edition (Linux Mint LMDE 64-bit), I get the following error message: SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/home/neven/Downloads/basex/lib/slf4j-simple-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/home/neven/Downloads/basex/lib/slf4j-simple-1.7.12.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory] Connection failed (port: 8984). Previously the same system ran BaseX 8.2, and everything was fine. Reinstalling 8.2 also brings everything back to normal. Is this my local problem, or something else? Best, Neven Neven Jovanovic Zagreb, Croatia

2 1

about xi:include and xml:base
by Marco Randazzo 01 Oct '15

01 Oct '15

In my application I have a main xml file (general.xml) which includes several xml files (file1.xml, file2.xml...) using the xi:include tag. I successfully imported general.xml in basex using the gui: the xi:include directives were successfully processed, merging all data in a single database. I noticed in the result window that the database keeps track of the origin of the data, adding an xml:base info for each included block. I then performed some find and replace operation on the database, modifying some values which were originally belonging to different files. Now I want to export data to file. I successfully obtained a single xml file using the export command of the gui. The generated file still preserves the xml:base infos. However, I'd like to recreate the original structure, i.e. obtain multiple files, the same which were merged by xi:include directives at the beginning of the import process. I cannot find such an option in the export tab. Is it possible? Thank you for the help, MR

2 1

JSON serializer - slight bug
by Hans-Juergen Rennau 30 Sep '15

30 Sep '15

Dear BaseX, I think there is a very slight bug in the JSON serializer: when an element with type="object" has a <_> child, I think the serializer should report an error (as underscores must be doubled, if not using the name "_", reserved for array items. Instead, the serializer creates a property with the empty string as name. Example: json:serialize( <json type="object"> <BaseX type="object"> <_>is phantastic</_> </BaseX> </json> )=>{ "BaseX":{ "":"is phantastic" } } Compare with: json:serialize( <json type="object"> <BaseX type="object"> <__>is phantastic</__> </BaseX> </json> )=>{ "BaseX":{ "_":"is phantastic" } } It may look like pedantry, but this misbehaviour may cause confusion, as it is of course an interesting practise to create JSON by creating the XML format and in the end serializing: if then inspecting the end result, it is not immediately clear that the "":... is caused by the serializer, rather than by own code. Kind regards,Hans-Jürgen

2 2

crypto module with binary files
by Michel Banguerski 29 Sep '15

29 Sep '15

Greetings all, I would like to perform cryptographic operations with arbitrary binary files but am unable to figure how to convert the output of file:read-binary() to something that could be processed by crypto:hmac() for example. Can You give me a hint please? TIA Best regards Michel

2 1

Java access to JSON-to-XML transformation
by Hans-Juergen Rennau 29 Sep '15

29 Sep '15

Dear BaseX team, I have a question concerning the availability of the JSON-to-XML transformation. Before asking, this remark: I am very glad and grateful that BaseX offers this functionality (json:parse), as it exposes JSON to XPath, which enables important evaluations that otherwise would not even be attempted. And now my question. Is it possible - does it appear reasonable - to access the functionality within a Java application by calling the BaseX code (org.basex.build.json.JsonParser, I suppose)) immediately, without launching XQuery? I expect that one would be treading dangerous ground, relying on internal APIs which may change any time, not being meant for external use. If this is so, a brief confirmation would suffice to make me drop the idea. Thank you, and kind regards -Hans-Jürgen PS: Background of my question - I evaluate alternative possibilities how to validate JSON within Java applications. One (and probably the best) option is validating against JSON schema (json-schema.org), an alternative would be a to-XML transformation followed by XSD validation. A first experiment lettig BaseX via XQJ execute the epic query "json:parse(.)" revealed a performance which would not be sufficient to be competitive. So I wondered if removing the overhead of launching BaseX might be an approach to consider.

2 1

inspect:functions performance
by Andy Bunce 28 Sep '15

28 Sep '15

Hi, The following code runs (using v8.3) in about 1sec for me. import module namespace p="xquery-30" at " https://raw.githubusercontent.com/expkg-zone58/ex-xparse/master/src/main/co… "; p:parse-XQuery("2+2") Using inspect:functions let $f:= inspect:functions( " https://raw.githubusercontent.com/expkg-zone58/ex-xparse/master/src/main/co… ") [ local-name-from-QName(function-name(.)) = "parse-XQuery" and function-arity(.)=1] return $f("2+2") takes a very much longer time. Is this a bug? /Andy

2 4

Getting Line Number of Node in XML Doc
by ankit kumar 25 Sep '15

25 Sep '15

Hi, I just wanted to know , can basex provide line and column number of a element of a xml document loaded in BaseX database. Thanks, Anky.

2 2

BaseX 8.3: The Autumn Edition
by Christian Grün 23 Sep '15

23 Sep '15

Dear all, Summer is over, and a new version of BaseX is here! We are more than happy to present Version 8.3 of our XML database and XQuery 3.1 processor. This is what you get: SELECTIVE INDEXING - restrict value indexing to given elements and attributes - support extended to updatable and main-memory databases VALIDATION - support for RelaxNG validation (XML and compact syntax) - optional XML Schema 1.1 support - new function for creating validation reports XQUERY MODULES - Strings Module: Levenshtein, Soundex, Cologne Phonetic - updates in the Archive, Database, Admin and Process modules DBA - File panel: upload and download files BUG FIXES - automatic database optimization if node id turns negative - XQuery optimizations, performance tweaks, WebDAV issues You find the new release at http://basex.org. We are looking forward to your feedback, Christian BaseX Team

1 0

Enabling MIXUPDATES in basexhttp
by Wiemer, Sebastian 22 Sep '15

22 Sep '15

3 3

Outputting large output
by buddyonweb-software＠yahoo.com 21 Sep '15

21 Sep '15

I am using BaseX to transform some an XML documents into another XML layout.When the incoming document gets large, run out of memory. I've bumped up memory in the JVM and that worked. However, what if there was a really large document? Is there a way to redirect the outputso that instead of the results stored in memory they are sent to disk somewhere (whether to a fileon the file system or even back into BaseX - destination doesn't quite matter). Thanks.

2 4

Opening a database outside of the BaseX directory
by buddyonweb-software＠yahoo.com 21 Sep '15

21 Sep '15

OK, I've been working with BaseX for a little while with some great success. But I am now putting some 'glue' code together and I have a simple task that I am struggling with (believe it or not) Having an issue opening up a database (using just the BaseX jar file). I execute XQuery (inside Java program) and I try specifying the path to the database (e.g. /home/somedirectory/basex/data/MyDB). However whenever I use the full path to get the database, it can't find it. I execute the program locally (without the full path) and everything works just fine! I've tried using db:open() and collection(). Any advice - and sorry for such a simple question. I'm sure I am overlooking something both simple and silly. Thanks again

2 2

validate:rng compact
by Andy Bunce 21 Sep '15

21 Sep '15

Is there an issue with compact RelaxNG compact validation where the schema is supplied as a xs:string, containing the resource in its string representation [1]? let $rnc:="start = element book { page+ } page = element page { text }" return validate:rng(<book><page/></book>,*$rnc*,true()) Error: [FODC0002] Resource .../start = element book { page+ } page = element page { text }' does not exist. If the schema is not XML It looks like it is always treating it as a file path. /Andy [1] http://docs.basex.org/wiki/Validation_Module#RelaxNG_Validation

2 1

Fwd: Re : Basex Query Optimization Support
by Adi Babu 18 Sep '15

18 Sep '15

Dear Team, I am facing performance issue taking long time to execute the Xquery in Basex(Client Server architecture), can you please guide me to optimize the query performance. Below are the statistics & Basex server hardware specifications. Statistics : ------------- Total Records count : 6000000 Fetch count : 10000 Hits Parallel hits : 100 Time Taking : 750 seconds Architecture : Client Server Architecture Hardware Specifications of Basex Sever : ---------------------------------------------------------- Operating System : Red Hat Enterprise Linux 64bit OS Version : Linux 2.6.32 Hard Disk : 500 GB Memory Capacity : 16 GB Ram Processor Family : Intel (R) Xeon(R) CPU E5 -2680 V2 Processor Speed : 2.80 GHz Physical Processors : 8 Virtual Processors/cores : 4 Server Version : basex 7.9 Note : I have attached the sample xml data and Xquery . Thanks & Regards Adi

4 9

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk