- BaseX-Talk - mailman.uni-konstanz.de

Setting modification timestamp (for content migrated over WebDAV) over REST?
by Andreas Jung 03 Jan '19

03 Jan '19

As part of a migration we move data into BaseX over WebDAV. It would be neat if we could preserver the original timestamp. I am aware that it is not possible to set the timestamp over WebDAV. Would it be possible to set the modified timestamp for particular resource over the resource API or is this timestamp tied to storage internals of BaseX? Andreas

2 1

XQuery from Java
by thufir 03 Jan '19

03 Jan '19

I'm a tad more proficient with BaseX, but, how do I actually build an XQuery? Yes, I can write an XQuery and save it in a text file, then use BaseX for execution. But it would be far more flexible to write the actual XQuery from within Java itself. But how? Oracle gives an example: OXQDataSource ds = new OXQDataSource(); XQConnection con = ds.getConnection(); String query = "<hello-world>{1 + 1}</hello-world>"; XQPreparedExpression expr = con.prepareExpression(query); XQSequence result = expr.executeQuery(); using their datasource. Cannot BaseX do something similar? see also: https://stackoverflow.com/q/53996575/262852 thanks, Thufir

2 1

upper limits on storage; database admin
by thufir 03 Jan '19

03 Jan '19

What are the upper bounds to basex in size? Assuming it's just text xml, gigabytes is quite a bit to my thinking. At a certain, it's "big data" -- but how do you know when you're approaching that point? Or, is the bottleneck more read/write and consistency problems? What little I know of RDBMS is that master/slave can alleviate some bottlenecks. To put this another way: I'm so enthusiastic about basex that I'm having trouble finding a place it doesn't fit. As you approach terabytes and beyond what dbadmin approaches are employed? -Thufir

2 1

Bulk import (moving from eXist to BaseX)
by Andreas Jung 03 Jan '19

03 Jan '19

Hi there, consider moving my XML stuff for a particular project from eXist to BaseX. I have a full dump from eXist with all related content and I want to import it 1:1 into BaseX…is there a bulk loader or what is the preferred way to import an existing folder structure? Of course I can create my own script what would import the data through WebDAV but the dump has about 50.000 files. Andreas

3 4

console usage
by thufir 02 Jan '19

02 Jan '19

How can I run this script? thufir@dur:~/basex$ thufir@dur:~/basex$ basex [warning] /usr/bin/basex: Unable to locate /usr/share/java/jing.jar in /usr/share/java BaseX 9.0.1 [Standalone] Try 'help' to get more information. > > RUN fetch.note.text.xq Resource "/home/thufir/fetch.note.text.xq" not found. > > exit Have fun. thufir@dur:~/basex$ thufir@dur:~/basex$ cat fetch.note.text.xq fetch:xml("https://www.w3schools.com/xml/note.xml", map { 'chop': true() }) thufir@dur:~/basex$ The script seems to work fine from the GUI. thanks, Thufir

2 4

JSON serialization/compatibility with exist-db JSON?
by Andreas Jung 02 Jan '19

02 Jan '19

Hi there, I have an issue with the migration of an XQuery script from eXist to Basex: The link https://gist.github.com/zopyx/467a01264d53bdaa48ad27cd553cfda8 shows the script and the expected (status quo) output for XML and JSON. Calling the script using /rest/foo/?run=foo.xql&method=json generates an HTTP response with Content-Type: application/json;charset=utf-8 but the output is a quoted XML string like: "<item><uri>\/foo\/de\/ayapedia\/addendums\/ernaehrung_9861fc6a-ba68-11e8-a8a1-001c4210b7a0\/current-20180920-111838.bak\/xml\/index.xml<\/uri><title>Ernährung<\/title><description\/><language>de<\/language><status>current<\/status><area>ayapedia<\/area><path\/><date>2018-09<\/date><url\/><atc_code\/><guideline_id>bef53078-2d8d-42d1-af8c-b3d387dfa52e<\/guideline_id><plone_uuid>464520ec154a42839b9f5d2635caccaf<\/plone_uuid><old_authors_additional\/><authors_additional>für den Arbeitskreis Ernährung, Stoffwechsel und Bewegung der DGHO<\/authors_additional><documenttype>ayapedia<\/documenttype><societies xmlns:json=\"http:\/\/basex.org\/modules\/json\" json:array=\"true\">dgho<\/societies><guideline_topics xmlns:json=\"http:\/\/basex.org\/modules\/json\" json:array=\"true\">183<\/guideline_topics><authors xmlns:json=\"http:\/\/ basex.org\/modules\/json\" json:array=\"true\">9211<\/authors><authors xmlns:json=\"http:\/\/basex.org\/modules\/json\" json:array=\"true\">5577<\/authors><authors xmlns:json=\"http:\/\/basex.org\/modules\/json\" json:array=\"true\">13728<\/authors><authors xmlns:json=\"http:\/\/basex.org\/modules\/json\" json:array=\"true\">373215<\/authors><\/item>" Calling /rest/foo/?run=foo.xql&method=json&json=format=jsonml" finally generates JSON but not in the related format. Isn't the JSON serialization supposed being standardized and compatible? Or how can I generate a JSON result that is compatible with the existing JSON response from eXist-dB? Andreas

2 1

Scaling and Jsoniq
by Ben Pracht 02 Jan '19

02 Jan '19

Hi, I'm sorry if this was covered earlier, but I haven't seen it in a Google search. First, are there any support plans for scaling outwards? I know MarkLogic has splits clusters into multiple enodes and dnodes. But the idea is that there isn't one central bottleneck for requests. Second, I read about Jsoniq and was intrigued by it. It seemed like it supported JSON without requiring an XML intermediary. Having good JSON support would really help with frameworks like Angular or React. I really love Basex overall though and think it's underrated for what it can do. Regards, Ben

4 3

basic xquery
by thufir 02 Jan '19

02 Jan '19

How can I run this xquery: fetch:xml("http://books.toscrape.com/", map { 'parser': 'html', 'htmlparser': map { 'html': false(), 'nodefaults': true() } }) from basex using Java? I can run that xquery from the GUI. thanks, Thufir

2 1

update:output() update:cache()
by Dieter Zanzinger 02 Jan '19

02 Jan '19

I do not exactly understand, for which purpose update:output() is meant. Does anybody have an example, where one can see, how it works? (There is no example in the docs.) (I am searching for a way, to run a update-expression on a database and give the altered nodes as result back to the restq-user in one query. The update:output() or update:cache() - expression sounded like they do something similar… At present, i am helping me with a copy/modify/return-solution and am giving back the altered result, before I actually write back the result-node of the previous to the db. But I am searching for a more intuitive way to get this result). Sincerly Dieter

2 1

Serving Static Content from Tomcat
by Shaun Flynn 01 Jan '19

01 Jan '19

Hello there, I am using BaseX 9.1.1 inside a Tomcat server trying to build a webapp using RESTXQ. I have studied the DBA xqm files, and see that there is static content delivered to the generated login page, located in dba/static folder. When I try to replicate this in my app, I get 404 errors saying the resource can not be found in the Developer Tools of Opera. Below is my .xqm file. The resources in question are in bold and underlined. What am I doing wrong? module namespace scheduleGui = "www.tt.co.uk/schedule"; import module namespace path = "www.tt.co.uk/path" at "DFSPath.xqm"; (: Produces a simple HTML form for entering origin and destination to produce a path :) declare %output:method("html") %rest:path("/rail/a2b") function scheduleGui:welcome() { <html> <head> * <script type="text/javascript" src="static/jQuery3.1.1.js"></script>* * <script type="text/javascript" src="static/simplePost.js"></script>* </head> <body> <h1>Paths</h1> <table> <tr> <td> Origin </td> <td> <input type="text" id="origin" value="" size="8" /> </td> </tr> <tr> <td> Destination </td> <td> <input type="text" id="destination" value="" size="8" /> </td> </tr> <tr> <td> </td> <td> <input type="submit" value="Go!" id="findPath" /> </td> </tr> </table> <div id="displayArea"> </div> </body> </html> }; declare %rest:POST %rest:form-param("origin","{$origin}", "") %rest:form-param("destination","{$destination}", "") %output:method("html") %rest:path("/rail/a2bp") function scheduleGui:a2b($origin, $destination) { if($origin != "") then (<p> Find path from {$origin} to {$destination} </p>), <ul> { for $path in path:DFSSpec($origin, $destination, "up") return <li>{$path}</li> } </ul> };

1 1

Re: [basex-talk] 9.1.1: Relative path resolution fails with non-ascii characters
by Christian Grün 21 Dec '18

21 Dec '18

Hi Alex (cc to the list), This might be an OS-specific problem (I tried to reproduce the problem with Windows and Ubuntu, but I didn’t succeed). Which operating system are you using, and what’s the default encoding of your file system? > '../xqm/path:frequently used paths.xqm'; This is actually an invalid path in XQuery, as spaces should be encoded via %20. BaseX accepts it anyway, at least in version 9 (we might change that in future). Maybe you’ll generally encounter less issues if you use standard URI characters in your file paths. But as soon as I’ll manage to reproduce the encoding problem you encountered, I’ll be happy to have a closer look at it. Feel free to provide me with a minimal step-by-step procedure; maybe I missed something. Saludos, Christian On Fri, Dec 21, 2018 at 5:28 AM Alex R. Loayza <arx.inbox(a)gmail.com> wrote: > Hello Christian, > > I have encountered an issue in BaseX 9.1.1 after migrating from 8.5.3. It > seems to be a character encoding problem. > > In many queries, I import a module with a relative path: > > import module namespace path = 'http://myns' at '../xqm/path:frequently > used paths.xqm'; > > While this worked fine in 8.5.3, in 9.1.1 I get the following error > message: > > If I substitute the absolute path to the module for the relative path, > > import module namespace path = 'http://myns' at > '/home/arx/devWorks/otherProjects/almacén/procRep/xqy/xqm/path:frequently > used paths.xqm'; > > ...the import again succeeds. This tells me that the code resolving the > relative path in 9.1.1 is having problems with non-ascii characters: the > *é* in this case, which is changed to *?* in the resolved path. > > I see no way to fix this myself. Is this is a bug, or is there some > workaround? > > Cheers, > > Alex > > > --------------------------- > From: Christian Grün <christian.gruen(a)gmail.com> > <christian.gruen(a)gmail.com> > To:Alex R. Loayza > Cc:BaseX > Dec 20 at 3:36 AM > Hi Alex, > > All changes in the 9.0 storage layout are backward compatible. If you > update your database, it will be optimized incrementally. > > Breaking changes in BaseX will be documented explicitly. For example, if > you have written a lot of XQuery code, you may need to update some > BaseX-specific function calls. You will find those changes in the docs by > searching for "9.0" or "9.1". > > Hope this helps, > Christian >

1 0

possible basex 9.1.1 bug in java binding exception handling
by Mark McSweeny 21 Dec '18

21 Dec '18

Hello, I am seeing a possible bug during exception-handling while using Java binding in BaseX version 9.1.1. The problem can be illustrated by the following minimal working example query: Q{java.lang.String}new*java.lang.String(()) This is equivalent to the Java expression "new String(null)". "null" is not valid for this constructor so an exception is thrown. In version 9.1, I see the expected error: [XPTY0004] String.new(empty-sequence()): java.lang.NullPointerException. In version 9.1.1, I get message suggesting a potential bug along with a full stack trace: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk@... Version: BaseX 9.1.1 Java: Oracle Corporation, 1.8.0_92 OS: Windows 10, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.Util.className(Util.java:70) at org.basex.query.func.java.JavaEval.type(JavaEval.java:203) at org.basex.query.func.java.JavaEval.types(JavaEval.java:188) at org.basex.query.func.java.JavaEval.execError(JavaEval.java:149) at org.basex.query.func.java.DynJavaConstr.eval(DynJavaConstr.java:78) at org.basex.query.func.java.JavaCall.value(JavaCall.java:70) at org.basex.query.func.java.JavaCall.iter(JavaCall.java:63) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:335) at org.basex.query.QueryContext.cache(QueryContext.java:613) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:112) at org.basex.core.cmd.AQuery.query(AQuery.java:103) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:429) at org.basex.gui.GUI.lambda$4(GUI.java:372) at java.lang.Thread.run(Thread.java:745) The stack trace suggests that the error is occurring while the system is assembling the error message. It generates a string describing the Java arguments: https://github.com/BaseXdb/basex/blob/9.1.1/basex-core/src/main/java/org/ba… ... but when it tries to determine the type of "null": https://github.com/BaseXdb/basex/blob/9.1.1/basex-core/src/main/java/org/ba… ... it incurs a NullPointerException while calling "null.getClass()": https://github.com/BaseXdb/basex/blob/9.1.1/basex-core/src/main/java/org/ba… I hope this report is helpful. Take care, Mark Mark McSweeny Development Team Lead t: 403-648-4602 + 4602 e: mark.mcsweeny(a)aucerna.com Learn more about Aucerna www.3esi-enersight.com/blog/palantir-solutions Confidentiality Notice: The information transmitted herein may contain confidential, proprietary and/or privileged material which belongs to Aucerna and is only for the intended addressee(s). Any unauthorized review, distribution or other use of this information is prohibited. Finally, the recipient should check this email and any attachments for the presence of viruses. The organization accepts no liability for any damage caused by any virus transmitted by this email. If you received this email in error, please contact us at (403) 270-3270 or by return email and delete this email and any copies immediately. v&7.11.1989&$

2 1

Re: [basex-talk] possible basex 9.1.1 bug in java binding exception handling
by Mark McSweeny 20 Dec '18

20 Dec '18

The character in the example query between "new" and "java" was meant to be the "middle dot character" (&#xB7), not an asterisk: Trying again... and hoping it gets through the various mailers :) Q{java.lang.String}new·java.lang.String(())

1 0

Migrating Data
by Alex R. Loayza 20 Dec '18

20 Dec '18

Hello, I want to upgrade from 8.5.3 to 9.1.1, but I'm unsure if the data format is compatible. In the changelog for 9.0, I find that regarding storage there has been the following change: "Improved database compression (short strings, whitespaces)" Does this mean that the old data format is incompatible? If so, how to migrate the data? Is there some documentation page detailing compatibility of data formats across BaseX versions? I'm been unable to find it. An upgrade guide would be a welcome addition to the docs! Best regards, Alex

2 1

BaseX/GUI using all memory
by Rick Graham 17 Dec '18

17 Dec '18

Greetings, First of all, thank you very much for BaseX. It has made many of my assignments this semester doable, more enjoyable, and better. Using it, I could demonstrate database features at scale where only toy minimal examples were required. The source of most of my data has been NIST's National Vulnerability Database <https://nvd.nist.gov/vuln/data-feeds> and the Mitre curated Common Weakness Enumeration Lists <https://cwe.mitre.org/data/downloads.html>. Using BaseX, I found and reported to NIST some errors in the CVE database and the errors have since been fixed. I'm sure there are many more fixes and enhancements possible with the CVE database. I almost exclusively use BaseX/GUI (version 9.0.2, then 9.1, and now 9.1.1) on Fedora Linux. I do have some issues using BaseX/GUI and I am hoping that some improvements can be made. Eventually, BaseX/GUI uses all of it's allocated memory. Even after increasing the max memory to 3.5GB, eventually it is all used and BaseX/GUI essentially freezes. Any operation that freezes, executes quickly and completely after quitting/killing BaseX/GUI and then restarting. It seems that some memory just never gets freed as I develop different XQuery routines in the Editor, run them, save them to files, click in various places on the Map Visualization, run XQuery on the Input Bar, etc. Sometimes closing the database frees the memory, mostly it doesn't. Once I think memory was freed when I saved a file in the Editor. The Java error messages all seem to relate to running out of memory. Hitting the "GC" button never seems to help. I don't have a specific sequence of actions that eventually consumes all the memory. An example database that will demonstrate this memory consumption is composed of NVD-CVE-1.0-2018 <https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2018.json.zip> and CWE Comprehensive View <https://cwe.mitre.org/data/xml/views/2000.xml.zip>. The database takes about 109 MB and has about 5.25 million nodes. Just viewing the Visualization Map, clicking around, and running/editing queries like this will eventually use all the memory. let $cwe := distinct-values > ( > for $c in //cve//problemtype__data//value > return > tokenize($c, "-")[last()] > ) > for $c in $cwe > where > empty(//Weakness_Catalog[contains(@Name, "CWE-2000")]//Weakness[@ID = $c]) > and > empty(//Weakness_Catalog[contains(@Name, > "CWE-2000")]//Related_Weakness[@CWE_ID = $c]) > order by number($c) > return > $c `java -version` reports: openjdk version "1.8.0_191" > OpenJDK Runtime Environment (build 1.8.0_191-b12) > OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode) I will gladly provide any additional info that may help to diagnose these symptoms, etc. Thanks and best regards. RG

2 3

BaseX 9.1.1
by Christian Grün 17 Dec '18

17 Dec '18

Hi all, we are glad to provide you with version 9.1.1 of BaseX! It’s actually more than just a maintenance release: XQuery: - Comprehensive rewritings of positional predicates and functions - Higher-order functions: Improved type inference - Improved rewriting of context-based and/or nested predicates Java Bindings: - Faster access to and evaluation of Java functions and variables - Improved pre-selection of function candidates at compile time - Better error messages (incl. function arity and similar names) DBA: - Settings: user-defined pattern for ignoring log entries - Login: pass on URL query strings Minor improvements: - Import: detect epub files as ZIP archives - Digest Authentication: No delay after first request - GUI, Preferences: user-defined choice of XML suffixes The new version is online: http://basex.org/ Looking forward to your feedback as usual. Have a nice time, Christian

4 3

eq vs =
by Leo Studer 13 Dec '18

13 Dec '18

Hello Could someone explain me why this woks //country[@population = max(//@population)]/name Whereas this does not //country[@population eq max(//@population)]/name Thanks in advance Leo

3 3

Command line options not working with update operation on input file
by Zimmel, Daniel 13 Dec '18

13 Dec '18

Hello, can anyone give me a hint on the behaviour of the command line options in BaseX 9.0.2? When I try an update operation on a file given with "-i", neither the option "-w" nor any serialisation option gets evaluated; while the update operation with "-u" is working correctly, my whitespace gets happily chopped. CCL: $ basex.bat -ifile.xml -sindent=no -u -w update.xquery XQ: for $c in doc(document-uri())//element return replace value of node $c with "TEST" A workaround is using fetch:xml() with document-uri(), which does leave any whitespace intact and does no indentation (no parameters necessary). declare variable $doc := document-uri(); for $c in fetch:xml($doc)//element return replace value of node $c with "TEST" Unfortunately my requirement is I cannot use specific BaseX-functions in this specific update script. My XML: <root> <vs> <kennung>Kennung</kennung> <absatz> <fett>eins</fett> </absatz> <absatz id="sgb04_k_para067_p67_a0001_a0001"> Test <fett>fett</fett> <kursiv>kursiv</kursiv> Text Text.</absatz> </vs> </root> Thanks, Daniel

2 14

Strange response from Docker BaseXDBA
by Huib Verweij 07 Dec '18

07 Dec '18

Hi, I have a strange case of receiving a “No function found that matches the request” message from BaseXDBA. I did a "docker build -t basexdba ." in de root of the source folder of BaseX as per the DBA example in http://docs.basex.org/wiki/Docker <http://docs.basex.org/wiki/Docker>. I got a basexdba:latest image and started it with “docker run -p 8984:8984 basexdba:latest”. According to the documentation I should get the dba page with: http://localhost:8984/dba <http://localhost:8984/dba> but the server returns "No function found that matches the request.". There’s also a recent question on Stackoverflow about this: https://stackoverflow.com/questions/53462688/docker-basex-dba/53543130#5354… <https://stackoverflow.com/questions/53462688/docker-basex-dba/53543130#5354…> Regards, Huib.

3 2

BaseX WebDAV Rejecting Large Files
by Kanda (US), David 04 Dec '18

04 Dec '18

Hello, We are attempting to use WebDAV to pump a large zip file to BaseX then have BaseX unzip and import the uncompressed xml file. WebDAV transfer works well with small files, (less than 1Mb) but it fails immediately when uploading a large zip or xml file (~50MB). Is there any sample code to demonstrate programmatically transferring a large file to BaseX over WebDAV? Cheers, David

2 3

BaseX and docker
by France Baril 02 Dec '18

02 Dec '18

Hi, For one of my projects, we want to set up BaseX as part of an online application. I was wondering if anyone has experience installing BaseX in a Docker setup and if so how things got split up. In our case, each client will have many database, we're afraid that if we use a single baseX installation, it will have too many attached dbs. So we were thinking that we could use 1 application but save1 data/repo per client in their own docker unit , then again, since .basex can only link to 1 repo/data, it doesn't seem possible. If you consider 1000 clients with an average of 30 (1 per language) database each, would you use a single installation and manage security at the db level with all dbs for all clients in the same setup or would you suggest 1 full instance (server + set of db) per client? Links to any case study would be useful too. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 3

Log of discarded files / SKIPCORRUPT
by Kittelmann, Maike 30 Nov '18

30 Nov '18

If the import option SKIPCORRUPT [1] is selected - where can I find a log as to which files have been discarded? Best, MK [1] http://docs.basex.org/wiki/Options#SKIPCORRUPT

2 1

Reg : Xquery performence
by chandra Sekhar 28 Nov '18

28 Nov '18

Dear basex, Please find attachment for sample xml,Like sample xml we are added multiple xml's to the collection .Below query is my XQuery ,It is taking huge time,Can we optimize this query. My collection size is nearly 1.5 GB let $entriesDisplay := 'Display All' let $Rows := (collection("752150_Voice_OCTOBER-18_Billed")/SUBCUSTBRK[AccNo[@NO = (9800964)]][DOB >='2018-10-01' and DOB <='2018-10-31'][ServInfo!=0]) let $accNo := "9800964" let $accWiseTags := $Rows[AccNo[@NO = $accNo]] for $servNos in distinct-values($accWiseTags/CONN/@NO) let $eachRow := $accWiseTags[CONN[@NO=$servNos]] return $eachRow

3 2

Re: [basex-talk] BUG: Can't parse JSON from GZIP archive
by Rick Graham 27 Nov '18

27 Nov '18

Would've filed an issue, but the request is to post here first. (?) Using version 9.1 BaseX app, a GZIP archive <https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-recent.json.gz> of a JSON database can't be used to properly create a database. Interestingly, a ZIP archive <https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-recent.json.zip> works fine. There is no error message, just an empty database is created silently. IDK if the GZIP problem is more widespread.

2 8

Fw: Re: including xsd files
by kgi 26 Nov '18

26 Nov '18

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk