BaseX-Talk June 2025

basex-talk@mailman.uni-konstanz.de

15 participants
13 discussions

Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized
by ykhabins＠bellsouth.net 04 Jul '25

04 Jul '25

Hello, Congrats on the BaseX 11.9 release! Installed it, and started to run my XQuery tests. Right away I got the following error: "Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized." Both doc() and collection() are tripping on it. A full repro is below. XQuery #1 ============================================= declare variable $base_dir as xs:string := 'e:\Temp\'; for $docx in collection($base_dir) return $docx XQuery #2 ============================================= declare variable $base_dir as xs:string := 'e:\Temp\'; for $file in file:list($base_dir, false(), 'books*.xml') let $docx := doc($base_dir || $file) return $docx Regards, Yitzhak Khabinsky

6 21

Fulltext processing, "window selection"
by Hans-Juergen Rennau 30 Jun '25

30 Jun '25

Dear BaseX people, it seems to me there is a bug concerning full text processing. The following expression basex "'a single event during the custodial history of a manuscript or other object.' contains text 'custodial history of a manuscript' all words window 5 words" yields "false", shouldn't it yield "true"? Only when I enhance the window width to 10, I get true. 10 would be the required window length if the window started at the beginning of the string. But I think the window should start at the first and end at the last of the words, so 5 should suffice. With kind regards,Hans-Jürgen

2 1

BaseX 12: The Summer Edition
by Christian Grün 26 Jun '25

26 Jun '25

Dear all, Version 12 marks a major leap forward for BaseX – our open-source XML framework, database engine, and XQuery 4.0 processor. This release introduces powerful new features, essential upgrades, and expanded standards support that will elevate how you build, query, and manage XML-driven applications. This is what you get: 🔧 Core Upgrades - Java 17: better performance, long-term support - Jetty 12: better compatibility, future-proofing ✨ XQuery features, 4.0 - Order-Preserving Maps: more intuitive & predictable data structures - Map performance: significantly leaner & faster, close to native Java - Arrays & sequences: Wrapping as arrays in constant time & vice versa - Pipeline Operator: clean, expressive queries with the -> operator - Typed constructs: structured data with item and record constructors - Stack Traces, finally block: better debugging, robust error-handling - While Clauses: better control flow in functional logic - Standardized CSV, JSON, and HTML Parsing, support for Validator.nu - Scripting: launch XQuery expressions as independent jobs - Profiler Optimizations: aggregation of profiled results 🔐 Security & Admin Enhancements - Automatic Admin Password Generation (first startup) - Log Filtering, Masking & Truncation: better control over logging Get the new version and check out our documentation for more details: https://basex.org https://docs.basex.org/main/Changelog Have fun, Your BaseX Team

4 5

Execute an Query function from Java code
by Mauro Mugnaini 24 Jun '25

24 Jun '25

Hi all, I’m trying to invoke an XQuery function (instance of FItem) from a Java class that acts a callback listener for a Java client adapter. I’m able to instantiate and register it in a query module by using the Java bindings, passing the reference to the XQuery code to invoke) but at the moment that the function is invoked a QueryContext instance is needed (or at least the current Context to create it if I understood correctly) of the running BaseX service (an HTTP server in my case). I tried to find a way to do that taking a look of the Jobs module and similar packages in the source code but without success. In the “Java" examples it is shown how to do this for code invoked during a query execution in a class that is a subclass of the QueryModule and by using the ContextDependent annotation that do the job automatically. It is not my case since the code is not directly call during a query execution but asynchronously in a separate thread. Finally my questions: It is something that is possibile to do? Is there some singleton I can access or other classes I can use to achieve that? Thanks and regards. Mauro

2 3

csv:doc - interpretation of option values
by Hans-Juergen Rennau 24 Jun '25

24 Jun '25

Dear BaseX people, a small observation, which might be regarded as a bug (perhaps not). It is about the interpretation of options passed to function csv:doc. I set the 'header' option like this: let $options := map{'header': //header/data()} with the confusing result that the option is ignored, although the comparison $options?header eq 'yes' yields true. If I replace data() with string(), let $options := map{'header': //header/string()} the option works as expected. Kind regards,Hans-Jürgen

2 2

Confirming presence of icu4j
by Joe Wicentowski 16 Jun '25

16 Jun '25

Hi all, I have a query that makes use of the UCA collation with the "numeric" keyword [1] (e.g., for ensuring that "d2" sorts before "d12"), and I'm seeking a way to confirm that the icu4j library is available on the BaseX classpath before I run queries that depend on it. [2] Even though I manually install the icu4j library into Basex's lib/custom directory as specified in [3], I have sometimes forgotten to do so when, for example, Homebrew upgraded BaseX, and as a result my query relying on this collation began producing unexpected results. I've tried to make use of the XQuery 4 fn:collation-available function [4], but so far I've been unsuccessful. Specifically, using BaseX 11.9 or 12 with icu4j-77.1.jar on macOS 15.5 (on Apple Silicon), the following expression returns the expected result: ``` ("d2", "d12") => sort("http://www.w3.org/2013/collation/UCA?numeric=yes") ``` The result, as expected, is ("d12", "d2"), when the library is present and the opposite when it is absent. But the following version, which introduces a conditional and the fn:collation-available function, always takes the "else" path: ``` if (collation-available("http://www.w3.org/2013/collation/UCA?numeric=yes", "compare")) then ("d2", "d12") => sort("http://www.w3.org/2013/collation/UCA?numeric=yes") else "UCA collation not present" ``` I expected this expression to return ("d12", "d2") but instead received "UCA collation not present". Am I misusing/misunderstanding how to use fn:collation-available? Thanks! Joe [1] https://www.w3.org/TR/xpath-functions-31/#uca-collations [2] https://docs.basex.org/main/Full-Text#collations [3] https://docs.basex.org/main/Startup#full_distributions [4] https://docs.basex.org/12/Standard_Functions#fn:collation-available

2 2

Manual database lock
by Matt Dziuban 12 Jun '25

12 Jun '25

Hello everyone, Is there any function or command I can use to manually lock and unlock a database? Based on the documentation on File-System Locks <https://docs.basex.org/12/Transaction_Management#file-system_locks> it sounds like maybe just creating an upd.basex file in the database directory would be sufficient? Thanks in advance, Matt

2 4

Result too large with Full Text Index
by Yann de Thézy 11 Jun '25

11 Jun '25

Hello, I encounter what seems to be a bug with the use of Full Text Index (basex 11.9). I have created a database with FTINDEX (and CASESENS + DIACRITICS). When I call once a function in the xquery below, the result is different than when I call it twice. It seems that the whole database is searched in the case of 2 calls which is not what is expected. Xquery is : declare function local:getHit($documents, $word) { (# db:enforceindex #) { $documents//*[text() contains text {$word}] } }; let $docs := collection() let $docsSmall := for $doc in $docs where $doc/book/@category='COOKING' return $doc let $a := trace("res 1 : " || count(local:getHit($docsSmall, '2005'))) (: uncomment the line below to change getHit result :) (: let $a := trace("res 2 : " || count(local:getHit($docsSmall, '2005'))) :) return '' Result is : "res 1 : 1" After uncommenting the second call, result is: "res 1 : 2" "res 2 : 2" The same with this more simple xquery: declare function local:getHit($documents, $word) { (# db:enforceindex #) { $documents//*[text() contains text {$word}] } }; let $docs := collection() let $docsSmall := $docs[1] let $a := trace("res 1 : " || count(local:getHit($docsSmall, '2005'))) return '' Result is : "res 1 : 2" ("res 1 : 1" expected) 2 documents are populating this database : <book category="COOKING"> <title lang="en">Everyday Italian</title> <author>Giada De Laurentiis</author> <year>2005</year> <price>30.00</price> </book> and <book category="CHILDREN"> <title lang="en">Harry Potter</title> <author>J K. Rowling</author> <year>2005</year> <price>29.99</price> </book> Best, Yann -- Cet e-mail a été vérifié par le logiciel antivirus d'Avast. www.avast.com

3 10

running several updating queries from a single query?
by Graydon Saunders 10 Jun '25

10 Jun '25

Hello! So if I have a number of updating queries, what's the best way to write a query that will run all of them in some fixed order? (I am doing this from the GUI.) All the individual updating queries do what they're expected to do and it works if I run them in sequence from the GUI, query one, query two, and so on. If I try to chain them together: xs:anyURI('updating-query-1.xq') => xquery:eval-update(), xs:anyURI('updating-query-2.xq') => xquery:eval-update() Seems to work OK for the first two or three and then to start having issues (in the sense that the updates don't appear to happen to the target) if I chain four or five together. (The updating queries get the db name to update from a common xquery module.) It also looks inelegant, like there ought to be a better way. Anyone got any suggestions? Or is this not a sensible thing to be attempting? Thanks! Graydon

2 2

Optimizing query that reads nodes from two databases
by Matt Dziuban 04 Jun '25

04 Jun '25

Hi all, I'm working on a query that reads from two databases -- OriginalDB and UpdateDB. The structure of each database is the same: <data> <item id="1">...</item> <item id="2">...</item> ... </data> OriginalDB has 2,305,570 items and UpdateDB has 307,019. The query gets all distinct item ids from the two databases, then gets the item with a matching id (if there is one) from each database, and returns the id and both nodes in a JSON object. Here's the query: let $originalDB := db:get('OriginalDB')/data/item let $updateDB := db:get('UpdateDB')/data/item for $id in distinct-values(($originalDB/@id, $updateDB/@id)) let $original := $originalDB[@id = $id] let $update := $updateDB[@id = $id] return json:serialize(map { 'id': xs:long($id), 'original': $original, 'update': $update }, map { 'indent': 'no' }) In its current state this query is very slow -- it's returned only 35 JSON objects in ~30 minutes. How can I go about optimizing it to best take advantage of each database's indices? Thanks in advance, Matt

3 5

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk June 2025