June 2025 - BaseX-Talk - mailman.uni-konstanz.de

Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized
by ykhabins＠bellsouth.net 04 Jul '25

04 Jul '25

Hello, Congrats on the BaseX 11.9 release! Installed it, and started to run my XQuery tests. Right away I got the following error: "Property 'http://www.oracle.com/xml/jaxp/properties/entityExpansionLimit' is not recognized." Both doc() and collection() are tripping on it. A full repro is below. XQuery #1 ============================================= declare variable $base_dir as xs:string := 'e:\Temp\'; for $docx in collection($base_dir) return $docx XQuery #2 ============================================= declare variable $base_dir as xs:string := 'e:\Temp\'; for $file in file:list($base_dir, false(), 'books*.xml') let $docx := doc($base_dir || $file) return $docx Regards, Yitzhak Khabinsky

6 21

Fulltext processing, "window selection"
by Hans-Juergen Rennau 30 Jun '25

30 Jun '25

Dear BaseX people, it seems to me there is a bug concerning full text processing. The following expression basex "'a single event during the custodial history of a manuscript or other object.' contains text 'custodial history of a manuscript' all words window 5 words" yields "false", shouldn't it yield "true"? Only when I enhance the window width to 10, I get true. 10 would be the required window length if the window started at the beginning of the string. But I think the window should start at the first and end at the last of the words, so 5 should suffice. With kind regards,Hans-Jürgen

2 1

BaseX 12: The Summer Edition
by Christian Grün 26 Jun '25

26 Jun '25

Dear all, Version 12 marks a major leap forward for BaseX – our open-source XML framework, database engine, and XQuery 4.0 processor. This release introduces powerful new features, essential upgrades, and expanded standards support that will elevate how you build, query, and manage XML-driven applications. This is what you get: 🔧 Core Upgrades - Java 17: better performance, long-term support - Jetty 12: better compatibility, future-proofing ✨ XQuery features, 4.0 - Order-Preserving Maps: more intuitive & predictable data structures - Map performance: significantly leaner & faster, close to native Java - Arrays & sequences: Wrapping as arrays in constant time & vice versa - Pipeline Operator: clean, expressive queries with the -> operator - Typed constructs: structured data with item and record constructors - Stack Traces, finally block: better debugging, robust error-handling - While Clauses: better control flow in functional logic - Standardized CSV, JSON, and HTML Parsing, support for Validator.nu - Scripting: launch XQuery expressions as independent jobs - Profiler Optimizations: aggregation of profiled results 🔐 Security & Admin Enhancements - Automatic Admin Password Generation (first startup) - Log Filtering, Masking & Truncation: better control over logging Get the new version and check out our documentation for more details: https://basex.org https://docs.basex.org/main/Changelog Have fun, Your BaseX Team

4 5

Execute an Query function from Java code
by Mauro Mugnaini 24 Jun '25

24 Jun '25

Hi all, I’m trying to invoke an XQuery function (instance of FItem) from a Java class that acts a callback listener for a Java client adapter. I’m able to instantiate and register it in a query module by using the Java bindings, passing the reference to the XQuery code to invoke) but at the moment that the function is invoked a QueryContext instance is needed (or at least the current Context to create it if I understood correctly) of the running BaseX service (an HTTP server in my case). I tried to find a way to do that taking a look of the Jobs module and similar packages in the source code but without success. In the “Java" examples it is shown how to do this for code invoked during a query execution in a class that is a subclass of the QueryModule and by using the ContextDependent annotation that do the job automatically. It is not my case since the code is not directly call during a query execution but asynchronously in a separate thread. Finally my questions: It is something that is possibile to do? Is there some singleton I can access or other classes I can use to achieve that? Thanks and regards. Mauro

2 3

csv:doc - interpretation of option values
by Hans-Juergen Rennau 24 Jun '25

24 Jun '25

Dear BaseX people, a small observation, which might be regarded as a bug (perhaps not). It is about the interpretation of options passed to function csv:doc. I set the 'header' option like this: let $options := map{'header': //header/data()} with the confusing result that the option is ignored, although the comparison $options?header eq 'yes' yields true. If I replace data() with string(), let $options := map{'header': //header/string()} the option works as expected. Kind regards,Hans-Jürgen

2 2

Confirming presence of icu4j
by Joe Wicentowski 16 Jun '25

16 Jun '25

Hi all, I have a query that makes use of the UCA collation with the "numeric" keyword [1] (e.g., for ensuring that "d2" sorts before "d12"), and I'm seeking a way to confirm that the icu4j library is available on the BaseX classpath before I run queries that depend on it. [2] Even though I manually install the icu4j library into Basex's lib/custom directory as specified in [3], I have sometimes forgotten to do so when, for example, Homebrew upgraded BaseX, and as a result my query relying on this collation began producing unexpected results. I've tried to make use of the XQuery 4 fn:collation-available function [4], but so far I've been unsuccessful. Specifically, using BaseX 11.9 or 12 with icu4j-77.1.jar on macOS 15.5 (on Apple Silicon), the following expression returns the expected result: ``` ("d2", "d12") => sort("http://www.w3.org/2013/collation/UCA?numeric=yes") ``` The result, as expected, is ("d12", "d2"), when the library is present and the opposite when it is absent. But the following version, which introduces a conditional and the fn:collation-available function, always takes the "else" path: ``` if (collation-available("http://www.w3.org/2013/collation/UCA?numeric=yes", "compare")) then ("d2", "d12") => sort("http://www.w3.org/2013/collation/UCA?numeric=yes") else "UCA collation not present" ``` I expected this expression to return ("d12", "d2") but instead received "UCA collation not present". Am I misusing/misunderstanding how to use fn:collation-available? Thanks! Joe [1] https://www.w3.org/TR/xpath-functions-31/#uca-collations [2] https://docs.basex.org/main/Full-Text#collations [3] https://docs.basex.org/main/Startup#full_distributions [4] https://docs.basex.org/12/Standard_Functions#fn:collation-available

2 2

Manual database lock
by Matt Dziuban 12 Jun '25

12 Jun '25

Hello everyone, Is there any function or command I can use to manually lock and unlock a database? Based on the documentation on File-System Locks <https://docs.basex.org/12/Transaction_Management#file-system_locks> it sounds like maybe just creating an upd.basex file in the database directory would be sufficient? Thanks in advance, Matt

2 4

Result too large with Full Text Index
by Yann de Thézy 11 Jun '25

11 Jun '25

Hello, I encounter what seems to be a bug with the use of Full Text Index (basex 11.9). I have created a database with FTINDEX (and CASESENS + DIACRITICS). When I call once a function in the xquery below, the result is different than when I call it twice. It seems that the whole database is searched in the case of 2 calls which is not what is expected. Xquery is : declare function local:getHit($documents, $word) { (# db:enforceindex #) { $documents//*[text() contains text {$word}] } }; let $docs := collection() let $docsSmall := for $doc in $docs where $doc/book/@category='COOKING' return $doc let $a := trace("res 1 : " || count(local:getHit($docsSmall, '2005'))) (: uncomment the line below to change getHit result :) (: let $a := trace("res 2 : " || count(local:getHit($docsSmall, '2005'))) :) return '' Result is : "res 1 : 1" After uncommenting the second call, result is: "res 1 : 2" "res 2 : 2" The same with this more simple xquery: declare function local:getHit($documents, $word) { (# db:enforceindex #) { $documents//*[text() contains text {$word}] } }; let $docs := collection() let $docsSmall := $docs[1] let $a := trace("res 1 : " || count(local:getHit($docsSmall, '2005'))) return '' Result is : "res 1 : 2" ("res 1 : 1" expected) 2 documents are populating this database : <book category="COOKING"> <title lang="en">Everyday Italian</title> <author>Giada De Laurentiis</author> <year>2005</year> <price>30.00</price> </book> and <book category="CHILDREN"> <title lang="en">Harry Potter</title> <author>J K. Rowling</author> <year>2005</year> <price>29.99</price> </book> Best, Yann -- Cet e-mail a été vérifié par le logiciel antivirus d'Avast. www.avast.com

3 10

running several updating queries from a single query?
by Graydon Saunders 10 Jun '25

10 Jun '25

Hello! So if I have a number of updating queries, what's the best way to write a query that will run all of them in some fixed order? (I am doing this from the GUI.) All the individual updating queries do what they're expected to do and it works if I run them in sequence from the GUI, query one, query two, and so on. If I try to chain them together: xs:anyURI('updating-query-1.xq') => xquery:eval-update(), xs:anyURI('updating-query-2.xq') => xquery:eval-update() Seems to work OK for the first two or three and then to start having issues (in the sense that the updates don't appear to happen to the target) if I chain four or five together. (The updating queries get the db name to update from a common xquery module.) It also looks inelegant, like there ought to be a better way. Anyone got any suggestions? Or is this not a sensible thing to be attempting? Thanks! Graydon

2 2

Optimizing query that reads nodes from two databases
by Matt Dziuban 04 Jun '25

04 Jun '25

Hi all, I'm working on a query that reads from two databases -- OriginalDB and UpdateDB. The structure of each database is the same: <data> <item id="1">...</item> <item id="2">...</item> ... </data> OriginalDB has 2,305,570 items and UpdateDB has 307,019. The query gets all distinct item ids from the two databases, then gets the item with a matching id (if there is one) from each database, and returns the id and both nodes in a JSON object. Here's the query: let $originalDB := db:get('OriginalDB')/data/item let $updateDB := db:get('UpdateDB')/data/item for $id in distinct-values(($originalDB/@id, $updateDB/@id)) let $original := $originalDB[@id = $id] let $update := $updateDB[@id = $id] return json:serialize(map { 'id': xs:long($id), 'original': $original, 'update': $update }, map { 'indent': 'no' }) In its current state this query is very slow -- it's returned only 35 JSON objects in ~30 minutes. How can I go about optimizing it to best take advantage of each database's indices? Thanks in advance, Matt

3 5

BaseX 12.0 is tripping on the XSLT transformation that outputs text, not XML
by ykhabins＠bellsouth.net 04 Jun '25

04 Jun '25

Hello, It seems that BaseX 12.0 beta 2686758, and later, is tripping on the XSLT transformation that outputs text, not XML. I am using SaxonHE12-5J. Even the following XQuery setting is not helping. declare option output:method 'text'; IMHO, BaseX should read the output:method attribute from an XSLT and handle it properly. method? = "xml" | "html" | "xhtml" | "text" | "json" | "adaptive" | eqname https://qt4cg.org/specifications/xslt-40/Overview.html#id-xsl-output-declar… Below is an easy repro. Process3.xslt is working (xsl:output method="xml") Process2.xslt is NOT working (xsl:output method="text") Error: Stopped at C:/Program Files (x86)/BaseX/src/file, 10/15: [FODC0002] "" (Line 1): Content is not allowed in prolog. XQuery ============= (: Outputs the result as xml. :) declare option output:method 'text'; declare variable $input as xs:string := 'e:\Temp\BaseX_XSLT\Input2.xml'; declare variable $stylesheet as xs:string := 'e:\Temp\BaseX_XSLT\Process2.xslt'; xslt:transform($input, $stylesheet) input2.xml ============== <dummy>text</dummy> Process3.xslt ================= <xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform"> <xsl:output method="xml" omit-xml-declaration="yes"/> <xsl:template match="/dummy"> <xsl:copy-of select="."/> </xsl:template> </xsl:stylesheet> Process2.xslt ================ <xsl:stylesheet version="1.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform"> <xsl:output method="text" omit-xml-declaration="yes"/> <xsl:template match="/dummy"> <xsl:value-of select="."/> </xsl:template> </xsl:stylesheet>

3 3

Questions about xslt:transform-text and xslt:transform-report
by Lizzi, Vincent 02 Jun '25

02 Jun '25

Hello BaseX team, I typically use the xslt:transform-text function to apply an XSLT stylesheet and obtain the result that is serialized by Saxon according to the xsl:output instructions in the stylesheet. The xslt:transform-report has the advantage of providing access to messages created by xsl:message instructions. I have a few questions about these functions: Is there a way to use the xsl:transform-report function to obtain messages and the serialized result (instead of document nodes) that is currently returned by xslt:transform-text? Is there a way to provide a base URI in the options of xsl:transform-text (or xsl:transform-report or xsl:transform)? If the input to the transformation is on disk then the base URI is set automatically, however if the input is held in memory then the base URI is not set so it could be helpful to be able to provide a base uri to the transformer as an option. The documentation doesn't mention these capabilities so I'm guessing that these things are not currently possible. Thank you, Vincent ______________________________________________ Vincent M. Lizzi Head of Information Standards | Taylor & Francis Group E-Mail: vincent.lizzi(a)taylorandfrancis.com<mailto:vincent.lizzi@taylorandfrancis.com> Web: www.tandfonline.com<http://www.tandfonline.com/> Time zone: US Eastern Taylor & Francis is a trading name of Informa UK Limited, registered in England under no. 1072954 "Everything should be made as simple as possible, but not simpler." [https://res.public.onecdn.static.microsoft/assets/bookwithme/misc/CalendarP…]<https://outlook.office.com/bookwithme/user/aa80d42cbb5b46dba06a5ad241d7665b…> Book time to meet with me<https://outlook.office.com/bookwithme/user/aa80d42cbb5b46dba06a5ad241d7665b…> Information Classification: General

3 3

difference of type of $schema for different validation functions?
by Martin Honnen 02 Jun '25

02 Jun '25

Why is the function https://docs.basex.org/main/Validation_Functions#validate:xsd documented as taking the schema as item()? while the function https://docs.basex.org/main/Validation_Functions#validate:xsd-report documents the schema as xs:string? ? Is that a documentation error or quirk or are these two functions taking different types of arguments for the schema?

2 1