BaseX-Talk March 2023

basex-talk@mailman.uni-konstanz.de

14 participants
14 discussions

BaseX 9.6: The Summer Edition
by Christian Grün 28 Nov '24

28 Nov '24

Dear all, We provide you with a new and fresh version of BaseX, our open source XML framework, database system and XQuery 3.1 processor: https://basex.org/ Apart from our main focus (query rewritings and optimizations), we have added the following enhancements: XQUERY: MODULES, FEATURES - Archive Module, archive:write: stream large archives to file - SQL Module: support for more SQL types - Full-Text Module, ft:thesaurus: perform Thesaurus queries - Fulltext, fuzzy search: specify Levenshtein limit - UNROLLLIMIT option: control limit for unrolling loops XQUERY: JAVA BINDINGS - Java objects of unknown type are wrapped into function items - results of constructor calls are returned as function items - the standard package "java.lang." has become optional - array arguments can be specified with the middle dot notation - conversion can be controlled with the WRAPJAVA option - better support for XQuery arrays and maps WEB APPLICATIONS - RESTXQ: Server-Timing HTTP headers are attached to the response For a more comprehensive list of added and updated features, look into our documentation (docs.basex.org) and check out the GitHub issues (github.com/BaseXdb/basex/issues). Have fun, Your BaseX Team

11 43

recursively used variables
by Rob Stapper 12 Aug '24

12 Aug '24

Hi, The code[1] below and send as attachment generates a error message: “Static variable depends on itself: $Q{http://www.w3.org/2005/xquery-local-functions}test”. I use these variables to refer to my private functions in my modules so I can easyly refer to them in a inheritance situation. It’s not a big problem for me but I was wondering if the error-triggering is justified or that it should work. [1]=========================================== declare variable $local:test := local:test#1 ; declare %private function local:test( $i) { if ( $i > 0) then $local:test( $i - 1) } ; $local:test( 10) =========================================== Kind regards, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

4 7

xslt:transform-report result
by Andy Bunce 11 Mar '24

11 Mar '24

Hi, Using BaseX 9.7.1 and saxon9he-9.9.1.jar The documentation suggests the ?result from xslt:transform-report should be *a* document-node where possible [1] This seems not quite to be the case when there are processing instructions or comments at the top level. In these cases a sequence of document-nodes is returned. /Andy [1] https://docs.basex.org/wiki/XSLT_Module#xslt:transform-report let $xslt:=<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="3.0"> <xsl:mode on-no-match="shallow-copy"/> </xsl:stylesheet> let $xml:=document{ <?something type="compact"?>, <foo/>} return xslt:transform-report($xml,$xslt) Returns map { "messages": (), "result": (<?something type="compact"?>, <foo/>) }

3 7

PHP Client Session Object: infinite loop in read method when bpos is null
by Tamara Marnell 13 Jul '23

13 Jul '23

Hello everyone, Once in a while, my server running BaseX will suddenly experience a big spike in write operations, the hard disk space will fill up to 100%, and the whole server will lock up. I can't say what initiates this, because the logs and metrics disprove every theory I can think of. (There's nothing unusual in the access logs or BaseX data logs, memory usage stays consistently at 45% and CPU usage at 5%, no user attempted anything like a huge bulk upload, etc.) However, one thing that always happens during these incidents is that the Apache error log blows up to a crazy size like 1 GB, filled with the message: PHP Notice: Trying to access array offset on value of type null in /[path]/client/session.php on line 164 This line is in the read method of the Session class from GitHub, and it indicates that the byte position passed to the buffer property is null. My error log probably fills up because read() is called by readString() in a while loop that never terminates. There might be extraordinary circumstances in which during construction, socket_connect returns "true" but the response is not valid or expected. -Tamara -- Tamara Marnell Program Manager, Systems Orbis Cascade Alliance (orbiscascade.org <https://www.orbiscascade.org/>) Pronouns: she/her/hers

2 5

Problem with using XInclude in BaseX
by Virgile Reignier 03 Apr '23

03 Apr '23

Bonjour, Je me permets de vous contacter dans le cadre de mon doctorat en histoire médiévale. Je souhaiterai en effet organiser le dépouillement de mes archives à l'aide d'une base de données en XML en utilisant le logiciel BaseX, mais je suis face à une difficulté que je n'arrive pas à surmonter dans son utilisation. Cette difficulté est liée à l'utilisation de la balise <xi:include>. J'ai tenté de produire un exemple minimaliste avec deux fichiers dans un même répertoire pour voir ce qui ne marche pas : file music.xml : <musique xmlns:xi="http://www.w3.org/2001/XInclude"> <titre>Smoke on the water</titre> <artiste>Deep Purple</artiste> <xi:include href="label.xml"/> </musique> file label.xml : <label>Purple Records</label> Alors que ces deux fichiers sont décrits comme valides par Oxygen, l'importation du fichier music.xml avec BaseX (que ce soit avec l'interface DBA ou l'interface GUI) génère systématiquement l'erreur suivante : "An include with href 'label.xml'failed, and no fallback element was found". Je peux en revanche importer le fichier dans la base de données via Oxygen et l'utilisation du WebDAV de BaseX, mais le fichier est alors indiqué comme étant de type "binary" et est absolument inemployable pour réaliser des requêtes. J'ai pourtant tenté de réaliser la requête suivante au sein de ma DB dans BaseX GUI, ce qui n'a pas renvoyé d'erreurs : declare namespace xi = "http://www.w3.org/2001/XInclude"; xi:include J'ai également tenté de charger ces mêmes fichiers dans eXist DB, et l'inclusion s'est réalisée sans problèmes. Je ne comprends donc pas ce qui ne va pas avec l'utilisation de XInclude dans BaseX. Est-ce qu'il y a un problème avec la résolution des URI ? Je travaille sous Windows 10 (j'ai aussi fait des tests sur Ubuntu et obtenu le même résultat), BaseX 10.4 et Java 1.8.0_361. Est-ce que c'est quelque chose qui vous est déjà arrivé ? J'ai essayé de chercher dans les archives mail de basex-talk et trouvé quelques problèmes similaires, mais qui ont été résolus par l'emploi de BaseX GUI. Or chez moi cela marche aussi mal avec GUI qu'avec DBA. Je peux transférer mon travail sur eXist DB, mais j'avoue m'être assez familiarisé avec BaseX et souhaiterai rester sur ce logiciel tant que possible. Je suis donc preneur de toutes vos propositions. En vous remerciant par avance pour vos réponses, Bien cordialement, Virgile Reignier Hello, I am contacting you as part of my PhD in medieval history. I would like to organise the analysis of my archives with the help of an XML database using the BaseX software, but I am encountering a difficulty that I cannot overcome in its use. This difficulty is related to the use of the <xi:include> tag. I tried to produce a minimalist example with two files in the same directory to see what goes wrong: file music.xml : <musique xmlns:xi="http://www.w3.org/2001/XInclude"> <titre>Smoke on the water</titre> <artiste>Deep Purple</artiste> <xi:include href="label.xml"/> </musique> file label.xml : <label>Purple Records</label> While both files are described as valid by Oxygen, importing the music.xml file with BaseX (either with the DBA interface or the GUI interface) consistently generates the following error: "An include with href 'label.xml'failed, and no fallback element was found". I can import the file into the database via Oxygen and the use of BaseX WebDAV, but the file is then indicated as being of type "binary" and is absolutely unusable for queries. However, I tried to perform the following query within my DB in BaseX GUI, which did not return any errors: declare namespace xi = "http://www.w3.org/2001/XInclude"; xi:include I also tried to load these same files into eXist DB, and the inclusion was successful. So I don't understand what is wrong with using XInclude in BaseX. Is there a problem with URI resolution? I'm working on Windows 10 (I also tested on Ubuntu and got the same result), BaseX 10.4 and Java 1.8.0_361. Is this something that has happened to you before? I tried to search the basex-talk mail archives and found some similar problems, but they were solved by using BaseX GUI. However, in my case it works just as badly with GUI as with DBA. I can transfer my work to eXist DB, but I have become quite familiar with BaseX and would like to stay with it as long as possible. I am therefore interested in any suggestions you may have. Thank you in advance for your answers, Virgile Reignier

4 16

Potential bug in GUI, Unit Tests
by Zimmel, Daniel 01 Apr '23

01 Apr '23

Hi, while I am trying to find my way around the Unit Module, I noticed the following unexpected behavior. 0. Using the test example from https://docs.basex.org/wiki/Unit_Module#Query in the GUI 1. changes that are not saved to disk do not get respected - as opposed to other queries 2. pressing the default button for running queries executes the most recent query which is open in another tab While 1 might not be a bug , 2 feels like one (a query fires that is not displayed on the current tab) BaseX 10.3 Bye, Daniel

2 3

Automated testing for XML databases
by Shuxin Li 30 Mar '23

30 Mar '23

Greetings! I'm Shuxin, an undergraduate CS student, who is currently an intern at NUS Test lab. I’ve been working on an automated testing tool for XML processors and databases. My goal is to find bugs in important systems, in order to improve these systems’ reliability. In the past few days, I submitted a few bug reports on Github (Github id: Twilight-Shuxin). Thanks for having already fixed these! I would like to ask whether you find these reports useful and would also appreciate future reports if I find more bugs? Any feedback for us is highly appreciated. We also plan to open-source this tool for public usage after it's fully realized, and truly hope that it might be of help to the community. Thanks! Best Regards, Shuxin Li

5 6

Database Query in RESTXQ function
by Alexander Krasnogolowy 29 Mar '23

29 Mar '23

Hi, given the following RESTXQ function: declare %rest:path("/myrest/{$db}") %rest:GET %output:method("xhtml") %output:omit-xml-declaration("no") %output:doctype-public("-//W3C//DTD XHTML 1.0 Transitional//EN") %output:doctype-system("http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd") function page:html($db as xs:string) { <html xmlns="http://www.w3.org/1999/xhtml"> <body> Database creation date: {db:info("NB")/databaseproperties/timestamp/text()}<br/> </body> </html> }; The website returns "Database creation date: " (without a timestamp) If I put that into a function: declare function page:getDBTimestamp($db as xs:string) { db:info($db)/databaseproperties/timestamp/text() }; and call it in the page: <body> Database creation date: {page:getDBTimestamp($db)}<br/> </body> then I can see the timestamp. Can somebody explain to my why it makes a difference and why I cannot query the database directly from the RESTXQ function? Alex

4 6

collection('i_do_not_exist')/users/user[@name=()] is () even if i_do_not_exist does not exit
by Omar Siam 23 Mar '23

23 Mar '23

Hi, Either I found an interesting new XQuery feature or a bug: collection('i_do_not_exist')/some/path[@attr=()] retruns the empty sequence whereas collection('i_do_not_exist')/some/path throws an error err:FODC0002 so does collection('i_do_not_exist')/some/path[@attr="i_am_an_attr"] Am I missing something? Best regards, -- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam(a)oeaw.ac.at | www.oeaw.ac.at/acdh

2 3

Issue with the Java 11 XML Catalog API and xsl:import/xsl:include
by Imsieke, Gerrit, le-tex 22 Mar '23

22 Mar '23

Hi, We experience an issue with the new catalog resolver when importing or including XSLT from another, possibly already catalog-resolved, XSLT file. If you unzip attached catalog_test.zip and set the catalog location by a pragma around xsl.xq or by set BASEX_JVM="-Dorg.basex.catalog=../catalog_test/xmlcatalog/catalog.xml" prior to invoking basexgui.bat or bin\basex.bat ..\catalog_test\xsl.xq, you will get an exception Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 10.4 Java: Eclipse Adoptium, 17.0.4.1 OS: Windows 11, amd64 Stack Trace: javax.xml.catalog.CatalogException: JAXP09040002: No match found for href 'other.xsl' and base 'file:/C:/Users/gerrit/Dev/catalog_test/xsl/imported.xsl'. … If I use Norm’s resolver by putting xmlresolver-5.1.1.jar and xmlresolver-5.1.1-data.jar into lib/custom, I get the expected result <result status="ok"><doc>other.xsl was imported!</doc></result> Therefore the issue isn’t urgent. We just use Norm’s resolver. Should I file an issue on Github? Gerrit -- Gerrit Imsieke Geschäftsführer / Managing Director le-tex publishing services GmbH Weissenfelser Str. 84, 04229 Leipzig, Germany Phone +49 341 355356 110, Fax +49 341 355356 510 gerrit.imsieke(a)le-tex.de, http://www.le-tex.de Registergericht / Commercial Register: Amtsgericht Leipzig Registernummer / Registration Number: HRB 24930 Geschäftsführer / Managing Directors: Gerrit Imsieke, Svea Jelonek, Thomas Schmidt

2 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk March 2023