BaseX-Talk November 2021

basex-talk@mailman.uni-konstanz.de

22 participants
24 discussions

BaseX 9.6: The Summer Edition
by Christian Grün 28 Nov '24

28 Nov '24

Dear all, We provide you with a new and fresh version of BaseX, our open source XML framework, database system and XQuery 3.1 processor: https://basex.org/ Apart from our main focus (query rewritings and optimizations), we have added the following enhancements: XQUERY: MODULES, FEATURES - Archive Module, archive:write: stream large archives to file - SQL Module: support for more SQL types - Full-Text Module, ft:thesaurus: perform Thesaurus queries - Fulltext, fuzzy search: specify Levenshtein limit - UNROLLLIMIT option: control limit for unrolling loops XQUERY: JAVA BINDINGS - Java objects of unknown type are wrapped into function items - results of constructor calls are returned as function items - the standard package "java.lang." has become optional - array arguments can be specified with the middle dot notation - conversion can be controlled with the WRAPJAVA option - better support for XQuery arrays and maps WEB APPLICATIONS - RESTXQ: Server-Timing HTTP headers are attached to the response For a more comprehensive list of added and updated features, look into our documentation (docs.basex.org) and check out the GitHub issues (github.com/BaseXdb/basex/issues). Have fun, Your BaseX Team

11 43

recursively used variables
by Rob Stapper 12 Aug '24

12 Aug '24

Hi, The code[1] below and send as attachment generates a error message: “Static variable depends on itself: $Q{http://www.w3.org/2005/xquery-local-functions}test”. I use these variables to refer to my private functions in my modules so I can easyly refer to them in a inheritance situation. It’s not a big problem for me but I was wondering if the error-triggering is justified or that it should work. [1]=========================================== declare variable $local:test := local:test#1 ; declare %private function local:test( $i) { if ( $i > 0) then $local:test( $i - 1) } ; $local:test( 10) =========================================== Kind regards, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

4 7

9.6 on Docker Hub
by Johannes Bauer 10 Jan '22

10 Jan '22

Hi, I cannot find the latest BaseX release on Docker Hub (only the 9.5 branch). Is this still planned? Thank you. Best Regards Johannes

3 4

docker, creating and deploying the dba docker-image
by Rob Stapper 29 Nov '21

29 Nov '21

Hi Christian, I’m fiddling with docker-images and containers now and I’m trying to build an deploy rhe dba-docker axample shipped with the basex-distribution. Docker is running under windows-10. So far I’ve been able to pull, build, deploy images and containers. It all work fine but I got stuck with the dba-example. I’ve mounted ‘c:/Program Files (x86)/basex/data’ on ‘/srv/basex/data’ But I’m confused what directories to mount on: ‘/srv/basex/repo’ and ‘/srv/basex/webapp’? I can’t find the docker-run example for this. Can you shine some more light on the issue. Thanx in advance, Rob Stapper Sent from Mail for Windows -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

4 6

encrypting my xquery-files and modules
by Rob Stapper 26 Nov '21

26 Nov '21

Hi Christian, Related to the previous question: Is possible to run encrypted xquery-files? Cheers, Rob Sent from Mail foNNr Windows -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 1

HTTP server stop working during long time process
by Sebastian Guerrero 25 Nov '21

25 Nov '21

Hi team! I'm enjoying using BaseX more than a year ago, thank you very much for all your help. But then, suddenly, the HTTP server instance stops working while I'm executing a long time duration process: around 4 hours to generate some indexes. ( the process just crash and I have to restart it ). This process was running daily for the last 14 months, without any problem. My doubt is this: *where or how may I get some information about what caused the problem?* Checking files inside */data/.logs* I see only the RESTXQ calls and other minor logs, but nothing to give me a clue about the reason for the server crash. I'm running BaseX 9.4 beta on a *Debian* machine. Here you have my settings: https://imgur.com/ucngBhY Any suggestions?

2 2

Help dealing with slow API responses
by Bridger Dyson-Smith 24 Nov '21

24 Nov '21

Hi all - I have the sneaking suspicion that the answer to this plea for help will be something like, "Use RESTXQ!!" or something similar, but let me describe the problem: I'm pulling data back from an OAI-PMH endpoint that is slow; i.e. response times are ~1/minute. Embarrassingly, I think I've spent several hours trying to figure out if my requests were buggy before I realized that the API endpoint was just *slow* (at least compared to others that I use regularly). I typically use the IntelliJ plugin or the BaseX GUI for the vast majority of my XQuery work, but these requests effectively build up a sequence of responses (as files) and then serialize them all to disk when the requests have finished. When the requests are answered quickly, there's prompt feedback (my script finishes quickly, I can see serialized files, etc), but when the requests are answered slowly, I'm left waiting (and then thinking, "Oh no - I've mistyped the endpoint URL." or something similar). Initially I think I have two requests for guidance: 1. Is there a better way, using the BaseX GUI (or the command line), to get feedback on a querying process like this? Something... asynchronous, or something clever with builtin functions in the `jobs` or `xquery` modules? 2. If this can be addressed relatively directly with RESTXQ, I'm game to (finally) get more comfortable with it, but does anyone have any examples, applications, scripts, etc they would be willing to share? I want to say that several examples and ideas have been shared before here on the list, but I'm having a terrible time finding them. I've attached a simple SSCCE, where the basic idea is: query an API for some data, and get a response like so: <example> <stuff>...</stuff> <resumptionToken>abc123</resumptionToken> </example> then take the text() of the resumptionToken, and resubmit a request to the API, which would return: <example> <stuff>...</stuff> <resumptionToken>def456</resumptionToken> </example> The full responses are written to the temp directory on your system (file:temp-dir()), with a date-stamp name. The endpoint in my attached example has a fairly small response from what I've selected, but the idea would be: how let me (or another user) know that the query is active and running, not hung up or failing? I understand that given the functional nature of XQuery these sorts of things can be a bit more complicated, so I would appreciate any thoughts, opinions, links, etc. Many thanks for your time and trouble. Best, Bridger PS the endpoint in the example doesn't necessarily exhibit the same slow behavior that is the basis for my woes -- for some list readers it may be very fast indeed -- but I felt like it might be apropos to use this particular endpoint for an illustration.

2 3

Module imports are not transitive?
by Andy Bunce 24 Nov '21

24 Nov '21

Hi, "Module imports are not transitive—that is, importing a module provides access only to function and variable declarations contained directly in the imported module. For example, if module A imports module B, and module B imports module C, module A does not have access to the functions and variables declared in module C." https://www.w3.org/TR/xquery-30/#id-module-import I have noticed before that BaseX does not appear to implement this see [1] My case was a conflict in a module that was imported internally within an EXpath Package and the same namespace used as a module in an application. I have just seen another example today where the current behavior was regarded as a "good" feature. I don't remember ever seeing any discussion on this. Is this something that might be implemented at some point? /Andy [1] https://gist.github.com/apb2006/9702104456e5ee2c48f4ff4f9eba5c1b#file-main-…

2 1

Question about ft:normalize
by Tim Thompson 24 Nov '21

24 Nov '21

Hello, I have a question about the BaseX ft:normalize function. What kind of Unicode normalization is performed by this function, and how might it be implemented using standard XPath functions? Thanks in advance! Tim -- Tim A. Thompson (*he, him*) Librarian for Applied Metadata Research Yale University Library www.linkedin.com/in/timathompson timothy.thompson(a)yale.edu

2 5

random items not sorted
by Tom De Herdt 24 Nov '21

24 Nov '21

Hi, While doing some tests, I noticed an unexpected query result in Basex 9.6.3 (on Windows 10). This query: let $ids := for $i in 1 to 10 return random:uuid() for $id in $ids order by $id return $id ... returns 10 UUIDs, but they are /not/ sorted. Information from the Info pane in the GUI: Compiling: - rewrite range expression to range sequence: (1 to 10) - rewrite simple map to util:replicate(items,count[,multiple]): (1 to 10) ! random:uuid() -> util:replicate(random:uuid(), 10, true()) - inline for $i_1 in (1 to 10) - simplify FLWOR expression: util:replicate(random:uuid(), 10, true()) - inline let $ids_0 := util:replicate(random:uuid(), 10, true()) - rewrite fn:sort(items[,collation[,function]]) to util:replicate(items,count[,multiple]): sort(util:replicate(random:uuid(), 10, true())) -> util:replicate(random:uuid(), 10, true()) - inline for $id_2 in util:replicate(random:uuid(), 10, true()) - simplify FLWOR expression: util:replicate(random:uuid(), 10, true()) Optimized Query: util:replicate(random:uuid(), 10, true()) In Basex 9.3.2 (on another Windows machine) items are sorted alphabetically, as I would expect them to be – but I may be overlooking something. Any ideas? Thanks, Tom De Herdt

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk November 2021