BaseX-Talk January 2023

basex-talk@mailman.uni-konstanz.de

20 participants
26 discussions

BaseX 9.6: The Summer Edition
by Christian Grün 28 Nov '24

28 Nov '24

Dear all, We provide you with a new and fresh version of BaseX, our open source XML framework, database system and XQuery 3.1 processor: https://basex.org/ Apart from our main focus (query rewritings and optimizations), we have added the following enhancements: XQUERY: MODULES, FEATURES - Archive Module, archive:write: stream large archives to file - SQL Module: support for more SQL types - Full-Text Module, ft:thesaurus: perform Thesaurus queries - Fulltext, fuzzy search: specify Levenshtein limit - UNROLLLIMIT option: control limit for unrolling loops XQUERY: JAVA BINDINGS - Java objects of unknown type are wrapped into function items - results of constructor calls are returned as function items - the standard package "java.lang." has become optional - array arguments can be specified with the middle dot notation - conversion can be controlled with the WRAPJAVA option - better support for XQuery arrays and maps WEB APPLICATIONS - RESTXQ: Server-Timing HTTP headers are attached to the response For a more comprehensive list of added and updated features, look into our documentation (docs.basex.org) and check out the GitHub issues (github.com/BaseXdb/basex/issues). Have fun, Your BaseX Team

11 43

recursively used variables
by Rob Stapper 12 Aug '24

12 Aug '24

Hi, The code[1] below and send as attachment generates a error message: “Static variable depends on itself: $Q{http://www.w3.org/2005/xquery-local-functions}test”. I use these variables to refer to my private functions in my modules so I can easyly refer to them in a inheritance situation. It’s not a big problem for me but I was wondering if the error-triggering is justified or that it should work. [1]=========================================== declare variable $local:test := local:test#1 ; declare %private function local:test( $i) { if ( $i > 0) then $local:test( $i - 1) } ; $local:test( 10) =========================================== Kind regards, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

4 7

xslt:transform-report result
by Andy Bunce 11 Mar '24

11 Mar '24

Hi, Using BaseX 9.7.1 and saxon9he-9.9.1.jar The documentation suggests the ?result from xslt:transform-report should be *a* document-node where possible [1] This seems not quite to be the case when there are processing instructions or comments at the top level. In these cases a sequence of document-nodes is returned. /Andy [1] https://docs.basex.org/wiki/XSLT_Module#xslt:transform-report let $xslt:=<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="3.0"> <xsl:mode on-no-match="shallow-copy"/> </xsl:stylesheet> let $xml:=document{ <?something type="compact"?>, <foo/>} return xslt:transform-report($xml,$xslt) Returns map { "messages": (), "result": (<?something type="compact"?>, <foo/>) }

3 7

PHP Client Session Object: infinite loop in read method when bpos is null
by Tamara Marnell 13 Jul '23

13 Jul '23

Hello everyone, Once in a while, my server running BaseX will suddenly experience a big spike in write operations, the hard disk space will fill up to 100%, and the whole server will lock up. I can't say what initiates this, because the logs and metrics disprove every theory I can think of. (There's nothing unusual in the access logs or BaseX data logs, memory usage stays consistently at 45% and CPU usage at 5%, no user attempted anything like a huge bulk upload, etc.) However, one thing that always happens during these incidents is that the Apache error log blows up to a crazy size like 1 GB, filled with the message: PHP Notice: Trying to access array offset on value of type null in /[path]/client/session.php on line 164 This line is in the read method of the Session class from GitHub, and it indicates that the byte position passed to the buffer property is null. My error log probably fills up because read() is called by readString() in a while loop that never terminates. There might be extraordinary circumstances in which during construction, socket_connect returns "true" but the response is not valid or expected. -Tamara -- Tamara Marnell Program Manager, Systems Orbis Cascade Alliance (orbiscascade.org <https://www.orbiscascade.org/>) Pronouns: she/her/hers

2 5

Different results when importing HTML documents
by Timothée 02 Feb '23

02 Feb '23

Hello all, I am trying to store HTML documents in BaseX. I setup a local instance of BaseX on my computer using Docker, and I imported this file in it: https://pastebin.com/HJdJgLv9 On my local BaseX instance, the document is imported and "/html/body/article" does return the <article> node as expected. On my remote/production BaseX instance (using the same Dockerfile and image), the document is imported but the <article> tag is "stripped" (even though its contents / child nodes remain in the imported document). "/html/body/article" is empty. If I copy over the .basex files from my local database to my remote database, then the documents are complete like on my local instance. I also tried to import the documents again on my local instance, and the <article> tag gets stripped too (and the child nodes remain). What am I doing wrong when importing my documents? What did I do to import them properly in my current local instance? I tried a lot of options but I just can't figure out why this happens (I fiddled a lot with it). I used the following options when importing my documents, as per the documentation: SET PARSER html SET HTMLPARSER method=xml,nons=true,nocdata=true,nodefaults=true,nobogons=true,nocolons=true,ignorable=true SET CREATEFILTER *.html I also use SET FTINDEX true but I don't think it would have an impact anyway. Thank you very much! - Tim

2 3

bug in BaseX104 with function arity determination
by Rob Stapper 31 Jan '23

31 Jan '23

Hi Christian, See attachment. When running, function ‘local:test1a’ triggers an error: ‘[XPTY0004] 2 arguments supplied, 3 expected: $f’. It looks like the arity of a function is incorrectly determined when called with a partial parameter set. ‘function ‘local:test1b’ is a workaround. Can you please have a look at this? Thanx in advance, Rob Stapper Sent from Mail for Windows -- This email has been checked for viruses by Avast antivirus software. www.avast.com

2 3

BaseX bug report
by Veysel Karslı 23 Jan '23

23 Jan '23

Hello, We got an error about BaseX. We connect BaseX Java Server from our application developed with C#. Thank you for your support. Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 10.3 Java: Oracle Corporation, 19.0.1 OS: Windows Server 2019, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: Index 4304 out of bounds for length 4096 at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:160) at org.basex.data.Data.kind(Data.java:312) at org.basex.query.up.atomic.AtomicUpdateCache.adjustDistances(AtomicUpdateCache.java:320) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:276) at org.basex.query.up.DataUpdates.apply(DataUpdates.java:167) at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) at org.basex.query.up.Updates.apply(Updates.java:179) at org.basex.query.QueryContext.update(QueryContext.java:660) at org.basex.query.QueryContext.lambda$4(QueryContext.java:354) at org.basex.query.QueryContext.run(QueryContext.java:763) at org.basex.query.QueryContext.iter(QueryContext.java:354) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:95) at org.basex.server.ServerQuery.execute(ServerQuery.java:125) at org.basex.server.ClientListener.query(ClientListener.java:397) at org.basex.server.ClientListener.run(ClientListener.java:104) -- Veysel Karslı Managing Partner & Co-founder M +90 543 238 8328 E veysel.karsli(a)codease.io CodEase Teknoloji Barbaros mh. Begonya sk. No:1/2 Ataşehir / İstanbul www.codease.io

2 2

Symlinks bug in webapp
by Jerome Chauveau 23 Jan '23

23 Jan '23

Hello, Symlinks seem to be not fonctional anymore since BaseX10 (Maybe before) in webapps. Is it due to a new version of Jetty ? I pushed a dummy example on that repository : [ https://git.unicaen.fr/chauveau/test-basex-symlinks | https://git.unicaen.fr/chauveau/test-basex-symlinks ] Thanks for your help ! Jérôme

2 4

Integrating BaseX With Server-Side Python
by Eliot Kimber 23 Jan '23

23 Jan '23

I’ve started implementing some sophisticated DITA data processing in Python, including using the Python xlsxwriter to easily generate Excel spreadsheets, something that would be more work to add to BaseX using Java and the Apache POI libraries. I’m also seeing that the Python streamlit tool, which provides sophisticated web pages for visualizing Python-based data (i.e., graphing from Pandas dataframes) would be a convenient way to generate graphs. I’m wondering: 1. Has anyone integrated streamlit with BaseX, for example, by running a streamlit server and using iframes from BaseX-served web pages to deliver graphs and whatnot. If so, are there any particular concerns or is it as simple running the server and creating the iframe? 2. What would be the best way to run or access Python scripts from BaseX server, for example, to run a script that will generate an Excel sheet from some data on the server (or provided by BaseX in some convenient form) and then serve the generated result back out? I think it should be as easy as using the process module to run Python commands from the command line, but again, wondering if there are any non-obvious considerations? Part of my new focus on Python is that my colleagues are Python-literate but not XQuery or XSLT literate, so it turns out to be best for us to do as much in Python as possible. But also the cost of doing really cool things in Python is just really low, streamlit being a good example. Thanks, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 1

Socket specifications?
by Ben Engbers 21 Jan '23

21 Jan '23

Hi, When I developed the Basex client for R, I ran into problems with the socket for a long time. In the end it turned out that in R I had to configure the socket as a non-blocking socket. This solved all performance issues! I am now trying to develop a client for SWI-prolog. Because that low-level compiler doesn't support using sockets enough, I need to develop a library in C++ first. And in doing so, I again run into problems with the socket. The basex documentation just says to use a socket. But there is no information on how to configure the socket itself. My question is how do I configure the client side of the socket for optimal use? Ben Engbers

3 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk January 2023