BaseX-Talk February 2021

basex-talk@mailman.uni-konstanz.de

10 participants
17 discussions

recursively used variables
by Rob Stapper 12 Aug '24

12 Aug '24

Hi, The code[1] below and send as attachment generates a error message: “Static variable depends on itself: $Q{http://www.w3.org/2005/xquery-local-functions}test”. I use these variables to refer to my private functions in my modules so I can easyly refer to them in a inheritance situation. It’s not a big problem for me but I was wondering if the error-triggering is justified or that it should work. [1]=========================================== declare variable $local:test := local:test#1 ; declare %private function local:test( $i) { if ( $i > 0) then $local:test( $i - 1) } ; $local:test( 10) =========================================== Kind regards, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

4 7

Autocomplete with RESTXQ
by Imsieke, Gerrit, le-tex 21 Jul '21

21 Jul '21

Hi List, Can anyone recommend a lightweight vanilla Javascript autocomplete library that can easily be used together with BaseX RESTXQ? Maybe even a readily cloneable/modifiable example? I don’t have a preference for a server response format. The RESTXQ service may be configured to return XML, JSON, or HTML No CORS restrictions need to be considered, the query host is the same that delivers the HTML pages. Gerrit

4 7

Package for system integration
by karlo＠fastmail.com 20 Jun '21

20 Jun '21

I have packaged basex in a way that I believe will be easier for integration with package managers. https://klarinet.kos.ovh/fossil/basex-root-install/uv/basex-9.4.3.tar.gz >From the root of that archive, you can build and install like this. make make install # as root The above will install to the prefix /usr/local. You can set a different prefix. Here is an example. make clean make PREFIX=/usr make PREFIX=/usr install # as root A secondary benefit of this package is the removal of the bash dependency. Could a package like this be distributed officially? If that is agreeable, I am happy to try incorporating this into the present build system. Here is a utility for preparing the package. It depends on sh and other Unix-like utilities. https://klarinet.kos.ovh/fossil/basex-root-install/dir?ci=tip With distinguished salutations, Kralj Karlo

3 6

BaseX 9.4.2: Tweaks & Fixes
by Christian Grün 02 Apr '21

02 Apr '21

Dear all, We have released another 9.4 late-summer maintenance release with new performance tweaks and minor bug fixes: http://basex.org In addition, we have started a new Wiki article on XQuery optimizations, which we plan to extend step by step: https://docs.basex.org/wiki/XQuery_Optimizations We are looking forward to your feedback; have fun, Your BaseX Team

2 7

Options for ft:search
by Sebastian Zimmer 15 Mar '21

15 Mar '21

Hi, I'd like to request a feature concerning the ft:search method: An `lserror` option that works exactly like the global option `LSERROR`. It would be nice if we could set the maximum Levenshtein distance specifically for each fuzzy search without having to adjust the global option. Another question on ft:search: Is there a reason why it doesn't have a `case` option just like ft:contains has one? Best regards, Sebastian

2 3

BaseX 9.5: The Spring Edition
by Christian Grün 25 Feb '21

25 Feb '21

Dear all, we are more than happy to provide you with a new and fresh version of BaseX, our XML framework, database system and XQuery 3.1 processor: https://basex.org/ BaseX is getting faster and faster! We have spent most of our time on query rewritings and optimizations, which will speed up the execution of your XQuery code and RESTXQ apps. You can find various other new enhancements in our release: RESTXQ - the client IP address behind a proxy is added to the logs - stack traces in the error message can now be suppressed - the default error code has been changed from 400 to 500 - error messages are more user-friendly now (#1708) - content negotiation was improved (#1991) - inline arguments of called function (#1982) XQUERY FUNCTIONS - Utility: new functions for sequences, arrays and maps - Higher-Order Functions: hof:drop-while - Jobs: More options for job intervals XQUERY PERFORMANCE - revised scoring propagation (all items will take less memory) - default function inlining limit reduced from 100 to 50 - axis path rewritings, better typing (#1910, #1976, #1979) - better typing (#1906, #1908, #1909, #1944, #1945) - faster data()/string() checks (#1975) - rewrite map:merge to map:put (#1969) - rewrite order by to fn:sort (#1966) - rewrite group by to fn:distinct-values (#1932) - rewrite quantifiers to FLWOR expressions (#1961) - optimizations of arithmetic expressions (#1938, #1972) - optimizations of lookup operator (#1929, #1984) - optimizations of counts (#1965, #1973, #1974) - optimizations of regular lists (#1919, #1924) - optimizations of switch expression (#1920) - optimizations of instance of (#1939) - distinct values (#1930, #1967) - positional checks (#1937) - existence checks (#1971) For a more comprehensive list of added and updated features, check out our documentation (docs.basex.org) and check out the GitHub issues (github.com/BaseXdb/basex/issues). Have fun, Your BaseX Team

3 2

BaseX, xinclude and xpointer
by pascaljoubaud＠gmail.com 19 Feb '21

19 Feb '21

Hello BaseX-Community, I'm a beginner with baseX so my questions may sound a bit weird. I hope not too much. I have a problem using xinclude in a baseX database. Basically i have a main file which contains this xinclude instruction : <xi:include href="EP15.xml" xpointer="element(EP15)"><xi:fallback><p>Pièce non encodée pour le moment.</p></xi:fallback></xi:include> In my baseX database i have my main file and the EP15.xml file which contains this instruction : <div type="Piece" xml:id="EP15">blabla<div> When i 'm looking to my main file in base X, i always have the fallback instruction displayed : <p>Pièce non encodée pour le moment.</p> I'm using baseX 9.3.2., the local option XINCLUDE is turned on. I have also tried to use direct xpath instead of a named element in my xpointer xpointer="element(/TEI/text/body/div[1])"> but the resultat is stille the same I'm a bit stuck at the moment.. Any help would be very much appreciated ! Thanks a lot Pascal

2 10

Nasty trap with RESTXQ content negotiation
by Marco Lettere 19 Feb '21

19 Feb '21

Dear all, First of all, I hope everything is fine and all of you are staying healthy! When I read again the docs about Content Negotiation in RestXQ I noticed the sentence: Functions can be restricted to specific Media Types. The default type is|*/*|. So I wrote the two RestXQ signaures [1] with the expectation of *fallback()* behaving as a catch-all for mime-types not declared in *specific(**)*. At that point, when calling the service with something stating "Content-Type: application/xml" BaseX yields the following error: Stopped at /....: [basex:restxq] Several functions found for path "test": - ccp_ui:test [text/plain] - ccp_ui:test2 [text/plain] If I specify an explicit %rest:consumes("*/*") in the annotations of fallback(), specific() correctly intercepts the request. Unfortunately at that point calling with "Content-Type: text/plain" which should slip through the functions and be catched by fallback() yields instead: No function found that matches the request. So there is no combination, to my knowledge, to implement my use-case correctly ... besides handling mime-types explicitly in code (which is rather uncomfortable). I'm using BaseX 9.4.5 at the moment. Do you have any hint on this? Thank you very much. Marco. [1] declare %rest:path("test") %rest:POST("{$body}") %rest:consumes("text/csv", "application/xml", "application/json") %output:method("text") function s:specific($body as document-node()) { "Treated as document" }; declare %rest:path("test") %rest:POST("{$body}") %output:method("text") function s:fallback($body as item()) { "Treated as binary" };

2 2

vanishing whitespace with fn:doc()
by Jos van den Oever 17 Feb '21

17 Feb '21

Dear all, First off: BaseX is great to work with. I use it for a few statically generated websites. But I recently found what might be a bug. Some whitespace vanishes when loading xml files. E.g. this xml file: ```test.xml <a> a b <a> c </a> d e </a> ``` run like this: doc('test.xml') gives: <a>a b<a>c</a>d e</a> But running this: ``` parse-xml('<a> a b <a> c </a> d e </a>') ``` retains the whitespace. I've tested this with BaseX 7.0, 8.0, 9.0 and 9.4.6. Running this in saxon-he-10.3.jar retains the whitespace. I can work around this issue by placing xml:space="preserve" in the document element. I cannot come up with a scenario in which discarding whitespace during is parsing is ok when no DTD or XML Schema is provided. Best regards, Jos

2 7

Re: [basex-talk] Jobs and file modules
by Christian Grün 16 Feb '21

16 Feb '21

There may be various solutions ;) A minimized code example that demonstrates your procedure could be helpful here. On Tue, Feb 16, 2021 at 3:21 PM Tim Thompson <timathom(a)gmail.com> wrote: > > Yes, the insert operations also involve lookups against a couple of full-text indexes (using ft:search()). The entries in the full-text indexes include corresponding unique identifiers (URIs). The query: > > iterates through a set of library catalog records > filters on certain elements > runs full-text lookups on the text (which are name or subject strings) > inserts a new element containing the URI from a match in the index. > Logs the result of the each lookup (using file:append-text-lines()) > > > I'm guessing that the index access is what slows things down the most. What would be the approach for combining updates? > > Thank you, > Tim > > > -- > Tim A. Thompson > Discovery Metadata Librarian > Yale University Library > > > > On Tue, Feb 16, 2021 at 4:53 AM Christian Grün <christian.gruen(a)gmail.com> wrote: >> >> Hi Tim, >> >> > Is it possible to put updating expressions in a library module function (with the name of the database hard coded) and then call from the function within jobs:eval() in a main module? >> >> Yes, it should be. Here’s a little example (create database 'x' first): >> >> lib.xqm: >> module namespace lib = 'lib'; >> declare %updating function lib:delete() { >> prof:sleep(1000), >> delete node db:open('x')//x >> }; >> >> query.xq: >> let $id := jobs:eval(" >> import module namespace lib='lib' at 'lib.xqm'; >> lib:delete() >> ") >> return (prof:sleep(500), jobs:list-details($id)) >> >> The query result looks something like this: >> >> <job id="job29" type="QueryJob" state="running" user="admin" >> duration="PT0.498S" reads="(none)" writes="x" >> time="2021-02-16T10:40:57.605+01:00">import module namespace lib='lib' >> at 'lib.xqm'; lib:delete()</job> >> >> If the name of the database is found in the "writes" attribute, you’ll >> know that only this database will be write-locked. >> >> However, please note that, due to random file access patterns, >> parallel writes are often slower than consecutive ones (even with >> SSDs), so my guess is that you won’t save a lot. >> >> 48 hours sounds a lot indeed. It’s usually much, much faster to run a >> single XQuery expression that performs 1000 updates than running 1000 >> independent queries. Could you give us more information on the insert >> operations you need to perform? Is there any chance to combine >> updates? >> >> Best, >> Christian

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk February 2021