- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Problem with creating new database from GUI
by Christian Grün 08 Aug '23

08 Aug '23

Hi Andreas (cc to the list), Thanks for forwarding the error message, which indicates that removed »Text Parser« may have caused the problem [1]. Good to know it works again. Best, Christian [1] https://docs.basex.org/wiki/Parsers#Changelog On Mon, Aug 7, 2023 at 5:57 PM Andreas Hartmann <andreas.hartmann(a)gmx.org> wrote: > Hi Christian, > > > > in fact I installed BaseX from the .exe. I did now try the .jar and .zip > and those work without any problems. Then I did a clean reinstall with the > .exe and this seems to have fixed the problem. This is the first time I had > problems with installing a new version over an existing installation. > > > > For what it’s worth, when starting the jar-file from the .exe before the > reinstall and clicking on the icon I got in the command line: > > > > Exception in thread "AWT-EventQueue-0" > java.lang.ArrayIndexOutOfBoundsException: Index 3 out of bounds for length 3 > > at > org.basex.gui.dialog.DialogParsing.setType(DialogParsing.java:79) > > at org.basex.gui.dialog.DialogImport.action(DialogImport.java:165) > > at org.basex.gui.dialog.DialogNew.action(DialogNew.java:115) > > at org.basex.gui.dialog.DialogNew.<init>(DialogNew.java:105) > > at org.basex.gui.GUIMenuCmd$1.execute(GUIMenuCmd.java:40) > > at > org.basex.gui.layout.BaseXButton.lambda$command$2(BaseXButton.java:115) >

2 2

Problem with creating new database from GUI
by Andreas Hartmann 07 Aug '23

07 Aug '23

Hello, since I updated to 10.7 I can no longer create a new database from the GUI. Neither clicking on the icon nor the shortcut CTRL+N cause the database creation window to open. Using the menu also has no effect. The other icons work normally. Thanks, Andreas

2 1

Re: [basex-talk] BaseX 10.7: The Summer Edition
by Christian Grün 07 Aug '23

07 Aug '23

Hi Yitzhak, The documentation in our wiki will be made available with version 11, but you can already browse through the current drafts of the specifications. Many of the listed features are already working: https://qt4cg.org/specifications/xpath-functions-40/Overview.html#changelog https://qt4cg.org/specifications/xquery-40/xquery-40.html#id-revision-log Hope this helps, Christian On Sun, Aug 6, 2023 at 3:53 AM <ykhabins(a)bellsouth.net> wrote: > Congrats on the new BaseX 10.7 release! > > > > >> “We have added numerous new operators, functions and features of XQuery 4.“ > > How to find that new XQuery 4 functionality in the BaseX wiki? > > Is their a particular keyword for that? > > > > > > > *Regards,Yitzhak Khabinsky* > > >

1 0

Webapp authentication flow – how do sessions work?
by Jack Steyn 03 Aug '23

03 Aug '23

Hi all, I'm trying to develop a single-page application in Vue where users can log in and out and have different levels of access. I've more or less cribbed the relevant authentication and permissions code from the DBA webapp (which is not single-page). When I test the API in a program like Postman or Insomnia, everything works as expected. However in the browser I can login successfully but I can't then access any RESTXQ functions which I haven't marked as public with the %perm:allow and %perm:check functions. The core problem is that I don't really understand how sessions work, but it seems like the session isn't persisting across requests that my Vue webapp is sending. Do I need to add something in my webapp code that is being handled automatically when I use the DBA webapp or my API testing software? Any advice would be greatly appreciated. Kind regards, Jack

1 1

Decoding error
by Graydon Saunders 19 Jul '23

19 Jul '23

Hello -- I have some mainframe files which start off in no-known-encoding. Using Basex 10.6, I'm trying to use the bin module to make some character substitutions so the content of these files can be UTF-8. let $charMap as map(*) := map { 33: 93, (: exclamation point ! to close bracket ] :) 162: 91, (: cent-sign ¢ to open bracket [ :) 124: 33, (: pipe character | to exclamation point ! :) 160: 32, (: non-breaking space to plain space :) 26: 32 (: U+001A SUBSTITUTION CHARACTER at the end of the file; do not want :) } let $fromList as xs:integer+ := map:keys($charMap) let $fileList as xs:string+ := file:children($localPath) for $x in $fileList return (file:read-binary($x) ! bin:to-octets(.) ! (if (. = $fromList) then $charMap(.) else .) ! bin:from-octets(.) ! bin:decode-string(.,'UTF-8')) => string-join('') Four of the five sample files work; one of them returns "Decoding error: xff" If I restrict the process to the problematic file and use return (file:read-binary($x) ! bin:to-octets(.) ! (if (. = $fromList) then $charMap(.) else .)) => distinct-values() => sort() I don't find a 255 value. And I'm pretty sure all the codepoints I do have are simple, less than 255, single octet UTF-8 characters. Any suggestions for what I ought to be looking at? Thanks! Graydon -- Graydon Saunders | graydonish(a)fastmail.com Þæs oferéode, ðisses swá mæg. -- Deor ("That passed, so may this.")

3 3

How to get stack trace from an Query Exception?
by Eliot Kimber 13 Jul '23

13 Jul '23

The docs for Try/Catch in in the XQuery_3.0 page say: · $err:additional: error stack trace However, in my testing, this only returns the place where the error was thrown, not the complete stack trace as is shown e.g., in a web app when an exception is thrown. Is it possible to get the stack trace in XQuery? I didn’t find anything searching on the BaseX-supplied DBA app. Thanks, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 1

PHP Client Session Object: infinite loop in read method when bpos is null
by Tamara Marnell 13 Jul '23

13 Jul '23

Hello everyone, Once in a while, my server running BaseX will suddenly experience a big spike in write operations, the hard disk space will fill up to 100%, and the whole server will lock up. I can't say what initiates this, because the logs and metrics disprove every theory I can think of. (There's nothing unusual in the access logs or BaseX data logs, memory usage stays consistently at 45% and CPU usage at 5%, no user attempted anything like a huge bulk upload, etc.) However, one thing that always happens during these incidents is that the Apache error log blows up to a crazy size like 1 GB, filled with the message: PHP Notice: Trying to access array offset on value of type null in /[path]/client/session.php on line 164 This line is in the read method of the Session class from GitHub, and it indicates that the byte position passed to the buffer property is null. My error log probably fills up because read() is called by readString() in a while loop that never terminates. There might be extraordinary circumstances in which during construction, socket_connect returns "true" but the response is not valid or expected. -Tamara -- Tamara Marnell Program Manager, Systems Orbis Cascade Alliance (orbiscascade.org <https://www.orbiscascade.org/>) Pronouns: she/her/hers

2 5

sequences after the path operator
by Graydon Saunders 07 Jul '23

07 Jul '23

Hello -- Using BaseX 10.6, the test query let $test as xs:string := "And O Lord the pride of man, broken in the dust again" let $syntax1 as xs:string := analyze-string($test,'\p{Lu}')/(fn:match/concat('[',.,']'),fn:non-match/string()) => string-join('') let $syntax2 as xs:string := analyze-string($test,'\p{Lu}')/*/(self::fn:match/concat('[',.,']'),self::fn:non-match/string()) => string-join('') return ($syntax1,$syntax2) produces [A][O][L]nd ord the pride of man, broken in the dust again [A]nd [O] [L]ord the pride of man, broken in the dust again I'm surprised by this, because I expected document order to apply to the result of analyze-string and for syntax1 to work in the sense of having the results emerging in the same order as the input. Have I miscomprehended something? Anyone care to have a go at explaining why syntax1 doesn't maintain the order of the input? (I'm possibly mistakenly confident that I understand why syntax2 does.) Thanks! Graydon -- Graydon Saunders | graydonish(a)fastmail.com Þæs oferéode, ðisses swá mæg. -- Deor ("That passed, so may this.")

2 2

Apparent bug when setting @xml:base on element with @base
by Eliot Kimber 07 Jul '23

07 Jul '23

This XQuery demonstrates the problem: (:--------:) let $xmlBaseAtt as attribute() := attribute {'xml:base'}{'/foo/bar.xml'} let $transformed1 as element() := try { $doc1 transform with { insert node $xmlBaseAtt into .} } catch * { <error code="{$err:code}" desc="{$err:description}" object="doc1"/> } let $transformed2 as element() := try { $doc2 transform with { insert node $xmlBaseAtt into .} } catch * { <error code="{$err:code}" desc="{$err:description}" object="doc2"/> } return ( ``[No @base attribute:]`` ,$transformed1 ,``[Has @base attribute:]`` ,$transformed2 ,() ) (:--------:) The results I get with 10.6 are: No @base attribute: <root xml:base="/foo/bar.xml"/> Has @base attribute: <error code="err:XUDY0021" desc="Duplicate attribute name: xml:base." object="doc2"/> It looks like the transform processor is matching @xml:base to @base even though they are different attributes. Is this a bug or is there a different way I should be specifying the @xml:base attribute? This is an issue because @base is a DITA-defined attribute that occurs on elements on which I need to set @xml:base (which is how I found the problem). Cheers, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 1

Whitespaces not preserved in TEI documents.
by Montserrat Matías 06 Jul '23

06 Jul '23

Hello. I have a bug with BaseX version 10 and higher related to handling whitespaces in documents with mixed content elements. I'm working with narrative documents (TEI). Following the instructions in the documentation about this type of documents (containing mixed elements) I have disabled the indentation and the STRIPWS option. When I execute queries with connection to the database, the result is as explained in the documentation (blanks are preserved). However, when I use the BaseX libraries to execute queries in a local context (without a connection to the database) the spaces are sometimes removed. Same error if I run the query in the Database Administration interface. Query: db:option('stripws') Result: false Query: db:option('serializer') Result: map{"omit-xml-declaration":"yes","binary":"yes","method":"basex","use-character-maps":"","tabulator":"no","allow-duplicate-names":"no","media-type":"","doctype-public":"","escape-uri-attributes":"no","standalone":"omit","csv":map{"lax":true(),"backslashes":false(),"separator":"comma","allow":"","header":false(),"quotes":true(),"format":"direct"},"indents":2,"json-node-output-method":"xml","json":map{"escape":true(),"strings":false(),"lax":false(),"indent":(),"format":"direct","merge":false()},"doctype-system":"","item-separator":(),"indent":"no","suppress-indentation":"","byte-order-mark":"no","include-content-type":"yes","encoding":"UTF-8","newline":"\n","normalization-form":"none","html-version":"","version":"","limit":-1,"undeclare-prefixes":"no","cdata-section-elements":"","parameter-document":""} Query: let $doc := <doc><entry><sense id='1'><def>Gente grosera o vulgar.</def><cit><quote><seg>La</seg> <oRef>chusma</oRef>.</quote></cit></sense></entry></doc> return $doc/entry//sense[@id = '1'] Result: <sense id="1"><def>Gente grosera o vulgar.</def><cit><quote><seg>La</seg><oRef>chusma</oRef>.</quote></cit></sense> The whitespace contained between the </seg> and <oRef> tags has been stripped. In version 9.3.5 this problem did not occur. Can you please have a look at this? In a TEI document whitespaces are important. Thanx in advance, Montse. ___________________________________________ NOTA LEGAL El contenido de este mensaje de correo electrónico, incluidos los ficheros adjuntos, es confidencial y está protegido por el artículo 18.3 de la Constitución española, que garantiza el secreto de las comunicaciones. Si usted recibe este mensaje por error, le rogamos que se ponga en contacto con el remitente para informarle de este hecho y no difunda su contenido ni haga copias. La Real Academia Española informa de que los datos que en esta comunicación figuran, así como los que mantiene de usted y/o de su empresa, son tratados con la finalidad de mantener el contacto, así como de realizar las gestiones que en esta aparecen, y son utilizados de forma autorizada por las partes y sin cederse a terceros ajenos. Puede ejercer sus derechos a través de proteccion_de_datos(a)rae.es<mailto:proteccion_de_datos@rae.es>. Puede obtener más información sobre protección de datos en nuestra página web<https://www.rae.es/aviso-legal> o contactando directamente con nosotros (Reglamento UE 2016/679).

3 7

Determining if a node is a database node
by Eliot Kimber 06 Jul '23

06 Jul '23

I need to be able to determine if an arbitrary node is or is not a database node. I implemented this function: declare function util:isDatabaseNode($node as node()) as xs:boolean { let $isDbNode as xs:boolean := try { let $nodeId as xs:integer? := db:node-id($node) (: let $msg := prof:dump(``[[DEBUG] relpath:isDatabaseNode(): nodeId: "`{$nodeId}`"]``) :) return exists($nodeId) } catch * { (: let $msg := prof:dump(``[[DEBUG] relpath:isDatabaseNode(): Got exception `{$err:code}` - `{$err:description}`]``) :) (: return :) false() } let $msg := prof:dump(``[[DEBUG] relpath:isDatabaseNode(): Returning `{$isDbNode}``]``) return $isDbNode }; With the prof:dump() calls commented out as shown here, it always returns true, even when it returned false. If I comment in the prof:dumps then I get the expected correct false result. This must be the result some optimization at compile time but I haven’t been able to find a construction of this function that works without the debug messages. Is there a better way to determine if a node is a database node? This is with 10.6. Cheers, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 3

Possible bug in the interaction between db:attribute(), data() and Sequences.
by Andreas Hengsbach | nexoma 05 Jul '23

05 Jul '23

Hello all, we have probably found a bug, the cause of which is currently unclear to us. Fortunately, the problem is reproducible in a small test case. Steps to reproduce the problem: 1. import the following XML into a BaseX database "testcase". ### schnipp <attributes foo="bar"> <attribute name="test1" seq="foo"/> <attribute name="test2"/> <attribute name="test3" seq="bar"/> </attributes> ### schnapp 2. make sure that an attribute index has been created. 3. execute the following script. ### schnipp let $source := db:attribute('testcase', 'bar', 'foo')/.. let $value := ( $source/attribute[@name="test1"]/@seq/data(), $source/attribute[@name="test2"]/@seq/data(), $source/attribute[@name="test3"]/@seq/data() ) return ( $value[2] => inspect:type() ) ### schnapp Explanation: The example is really only meant as a test case. For our case we have already found a workaround, so we don't have a serious problem. The important thing is that the element is read from the database via db:attribute() and then the individual values are combined again into a sequence. In doing so, we get an untypedAtomic from attribute test1, an empty-sequence() for test2 and an untypedAtomic again for test3. Observation: When we read the second value of the sequence by index ($value[2]), we get back an "attribute()" instead of an untypedAtomic. Expectation: We would expect an untypedAtomic here again. Workaround: We simply used string() instead of data() to explicitly cast the value to a string. Versions: We were able to reproduce the problem with 10.4 and the current 10.6. With a very old version 7.9, however, it was not reproducible. Many thanks and best regards Andreas

2 2

Performance of db:get-value() for large maps
by Eliot Kimber 03 Jul '23

03 Jul '23

I’m working on constructing DITA key spaces for our content. My current implementation builds an XQuery map that contains the key space data as well as the XML data from which the key space was constructed, which can be quite a bit (1-2 megabytes of XML all told—key space construction effectively requires constructing a single “resolved” DITA map from a tree of map documents, which I’m then storing in my key space map). A given key space might have 100,000 individual name-to-element mappings in addition to the raw DITA content. I tried saving these maps into a database using db:put-value(), which worked. But, when I went to fetch them back out, it took 30 seconds to fetch one of these maps. My expectation was that retrieving a map would be quite fast. I’m sure that it was silly to try to store all the raw markup in these maps, and I will change that aspect of my implementation to store the resolved maps separately and then use node IDs in the key space map. Worst case I can do what I have been doing with BaseX 9 and convert the XQuery map to an XML representation and use that for retrieval, which of course will work fine, at the cost of more code and a few more milliseconds of ingestion processing. Before I spend any more time trying to optimize the storage and retrieval of these maps, I wanted to ask a few questions: 1. Is my expectation that map retrieval should generally be very fast correct, modulo not having gobs of raw XML in them? 2. Is there a more efficient way to query over maps that are stored in a database? My initial attempt was to simply pull the entire map from the database and then operate on it as I would any other map, i.e.: $keySpace as map(*) := getKeySpace($rootMap) (: Pulls the map from the database :) $keydefs as element()* := $keySpace?keyscopes?($scopeKey)?keydefs?($keyName) 3. Is there some other maps-in-a-database optimization technique I’m overlooking? Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 2

Calling a Java function with varargs parameter from XQuery
by Lizzi, Vincent 03 Jul '23

03 Jul '23

Hello BaseX people, The Java language bindings in BaseX look like a very good way to use Java libraries from XQuery. I'm currently trying to use Lingua (https://github.com/pemistahl/lingua) with BaseX, and mostly have it working, but I've not been able to figure out how to call a Java function that takes a vararg (variable arguments) parameter. Here is a bit of XQuery code that shows the problem. I'm using BaseX version 10.6 and the jar for Lingua version 1.2.2 has been added to the classpath. This query should return a LanguageDetectorBuilder object. declare namespace Builder = "java:com.github.pemistahl.lingua.api.LanguageDetectorBuilder"; declare namespace Detector = "java:com.github.pemistahl.lingua.api.LanguageDetector"; declare namespace Language = "java:com.github.pemistahl.lingua.api.Language"; let $builder := Builder:fromLanguages( [ Language:ENGLISH(), Language:DUTCH(), Language:GERMAN(), Language:SPANISH(), Language:FRENCH() ] ) return $builder The above code produces this error message in the BaseX GUI: [XPTY0004] com.github.pemistahl.lingua.api.LanguageDetectorBuilder:fromLanguages(com.github.pemistahl.lingua.api.Language[]) expected, (CArray) found. If I try making the parameter a sequence instead of an array, replacing () parenthesis for the [] brackets, then this is the error message: [XPTY0004] com.github.pemistahl.lingua.api.LanguageDetectorBuilder:fromLanguages(com.github.pemistahl.lingua.api.Language[]) expected, (List) found. I've read through the Java Bindings page in the wiki and tried to rewrite the parameter in different ways, but so far have only gotten different error messages. The signature for the fromLanguages function can be seen at https://github.com/pemistahl/lingua/blob/main/src/main/kotlin/com/github/pe… Is there a way to make this work? Thanks, Vincent ______________________________________________ Vincent M. Lizzi Head of Information Standards | Taylor & Francis Group 530 Walnut St., Suite 850, Philadelphia, PA 19106 E-Mail: vincent.lizzi(a)taylorandfrancis.com<mailto:vincent.lizzi@taylorandfrancis.com> Web: www.tandfonline.com<http://www.tandfonline.com> Taylor & Francis is a trading name of Informa UK Limited, registered in England under no. 1072954 "Everything should be made as simple as possible, but not simpler." Information Classification: General

2 4

Prolog and XQuery
by Ben Engbers 29 Jun '23

29 Jun '23

Hi, My ultimate goal is to investigate the advantages of using Prolog and XQuery together when querying XML files. In doing so, I want to take advantage of BaseX's XQuery engine. Since there is no Prolog client, I initially started writing a Prolog client. But in SWI-prolog, I did not manage to connect using the webconnection tools. So I first started to write a C++ client and then start writing a bridge in Prolog that uses that client. The starting point for the C++ client was the RBaseX client I published earlier. I converted all functionalities from that client to C++. A preliminary version of the C++ client can be found at https://github.com/BenEngbers/BasexCpp. As soon as I manage to create a real shared object using CMake I will publish a final version. Regarding the server protocol for BaseX, however, I still have a question. According to that protocol, the ADD command accepts 4 arguments ({09 {name} {path} {input} ). However, neither in R nor in C++ have I succeeded in using the {name} argument. My question is whether this is a bug in the protocol? I don't know if there is a need for a C++ client that implements the full server protocol but in any case I enjoyed working on this project. Have fun, Ben Engbers

2 1

Setting up redirects and https
by Eliot Kimber 28 Jun '23

28 Jun '23

I have a “production” BaseX server for our Mirabel system that is currently served on the old 8984 port. As it’s a dedicated server, I would like to serve it on port 80. But I also have users who use the current port, and I don’t want to disrupt them more than necessary when I make this change. I’d also like to start serving using HTTPS. Is there an easy way to set up a redirect from the old port to the new port? What is involved in serving BaseX over HTTPS? I’m using the built-in Jetty server and I suspect the answer is in the Jetty docs but I thought I’d ask here first before seeing of ChatGPT can get me close to a solution. Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 0

Dynamic path segment for websockets
by Marco Lettere 28 Jun '23

28 Jun '23

Dear all, so I just found out that it is not possible to create websockets bound to dynamic paths. If I try a websocket connection to declare %ws:connect('/notification/subject/{$subject}') function log:subject() {}; I get an error (without significant logs). Whereas declare %ws:connect('/notification/subject/one') function log:subject() {}; works well. Does this have a motivation? Is there another way of meeting the requirement of having dynamic websocket channels? Thanks in advance, Marco.

2 4

Values stored to a database vs using the new store
by Eliot Kimber 28 Jun '23

28 Jun '23

I’m coming up to speed on BaseX 10 and trying to understand the practical difference between using the built-in store (or a custom store) and simply saving values into a database. As far as I can tell from the docs the basic feature is the same: given e.g., a map with stuff in it, I can store the map to a database with the new db:put-value() function or to the build-in store (or a custom store) using store:put() and in both cases can get the map back. Given that the store is automatically persistent, it seems like the obvious choice if you’re using maps as a result caching technique, so I’m wondering what the reasons would be for not using it and using a database instead. I think the answer includes: * Databases provide locking semantics that the store does not—the store docs are clear that the store is non-deterministic and may have side effects. So if you need to ensure locking consistency, you want to use a database. * Custom stores require that you manage any required persistence yourself, while databases are inherently persistent. Have I missed any other important considerations? Without taking the time to do the measuring, I’m guessing that there is negligible performance difference between using the store and a database—I’d be very surprised if the underlying implementation was not based on the same code. In our Project Mirabel system I need to do caching of large query results, so being able to quickly and conveniently store maps is ideal and I’m very excited to take advantage of this new feature. Cheers, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 1

Variable value
by Giuseppe G. A. Celano 19 Jun '23

19 Jun '23

Hi, I have stambled upon an unexpected issue concerning the value of a variable (in BaseX 10.6), which seems to be affected by an independent function. I have a function like page:open-url($an1) which takes a url as a parameter and opens a document. The url usually consists of an invariable part + a final number that identifies different documents. If I only pass the final number of the url, the function, as expected, returns an error (because it tries to resolve a relative path pointing to no document). However, if I change the script into let $f := page:documents($an1, $an2) return page:open-url($an1) the function page:open-url($an1) works properly (i.e., the presence of the independent let clause seems to affect the value of the variable $an1): I would not expect this in a functional programming language like XQuery. I have posted a gist here [1], where there are more details (look at the very end of the script) Ciao, Giuseppe —— [1] https://gist.github.com/gcelano/31ef1880ac8439398c7f6de1de6d78d3

2 1

Minor GUI irritation
by Andy Bunce 19 Jun '23

19 Jun '23

Hi, In the GUI when viewing an open database with many namespaces via database -> properties->information. The properties window is excessively tall, often larger than the screen height. There seems to be extra blank space below the "Resource Properties" section and perhaps the namespaces section that could have a scroll bar if required. db:create("nstest",(1 to 60)!``[<foo xmlns="ns`{.}`" />]``,(1 to 60)!(. || ".xml")) Creates a database that shows the behavior on my screen. Seen with BaseXGUI 10.6 on windows, but I think I also saw it with v9. Regards /Andy [image: image.png]

2 2

Timeframe for supporting fn:load-xquery-module()?
by Andrew Sales 08 Jun '23

08 Jun '23

Hello, The docs say: "The three functions fn:transform, fn:load-xquery-module and fn:collation-key may be added in a future version of BaseX as their implementation might require the use of additional external libraries." Is there a timeframe for this? I'm interested in particular in the load-xquery-module() to enable an implementation of Schematron written in pure XQuery[1] to be portable between engines[2]. Many thanks, Andrew [1] https://github.com/AndrewSales/XQS [2] https://github.com/AndrewSales/XQS/issues/8

4 4

Possible to optimize XPath lookup by string match on element content?
by Eliot Kimber 07 Jun '23

07 Jun '23

In my application I load numerous Oxygen validation report reports, consisting of many <incident> elements, where each incident is associated with a specific input document, captured in a <systemID> element: <incident xmlns=http://www.oxygenxml.com/ns/report> <engine>oXygen</engine> <severity>error</severity> <description>Cannot find definition for key "image.install-store-app-menu-path". Key Scopes:[[bundle-itsm], [reuse], [reuse]]. Keys are gathered from: bundle-itsm-it-service-management.ditamap.</description> <systemID>/Users/eliot.kimber/git-basex/utah/doc/source/reuse/activation/install-store-apps-steps.dita</systemID> <profile>suite-prod</profile> <type>Key reference</type> <location> <start> <line>33</line> <column>26</column> </start> <end> <line>33</line> <column>61</column> </end> <length>35</length> </location> </incident> I need correlate these incidents to the docs as stored in the database, where the match is just on the filename, not any part of the path (although I could match on the part of the path starting with “doc/source”). In my testing, with about 27K of these incident elements, it takes about 60 seconds to build a set of maps where the keys are the filenames and the values are the sequences of <incident> elements that match a given filename, i.e.: let $incidentsByDoc as map(*) := map:merge( let $docNames as xs:string* := $incidents/report:systemID ! string(.) ! relpath:getName(.) => distinct-values() return for $docName in $docNames return map{ $docName : $incidents[report:systemID/text() contains text { '/' || $docName}] } ) I think the only optimization is to save the resulting map as an XML file or (with BaseX 10) just save the map for later use. But I’m curious if there’s some other XPath-level optimization that would make this lookup faster? I’m already using the text index via “contains text”, although I suspect that it’s not really offering an advantage over a simple ends-with(.) check. Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 1

Trying to apply Query Update 3.0 update/transform operations
by Eliot Kimber 03 Jun '23

03 Jun '23

I found my error: I was passing in a variable from outside the transform/update call, rather than using the context node. This is the correct invocation: return ( $inputMap transform with { local:resolveMaprefs(.) } ,() ) I also successfully applied the transform recursively, so I think I have, despite my best efforts, figured out how do this map resolution as efficiently as possible. Cheers, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 1

Trying to apply Query Update 3.0 update/transform operations
by Eliot Kimber 03 Jun '23

03 Jun '23

In the context of my attempt to implement DITA map resolution in BaseX, I’m experimenting with using the new XQuery update 3 in-memory updates, which seem to be just what I need. However, my test script fails with: Stopped at /Users/eliot.kimber/git/mirabel/src/main/xquery/resolve-map-test.xqy, 32/9: [XUDY0014] Node was not created by transform expression: <mapref.../>. What subtlety of XQuery update am I missing? The code works as expected through the start if the THEN clause when $refTarget exists (meaning the mapref was resolved to its target document and we’re trying to construct the new nodes. The script is: (: Start of XQuery 😊 import module namespace dutils=http://servicenow.com/xquery/module/now-dita-utils; import module namespace relpath=http://servicenow.com/xquery/module/now-relpath-utils; declare %updating function local:resolveMaprefs($context) { let $maprefs as element()* := $context//mapref[@href][string(@scope) ne 'peer'] let $debug := prof:dump('local:resolveMaprefs(): have ' || count($maprefs) || ' maprefs') return for $mapref in $maprefs let $refTarget as element()? := dutils:resolveReference($mapref/@href) let $debug := (prof:dump('refTarget:'), prof:dump($refTarget)) return if (exists($refTarget)) then let $debug := prof:dump('Got a reference target, attempting to replace original href with it...') let $newNodes as element() := <topicgroup class="+ map/topicref mapgroup-d/topicgroup " base="submap {$refTarget/@base} {$mapref/@base}" xml:base="{relpath:base-uri($refTarget)}" >{ (: $mapref/@* except ($mapref/@href, $mapref/@format, $mapref/@base), $refTarget/@* except ($refTarget/@href, $refTarget/@*:DITAArchVersion, $refTarget/@domains, $refTarget/@base) :) } <topicmeta class="- map/topicmeta "> <navtitle class="- topic/navtitle ">{ $refTarget/*[dutils:class(., 'topic/title')]/node() }</navtitle> </topicmeta> {$refTarget/* except ($refTarget/title, $refTarget/topicmeta)} </topicgroup> return replace node $mapref with $newNodes else () }; let $mapurl as xs:string := 'bundle-devops-enterprise-dev-ops.ditamap' let $inputMap as document-node() := db:open('utah', $mapurl) let $maprefs as element()* := $inputMap//mapref[@href][string(@scope) ne 'peer'] return ( $maprefs, $inputMap update { local:resolveMaprefs(db:open('utah', $mapurl)) } ) (: End of XQuery :) A typical input map would be: <map xml:lang="en-US"> <title>Utah DevOps</title> <mapref href="now-keys-common.ditamap"/> <mapref href="devops-change-velocity.ditamap"/> <mapref href="devops-config.ditamap"/> </map> _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 0

In XSLT run by Saxon against doc in a database, how to resolve URI references?
by Eliot Kimber 03 Jun '23

03 Jun '23

I’m trying to run an XSLT transform that works from the file system to work when run from BaseX, where the input is a document in a database. The transform needs to resolve URI references from the input source to their targets in the same database. It looks like using base-uri() in XSLT returns a file:/ URL: ["+ [DEBUG] resolveTopicRef(): base-uri($context)="file:///utah/bundle-devops-enterprise-dev-ops.ditamap""] ["+ [DEBUG] df:resolveTopicRef(): context is a topicref."] ["+ [DEBUG] df:resolveTopicRef(): href=""now-keys-common.ditamap"""] ["+ [DEBUG] df:resolveTopicRef(): topicUri is a string, trying to resolve..."] ["+ [DEBUG] $context = ", <mapref href="now-keys-common.ditamap"/>] ["+ [DEBUG] baseuri(context) = file:///utah/bundle-devops-enterprise-dev-ops.ditamap"] ["+ [DEBUG] df:resolveTopicRef(): document at uri ""file:/utah/now-keys-common.ditamap"" is not available, returning empty list"] (This is the output of xslt:transform-report()?messages, which is very nice BTW) So my question is: Is it possible, short of using the BaseX REST API, to have a Saxon-run XSLT access docs from a database? I can easily set the @xml:base attribute on the input document before passing it to Saxon if there was some base URI that would then resolve from the database. I didn’t see anything relevant in the documentation for the XSLT module. In this case the transform is doing DITA map resolution, creating a single result document from a tree of DITA maps by resolving <mapref> elements to their referenced maps and replacing the reference with the referenced element. I haven’t figured out an efficient way to do this directly in XQuery, so I thought I’d apply my existing XSLT transform, but this seems to be a blocker. I’m sure it would work to use the BaseX REST API to access the docs from the XSLT, but that of course requires having a running server and HTTP handler. I was hoping this would just work. Thanks, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twase\itter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk