- BaseX-Talk - mailman.uni-konstanz.de

Database with data on disk shows 0 documents, throws error on optimize all
by Omar Siam 12 May '25

12 May '25

Hi! We had some serious problems with our storage last week and unfortunately that killed one of our important BaseX databases. Is there any way to restore the data? Does BaseX GmbH provide paid data rescue services? The symptoms are: There is data in that database: Mode LastWriteTime Length Name ---- ------------- ------ ---- -a--- 12.05.2025 13:16 25214377 atv.basex -a--- 12.05.2025 13:16 451580 atvl.basex -a--- 12.05.2025 13:16 106065 atvr.basex -a--- 12.05.2025 13:16 131 ftxx.basex -a--- 12.05.2025 13:16 449615 ftxy.basex -a--- 12.05.2025 13:16 697581 ftxz.basex -a--- 12.05.2025 13:59 319 inf.basex -a--- 12.05.2025 13:16 39 pth.basex -a--- 12.05.2025 13:16 28 swl.basex -a--- 12.05.2025 13:16 29798400 tbl.basex -a--- 12.05.2025 13:16 23650 tbli.basex -a--- 12.05.2025 13:16 693232 tokl.basex -a--- 12.05.2025 13:16 105495 tokr.basex -a--- 12.05.2025 13:16 53480811 txt.basex -a--- 12.05.2025 13:16 669153 txtl.basex -a--- 12.05.2025 13:16 166050 txtr.basex -a--- 12.05.2025 13:59 0 upd.basex Inspect reports 0 documents. Checking main table (0 nodes): - 0 invalid node kinds - 0 invalid parent references - 0 wrong parent/descendant relationships No inconsistencies found. 'dc_shawi_eng_000' inspected in 0.63 ms. Optimize all yields: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.3.2 Java: Azul Systems, Inc., 21.0.4 OS: Windows 11, amd64 Stack Trace: java.lang.NullPointerException: Cannot invoke "org.basex.index.path.PathIndex.write(org.basex.io.out.DataOutput)" because "this.paths" is null at org.basex.data.DiskData.write(DiskData.java:144) at org.basex.data.DiskData.close(DiskData.java:160) at org.basex.core.Datas.unpin(Datas.java:52) at org.basex.core.cmd.Close.close(Close.java:45) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:126) at org.basex.core.cmd.OptimizeAll$1.run(OptimizeAll.java:42) at org.basex.core.cmd.ACreate.update(ACreate.java:90) at org.basex.core.cmd.OptimizeAll.run(OptimizeAll.java:38) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.api.client.LocalSession.execute(LocalSession.java:132) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:92) at org.basex.core.CLI.execute(CLI.java:76) at org.basex.BaseX.console(BaseX.java:177) at org.basex.BaseX.<init>(BaseX.java:152) at org.basex.BaseX.main(BaseX.java:43) Best regards -- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam(a)oeaw.ac.at | www.oeaw.ac.at/acdh

2 3

Strange behaviour with db:copy and put-value
by Marco Lettere 12 May '25

12 May '25

Dear all, running 11.7 I'm trying to rename some resources that have been inserted into a database with db:put-value(). Uncommenting and executing single lines of the following sequence [1] I get the output in [2] for the first db:list-details but the output in [3] for the second list-details. It somehow has to do with multiple renaming because if I rename the resources one by one this doesn't seem to happen. Could you provide some insight? Thank you, Marco. [1] (:db:create("test"):) (:db:put-value("test", <a/>, "first/a"), db:put-value("test", <b/>, "first/b"):) (:db:list-details("test", "first"):) (:db:rename("test", "first", "second"):) (db:list-details("test")) [2] <resource type="value" content-type="application/octet-stream" modified-date="2025-05-12T12:42:35.403Z" size="7">first/a</resource> <resource type="value" content-type="application/octet-stream" modified-date="2025-05-12T12:42:35.403Z" size="7">first/b</resource> [3] <resource type="value" content-type="application/octet-stream" modified-date="2025-05-12T12:37:24.563Z" size="7">second.basex/a</resource> <resource type="value" content-type="application/octet-stream" modified-date="2025-05-12T12:37:24.564Z" size="7">second.basex/b</resource>

2 1

Stemming and Italian
by Marco Lettere 12 May '25

12 May '25

Dear all, as stated in the documentation for fulltext, since I have lucene-3.4.0 jar file in the lib directory of BaseX (and thus in its classpath which is java -cp [...]/basex/BaseX.jar:[...]/basex/lib/custom/*:[...]/basex/lib/*: -Xmx2g org.basex.BaseXGUI) I was expecting the following query to return true() "cammina" contains text "camminare" any word using stemming using language "it" (: tried also with Italian:) But I always get false() with any combination whereas it works neatly with embedded English and German. Ho can I understand if stemming is actually used and in case with what language. Thanks for your support, Marco.

2 1

help
by 林晓东 12 May '25

12 May '25

unsubscribe -- 此致林晓东莫愁前路无知己，天下谁人不识君。

1 0

Compatibility of BaseX Java library between versions
by Matt Dziuban 05 May '25

05 May '25

Hello, I run a BaseX server and connect to it in code using the org.basex:basex Java library hosted on https://files.basex.org/maven, specifically using the ClientSession <https://github.com/BaseXdb/basex/blob/11.9/basex-core/src/main/java/org/bas…> and ClientQuery <https://github.com/BaseXdb/basex/blob/11.9/basex-core/src/main/java/org/bas…> classes. I'm wondering about the compatibility between the BaseX server and client versions. For example, if the BaseX server is running v11.8, but my code uses v11.9 of the Java library, am I likely to run into any issues? Thanks in advance, and congratulations on the 11.9 release! Matt

2 2

Recovering database in bad state
by Eliot Kimber 01 May '25

01 May '25

I have a database that shows having the expected 2 documents in it in the DBA databases list but when I go to the database in the DBA it shows 0 items. I think this is because the database was being written to and something happened that left it in a bad state. Is there any possibility of recovering this database so it is usable? The practical problem is that it takes several hours to populate this database, so recovering it rather than attempting another multi-hour load would be nice. Here’s what I see for files in the database’s directory on the server: -rw-r--r-- 1 eliot.kimber.adm domain users 73039559 Apr 18 14:50 atv.basex -rw-r--r-- 1 eliot.kimber.adm domain users 7544382 Apr 18 14:52 atvl.basex -rw-r--r-- 1 eliot.kimber.adm domain users 2730980 Apr 18 14:52 atvr.basex -rw-r--r-- 1 eliot.kimber.adm domain users 236 Apr 18 04:17 ftxx.basex -rw-r--r-- 1 eliot.kimber.adm domain users 218072 Apr 18 04:17 ftxy.basex -rw-r--r-- 1 eliot.kimber.adm domain users 1603678 Apr 18 04:17 ftxz.basex -rw-r--r-- 1 eliot.kimber.adm domain users 15 Apr 18 04:17 idp.basex -rw-r--r-- 1 eliot.kimber.adm domain users 15193 Apr 18 04:17 inf.basex -rw-r--r-- 1 eliot.kimber.adm domain users 67 Apr 18 04:17 pth.basex -rw-r--r-- 1 eliot.kimber.adm domain users 28 Apr 18 04:17 swl.basex -rw-r--r-- 1 eliot.kimber.adm domain users 83701760 Apr 18 14:52 tbl.basex -rw-r--r-- 1 eliot.kimber.adm domain users 9 Apr 18 04:17 tbli.basex -rw-r--r-- 1 eliot.kimber.adm domain users 112380335 Apr 18 14:52 tokl.basex -rw-r--r-- 1 eliot.kimber.adm domain users 2829520 Apr 18 14:52 tokr.basex -rw-r--r-- 1 eliot.kimber.adm domain users 1718692 Apr 18 04:17 txt.basex -rw-r--r-- 1 eliot.kimber.adm domain users 351326 Apr 18 04:17 txtl.basex -rw-r--r-- 1 eliot.kimber.adm domain users 285610 Apr 18 02:38 txtr.basex -rw-r--r-- 1 eliot.kimber.adm domain users 0 Apr 18 04:18 upd.basex In the Databases list I see: _temp_lrk_yokohama_link_records<http://mirabel.corp.service-now.com:8984/dba/database?name=_temp_lrk_yokoha…> 2 274 MB 2025-04-18, 14:52:42 But then when I go to the database itself it just say “0 entries”. Thanks, Eliot _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

3 11

inspect:functions
by Rob Stapper 01 May '25

01 May '25

Hi, I want to make use the 'inspect:functions'-function but whatever I do I always get this error: ' [inspect:parse] Stopped at C:/Users/Rob/Projecten/SemanticWorldModel/repo/SWM.main/content/IMPLEMENTATION-DOMAIN/reverseArrayIterator.xqm, 4/27: [XQST0049] Duplicate declaration of static variable .........' It looks like the function traverse all through the module structure following the module imports. And when it encouters a cyclic situation, which is not abnormal within a module structure, the function trigers this error. I think it should just stop on that branche because obviously the model has already been processed. Maybe even, the function should not iterate through the module structure at all, just returning the functions of the requested module. Maybe I'm just doing things wrong here. Can you please shed some light on how to prevent this error when using 'inspect:functions'? Some background for this madness: I want to annotate my FunctionDataStructure, dataStructures as functioncallparameterset, with the name of the module that contains the functions for this type/class of data (class and methods in OO). Thanks in advance for your responce. mvgr. Rob Stapper

2 6

BaseX 11.8: Lightning fast maps, new XQuery 4 features
by Christian Grün 30 Apr '25

30 Apr '25

We are delighted to announce BaseX 11.8, one more important step to the next major version. Here are the most significant changes: - [MOD] Lightning fast construction of ordered maps of all types - [MOD] fn:distinct-values, fn:duplicate-values: faster comparisons - [MOD] Faster map comparison (ordered and unordered) - [ADD] New function util:values-except - [ADD] XQuery 4.0 functionality (functions, %method annotation) - [MOD] XQuery fold functions: more early exits - [MOD] XQuery, fn:parse-xml: options added - [MOD] prof:variables: Better capture of in-scope variables - [FIX] Stricter permission checks when calling built-in functions For a preview of the upcoming 12 features, please visit the following page… https://docs.basex.org/12 …and have a look at our homepage to download the latest version: https://basex.org Have fun, Your BaseX Team

2 3

Problem in Java extension module
by Nico Verwer (Rakensi) 24 Apr '25

24 Apr '25

Greetings, BaseX creators and users! I am trying to make a custom XQuery function in Java. This works fine in most cases, but it seems to lose namespaces on attributes. The Java code in the function converts the BaseX representation of an element into a `org.w3c.dom.Element` DOM; transforms the DOM, creating a new DOM; sends the resulting DOM element back to BaseX. The problem is quite subtle and hard to explain in a few sentences. Therefore I have made a project demonstrating it, which can be seen on [Github](https://github.com/nverwer/possible-bug-in-BaseX). The project includes Java code and a simple XQuery that demonstrates the problem. I am at the point where I think the problem could be a bug in BaseX, which is why I thought it would be a good idea to post this to the basex-talk mailing list. If someone with more knowledge of the inner workings of BaseX could help me, I would much appreciate. Best regards, Nico Verwer

3 2

Way to record node IDs that does not depend on database name?
by Eliot Kimber 22 Apr '25

22 Apr '25

In my long-running data load process that appears to fail, I’ve found the issue but I don’t see an obvious way to correct it. My process creates a temporary content database that contains the latest content version of content previously loaded. This temp database is then the source for a process that creates a set of where-used index records in another database that point to the nodes in the temp content database by node ID. The node-recording elements look like this: <noderef node-id="43617" database="pce-test-data" tagname="mapref" baseuri="/pce-test-data/encryption-support.ditamap" href="cloud-encryption.ditamap" /> Note the “database” attribute: it’s the name of the database the node ID is from. After the process as completed constructing all the where-used records and is ready to swap these new databases into production, I have an XSLT transform that updates the values of the @database attributes to replace the temporary database name with the production name (i.e., remove leading “_temp_” from the database name. I then swap the temp databases in place of the old databases, putting the new data into production. This works fine at small scales, but when I attempt it with my 200K-link database, the XSLT transform either simply never completes or fails in the backgroujnd or would take so long to complete that it would be impractical. In any case, this approach does not work for my full-scale case ☹ So my question is: How can avoid this need to update my node reference elements to reflect the new database name? One solution that comes to mind is simply not recording the database name on the <noderef> element but somewhere else, say in the root element of the document that contains the <nodere>, but that requires that all the <noderef> elements in that context target the same database, which will be true in this case but might not be true in the future (I had designed <noderef> to enable mixing references to nodes in different databases). I could also have the code that’s creating these where-used records manage the prod-to-temp database name dynamically (and that may be my best solution the more I think about it) but starts to look like magic and I try to avoid magic code. So a solution that is less fragile would be ideal. Changing the value requires an update of some sort, whether it’s via XSLT or XQuery update, it’s going to be problematic at this scale. Is there any solution I’ve overlooked? Thanks, Eliot _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

2 2

Runtime error from DBA log viewer
by Eliot Kimber 19 Apr '25

19 Apr '25

Trying to view today’s log, I get this runtime failure: Stopped at /data1/basex/webapp/dba/logs/logs.xqm, 220/25: [FORG0001] Cannot convert to xs:decimal: 3.4345182E+8. Stack Trace: - /data1/basex/webapp/dba/logs/logs.xqm, 157/10 266.98 ms I can provide the log file separately. This is with BaseX 11.6 Cheers, Eliot _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

1 0

Parallelizing writes to a database
by Eliot Kimber 18 Apr '25

18 Apr '25

In my Mirabel system, I create a link database that records all the links made in a set of documents. This becomes a “where used” index over the content. We have on the order if 200K links for one content set, so at 0.1 second per link it takes about 7 hours to build this index. I’m currently doing this in one process that builds the whole index and then stores it in a database. This is failing in hard-to-diagnose ways, for example, because a database has a write lock on it when I go to rename it from it’s temp name to it’s production name (to replace the current production version). The data is such that I could parallelize the processing but I’m not sure how I would do that in BaseX so that I can safely write to a single database from multiple threads. The fork-join() docs clearly say “non-updating” functions, so that doesn’t seem to be an option. I have multiple BaseX HTTP servers running so I could farm processing across them, but I think I would then run into write lock issues. I could create separate databases for each thread of operation and then combine those at the end—that seems like it might be the best option. Have I missed anything? Thanks, Eliot _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

1 0

Bug report - argument = context item, param value several items
by Hans-Juergen Rennau 10 Apr '25

10 Apr '25

Dear BaseX people, I have encountered a bug (?). Please consider this code: = = = = = = = = = begin = = = declare namespace f="http://weatherreport.org/heavyweather"; declare function f:relatedNames($node, $relationship) as xs:string* { let $fnName := function($node) { let $_DEBUG := trace(count($node), '#node: ') return name($node)} let $items := switch($relationship) case 'child' return $node/* default return error() return $items/$fnName(.) => distinct-values() => sort() => string-join(', ')}; let $doc := <doc><a/><b/><c/></doc>return f:relatedNames($doc, 'child') = = = = = = = = = end = = = = = = = = = = = = output = = =#node: 3Stopped at C:/projects/foxpath-examples/pre-balisage/problem-basex2.xq, 15/25:[XPTY0004] Item expected, sequence found: (<a/>, <b/>, <c/>).= = = = = = = = = = = = = = = = The call $fnName(.) receives a single item, but three items arrive at the function item! With kind regards,Hans-Jürgen PS: The funny switch() seems to play a part in the game, when I removed it, the issue vanished.PPS: BaseX 11.8 [Standalone]

2 3

Execution of let clauses versus optimization
by Hans-Juergen Rennau 06 Apr '25

06 Apr '25

Dear BaseX people, I observe a behaviour which appears to me not desirable, although it is, strictly speaking, correct. Please consider this code: let $fnCopy := function($term) {trace('yes', 'within fnCopy: ')} let $_DEBUG := trace('before call fnCopy') let $result := $fnCopy('yogi') (: let $_DEBUG := if ($result eq 'NEVER') then error() else () :) let $_DEBUG := trace('after call fnCopy') return () As long as the commented out clause is not activated, the function is *not* executed. It is strictly speaking correct behaviour: the processor may optimize and skip the call of $fnCopy, as it does not contribute to the value of the containing FLWOR expression. However, when using functions with side-effects (as file:write()), it is of course necessary to be sure that the call is executed. Contrary to other processors, according to my experience BaseX has never skipped let clauses for reasons of optimization, and in many years of usage I have again and again highly appreciated this behaviour. The skipping behaviour is new to me. Is it so that BaseX has changed its policy concerning let clauses not contributing to the FLWOR result? It would be very important to know, because the execution of functions with side effects is everyday practice. Kind regards,Hans-Jürgen

2 2

11.8: Store always clearing on restart
by Zimmel, Daniel 26 Mar '25

26 Mar '25

Hi, is this a bug? The store is always clearing on restart. In contrast, the documentation says: "The store will still be available if BaseX is restarted until it is cleared." https://docs.basex.org/main/Store_Functions It works as documented in 11.6, but not in 11.7 and 11.8. Steps to reproduce via GUI: 11.6: Start GUI XQuery: store:put('TEST','TEST') Close GUI Start GUI XQuery: store:get('TEST') Result: 'TEST' 11.7/8: Start GUI XQuery: store:put('TEST','TEST') Close GUI Start GUI XQuery: store:get('TEST') Result is empty The changelog for 11.7 says (not related?): [MOD] Store functions: only read if contents have changed (https://basex.org/2025/01/31/basex-11.7/) Cheers, Daniel

2 3

Re: document-uri() and base-uri() functions in BaseX 11.8
by ykhabins＠bellsouth.net 25 Mar '25

25 Mar '25

Hi Gunther, I tested the latest build, BaseX 11.9 beta c55e0e8 Everything is back to normal. The document-uri() and base-uri() functions working as expected. Thanks a lot for such quick turn-around with the fix. Regards, Yitzhak Khabinsky

1 0

Re: document-uri() and base-uri() functions in BaseX 11.8
by ykhabins＠bellsouth.net 25 Mar '25

25 Mar '25

Hi Gunter, I tested the latest build, BaseX 11.9 beta c55e0e8 Everything is back to normal. The document-uri() and base-uri() functions working as expected. Thanks a lot for such quick turn-around with the fix. Regards, Yitzhak Khabinsky

1 0

document-uri() and base-uri() functions in BaseX 11.8
by ykhabins＠bellsouth.net 25 Mar '25

25 Mar '25

Hello, Congrats on the BaseX 11.8 release. Was there a change in BaseX 11.8 to the document-uri() and base-uri() functions behavior? It seems that they are striping out a file name at the end of the fully qualified file path on the file system! Please find below a repro of it. BaseX 11.7 ========== declare variable $base_dir as xs:string := 'e:\Temp\Identity Transformation88\'; for $x at $i in collection($base_dir) let $file := tokenize(document-uri($x), '/')[last()] return (document-uri($x), $file) Emits the following as expected: file:///E:/Temp/Identity%20Transformation88/Input.xml Input.xml file:///E:/Temp/Identity%20Transformation88/Output.xml Output.xml BaseX 11.8 ========== The same XQuery emits the following: file:///E:/Temp/Identity%20Transformation88/ file:///E:/Temp/Identity%20Transformation88/ Regards, Yitzhak Khabinsky

2 2

Pretty printing of results in BaseX GUI.
by Buddy Kresge 25 Mar '25

25 Mar '25

In BaseX GUI (Version 10.5), I cannot get the pretty printing to work. I have the below option configured in .basexgui but it appears to have no impact, as the XML that is output in the Results area is NOT pretty printed. Can you advise on how to best get the pretty printing of the XML to happen in BaseX GUI? # Local Options SERIALIZER = indent=yes Buddy Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.

2 4

Great work! Thank you basex folks
by Liedtke, Alexander 23 Mar '25

23 Mar '25

Thanks for the great work and the new version update! I think everybody using basex should consider using the (pretty good hidden) donate button at the bottom of the basex.org homepage, to at least spend the devs a good weekend with coffee or beer… 😉

2 2

csv:parse header option not working in version 11.7
by Lizzi, Vincent 19 Mar '25

19 Mar '25

Hi BaseX team, Has the "header" option on csv:parse changed between BaseX version 11.6 and 11.7? Here is an example to illustrate what looks like a problem or change. Given a tab separated text file such as this: aaaa bbbb cccc a1 b1 c1 a2 b2 c2 This query uses the "header": "yes" option on csv:parse which should map column names to element names. "tsv-test.tsv" => file:resolve-path() => file:read-text() => csv:parse(map{'separator': 'tab', 'header': 'yes'}) BaseX version 11.6 produces the expected parse: <csv> <record> <aaaa>a1</aaaa> <bbbb>b1</bbbb> <cccc>c1</cccc> </record> <record> <aaaa>a2</aaaa> <bbbb>b2</bbbb> <cccc>c2</cccc> </record> </csv> BaseX version 11.7 seems to be ignoring the header option and produces this output: <csv> <record> <entry>aaaa</entry> <entry>bbbb</entry> <entry>cccc</entry> </record> <record> <entry>a1</entry> <entry>b1</entry> <entry>c1</entry> </record> <record> <entry>a2</entry> <entry>b2</entry> <entry>c2</entry> </record> </csv> If this is an expected change, is there any equivalent to the option "header": "yes" ? Best regards, Vincent ______________________________________________ Vincent M. Lizzi Head of Information Standards | Taylor & Francis Group E-Mail: vincent.lizzi(a)taylorandfrancis.com<mailto:vincent.lizzi@taylorandfrancis.com> Web: www.tandfonline.com<http://www.tandfonline.com/> Time zone: US Eastern Taylor & Francis is a trading name of Informa UK Limited, registered in England under no. 1072954 "Everything should be made as simple as possible, but not simpler." Information Classification: General

3 4

HTTP server performance seems very slow...
by Peter Villadsen 15 Mar '25

15 Mar '25

All, I have been using BaseX for a while, connecting to the TCP endpoint. I know the performance I typically get, and it is impressive! However, now I wanted to use the HTTP endpoint, and it seems the performance is at least 2 orders of magnitude worse! Here is the query that I am POSTing to http://localhost:8984/rest/RainFnd_6.0.10.0 <query xmlns=http://basex.org/rest> <text>/Class[@Package='ApplicationPlatform']/@Name</text> </query> This simple query will generate around 1500 results from the 13GB database (RainFnd_6.0.10.0<http://localhost:8984/rest/RainFnd_6.0.10.0>). It takes just over 7 seconds to do this. If I do this in the BaseX GUI that is self contained, it takes around 20ms. However, it seems that the time spent executing the query against the database is negligible. Please consider this query: <query xmlns=http://basex.org/rest> <text>1 + 2</text> </query> In which there there is obviously no database access. It takes almost the same amount of time as the query that accesses the database. 7 seconds to calculate 1 + 2 is too long. If I post the 1 + 2 query to the endpoint without specifying the database on the URL: http://localhost:8984/rest it takes around 7 milliseconds, close to what I expected, certainly within expectations for the time spent sending the query over the wire and serializing etc. This leads me to believe that a lot of the time (>7 seconds) may be spent opening the database each time a POST is done? Is there a way to tweak the HTTP server to "remember" the connection with the current database for a little while? This may be against the REST principles, of course. The database is guaranteed to be read-only in my case. The problem is that this makes the HTTP server inappropriate for interactive applications. I can still use the TCP server, where I get the results I need, but using the HTTP would be simpler, and have less overhead in terms of code needed to communicate with the server. Please let me know if there is a way to accomplish acceptable performance with the HTTP server. Best Regards Peter Villadsen Principal Technical Program Manager Microsoft Business Applications Group

3 7

Protecting against XML vulnerabilities
by Nico Verwer (Rakensi) 14 Mar '25

14 Mar '25

I am trying to protect my BaseX application from XML vulnerabilities, like the ones described in [https://gist.github.com/mgeeky/4f726d3b374f0a34267d4f19c9004870] and [https://learn.microsoft.com/en-us/archive/msdn-magazine/2009/november/xml-d…]. My application runs as `basexhttp` inside a docker container, and I set the options in web.xml: <context-param> <param-name>org.basex.dtd</param-name> <param-value>false</param-value> </context-param> <context-param> <param-name>org.basex.xinclude</param-name> <param-value>false</param-value> </context-param> I have not found other options, for example to let the parser limit expansion of internal entities. Is there a way to set parser properties like `jdk.xml.entityExpansionLimit` in BaseX?

4 6

Incremental updates: Best practices?
by Florian Schmitt 14 Mar '25

14 Mar '25

Hi all, I’m searching for a way to apply “incremental updates” to a database. By “incremental updates”, I refer to the following situation: 1. Starting point is a database containing several xml resources, e.g. /coll1/res1.xml /coll1/res2.xml /coll2/res3.xml. 2. The update consists of a file structure like /coll1/res2.xml /coll2/res4.xml /coll3/res5.xml - so I want to update the existing resource /coll1/res2.xml and add some additional resources /coll2.res4.xml, /coll3/res5.xml. The desired result is a structure like this: /coll1/res1.xml (untouched) /coll1/res2.xml (updated) /coll2/res3.xml (untouched) /coll2/res4.xml (added) /coll3/res5.xml (added) Using the command line client and the “ADD” command, I’m able to apply the update content in a single step, but (as the documentation predicted) /coll1/res2.xml now appears twice. This isn’t the desired result - /coll1.res2.xml should be overwritten by the content of / coll1.res2.xml from the update. Using the command line client and the “PUT” command replaces / coll1.res2.xml and adds the additional resource. But it deletes / coll1/res1.xml and /coll2/res3.xml - again, not the desired result, since resources missing in the update should simply be kept untouched. In my real use case, the initial dataset contains about 18,000 resources, updates may contain hundreds of updated or new resources, so separating ADD and PUT operations manually isn't possible. A simply but ugly solution would be to keep the initial set of resources in the file system, "apply" the update there and import the complete set of files as new Database. Another solution would be to write a dedicated xquery that checks for each single resource to apply a PUT or ADD operation. Is there a better way for such a use case? Florian

3 2

Upgrading BaseX
by Csaba Fekete 02 Mar '25

02 Mar '25

Hi all, What is the best way to upgrade BaseX on a production server? My current version is 11.1 and I'd like to upgrade to the latest. My gut feeling is that all it takes to overwrite the following (and leave everything else): *bin/etc/lib/BaseX.jar* ... and then restart the http server. Any thoughts? Thanks

4 4

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk