- BaseX-Talk - mailman.uni-konstanz.de

Upgrading BaseX by several major versions
by Rémy Delanaux 18 Dec '24

18 Dec '24

Hello, I manage a project I've worked on from 2020 to 2022 and have recently come back to (no one has really worked on since then). The project currently runs BaseX 9.4, and we obviously would like to catch up on versions of BaseX. But I'm wondering what is the best way to process here. I don't remember upgrading major versions of BaseX during my time on project (we changed servers so for BaseX 9 we did a fresh install and backup restore) What is the correct way to do this? Should I straight up install the latest version (probably BaseX at the time of writing) and find all blocking migration changes, or gradually install major version after major version (10 then 11 then 12 when available) and ook for smaller migration processes? I wasn't able to find migration guides except for upgrading from 9 to 10 (although there are individual changelogs for each individual module). Thanks! Best, Remy Delanaux

6 10

parse-json() function reorder keys in the resulting map{}
by Oleksandr Shpak 16 Dec '24

16 Dec '24

Hi team, Found one "issue" with key ordering in the resulting map. Need to clarify, is it normal behavior or a bug. json:parse('{"b":1, "a":3}', { 'format': 'xquery' }) returns {"a":3.0e0,"b":1.0e0} but json:parse('{"b":1, "a":3}') <json type="object"><b type="number">1</b><a type="number">3</a></json> As you see, the standard function returns keys not in the order as it was set in the original JSON string. I didn't find any requirement in xQuery spec that the resulting map entries should be sorted by the key name. Is it a bug or a feature? If a feature I would be really happy to see one additional param to preserve key ordering. Thanks! -- s0rr0w

3 7

BaseX freeze
by Jerome Chauveau 16 Dec '24

16 Dec '24

hi, my basex server (11.5) stops responding when too many clients request my rxq application. I've published a little demo to reproduce the bug here : [ https://git.unicaen.fr/chauveau/basex-freeze-app | https://git.unicaen.fr/chauveau/basex-freeze-app ] I don't know if the problem comes from BaseX, Jetty or the Saxon XSLT processor. Thanks for your help Jérôme

2 3

Runtime failure in DBA optimize database panel
by Eliot Kimber 16 Dec '24

16 Dec '24

Using 11.6, the DBA app’s “optimize” panel gives this runtime error: ``` Stopped at /data1/basex/webapp/dba/databases/db-optimize.xqm, 104/10: [basex:restxq] Value of "name" must be xs:string, supplied: (). ``` Must be a simple code bug but I couldn’t find the source in github. Where is the source for the DBA app? Cheers, E. _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

2 1

How best to manage link data collection and storage?
by Eliot Kimber 10 Dec '24

10 Dec '24

Over the last couple of years I’ve developed the Mirabel system that provides DITA link management and query features over large volumes of content (the ServiceNow product documentation source). In particular it knows what links to what and enables viewing the content with all link information available. For a given version of the product docs we have about 60K DITA topics and 100 root maps that organize those topics into publications. The primary job of Mirabel is to capture all the hyperlink details as defined by the DITA source and enable queries about the element-to-element and document-to-document relationships established by those links. My implementation approach for loading the link knowledge uses a multi-step process: 1. Load the entire source content into a database 2. Create a “key space” database that reflects the DITA key-to-resource mappings defined by each root DITA map. The key spaces are XQuery maps that map from key names to resources identified by their database node IDs (essentially, each use of a topic from a map has an associated unique key by which that use of the topic can be referenced). The key spaces are a prerequisite for resolving cross references to keys from one topic to other topics in the context of some root map (the same root map or a different one). 3. Create a “link record keeping” database that contains the “where used” index for the content. The where-used index maps element node IDs to a record of every reference to that node (cross references, content references, topic references from maps). The where-used index is the core data used to know where a given map or topic is used, which is used to answer questions like “what publications use this topic?” or “is this topic used at all?”. The where-used table is constructed as an XQuery map that is then turned into XML for storage (I implemented this before BaseX added direct storage of maps but given the size I think it still makes sense to store it as XML, but I could be wrong). * Process all map-to-map and map-to-topic references and create the initial map entries, one for each map and topic. * For topics referenced from maps, process all topic-to-topic references and update the records for each target topic to reflect the references to it. The map context of a given topic determines the targets of key references from that topic, so it is necessary to process the topics in the context of the root maps that use them (in DITA, root maps determine the key-to-resource bindings to which key references resolve). * For topics not referenced from any maps, add entries for them to the where-used table and process any topic-to-topic references (key references cannot be resolved but direct URI references can be). Convert the XQuery map to a single XML document and store in the link record keeping database. The resulting database takes about 150MB of storage. This third step can take two-to-three hours: 60K topics times 0.2 seconds for each topic is 3.3 hours. 0.1 seconds is about as fast as the link processing can go based on my testing. This is all done using temporary databases so as not to disturb the working databases used by the running Mirabel web application. The work is performed by a BaseX “worker” server, not the main server that serves the web site. I essentially have one BaseX http server for each core on my server and allocate work to them based on load, so queries coming from the web app will not be allocated to a worker currently doing a content update process. Once all the new link data is loaded, the temporary databases are swapped into production by renaming the production databases, renaming the temp databases to their production names, then dropping the old databases. (Saying this just now I’m realizing that I don’t know how to pause or wait for active queries against the in-production databases to finish so I can swap the databases.) Because all the index entries use node IDs, the content database and record-keeping databases have to be put into production at the same time, otherwise the content node IDs will be out of sync with the indexed record IDs. I’m working on the assumption that renaming databases is essentially instantaneous and so I can use that to swap the temp databases into production reliably. I use my job orchestration module (https://github.com/ekimbernow/basex-orchestration) to manage the sequence of operations, where each job calls the next job in the sequence once it has finished. This process works reliably for smaller volumes of content—for example, a content set with only a couple of thousand topics and four or five root maps. But at full scale I’m consistently seeing that the link record keeping database, which only has two large XML documents in it, never completes optimization: The database page shows the database with two things in it, but when you open the database’s page, they do not show up and the job that performs the optimization never completes, leaving the database in a locked state. This means the new where-used index can’t be put into production. I feel like I’m going about this the wrong way to make best use of BaseX and avoid this problem with very large databases but I don’t see any obvious alternative approaches. But it feels like I’m missing something fundamental or making a silly error that I can’t see. So my question: How would you solve this problem? In particular, how would you go about constructing the where-used index in a way that works best with BaseX? Or maybe the question is “should I be updating the in-production database with the new data and doing the swapping into the production within the database itself?” (i.e., by renaming the where used index document rather than the database itself.) I am currently using 11.6 and can move to 12 once it is released. Thanks, Eliot _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

1 0

How to unlock a locked database?
by Eliot Kimber 10 Dec '24

10 Dec '24

BaseX 11.6 on Redhat Linux. I have long-running update processes that are failing at some point, leaving databases in a locked state that is not cleared by restarting the server. Short of manually deleting the database from the file system, how can I clear these locks or determine what process has the lock? I do not have FAIRLOCK turned on. This is in the context of my Mirabel system, which loads content into one database and then creates secondary link data databases, which requires lots of data processing and may take several hours to complete. Thanks, Eliot _____________________________________________ Eliot Kimber Sr. Staff Content Engineer O: 512 554 9368 servicenow servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | X<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Instagram<https://www.instagram.com/servicenow>

1 0

BaseX GUI dark theme
by ykhabins＠bellsouth.net 10 Dec '24

10 Dec '24

Hello, I am using BaseX 11.6 on Windows OS 10 and 11 machines. I followed the following post https://basex-talk.mailman.uni-konstanz.narkive.com/w8VctrkD/editor-backgrou nd-color And downloaded latest JTattoo-1.6.13.jar, and copied it to the c:\Program Files (x86)\BaseX\lib\custom directory. All new themes show up in the Visualization tab dropdown upon BaseX GUI restart. If I select Noire or HiFi themes, i.e. dark themes, BaseX GUI changes menus, toolbars, dropdowns, except Editor, Result, Info, etc. panes background. Please advise. Regards, Yitzhak Khabinsky

2 1

Content is not allowed in prolog.
by Ben Engbers 06 Dec '24

06 Dec '24

Hi, I have been working very hard on my BasexCpp client project for the last few months. The most effort has been to convert the code that worked flawlessly in Eclipse to a library that meets all the requirements (see also https://medium.com/@pananton/modern-cmake-tutorial-for-c-library-developers…, Modern CMake tutorial for C++ library developers). During that work, there turned out to be imperfections anyway. Fixing a memory-leak took the most effort. I now have 2 versions of the code. The first version is based on CMake and builds a shared library that has to be installed. The second version does not use CMake. This version has to be compiled manually. Both versions use the same code for the library. As soon as I fix the last,following problem, I will publish both new versions. The last problem is in the test program. That program contains the following line: Session.Add(“Add_XML_2”, “/home/bengbers/Git/Private/Raw/libBasexCpp/src/extdata/Articles.xml”); This line calls the "Add command" from the server protocol. The above line is executed without errors. However, the problem is that when I change the path to "./Raw/libBasexCpp/src/extdata/Articles.xml" I get the following error message: "Content is not allowed in prolog.". And since the same testprogram is used to test the different versions, the path has to be relative. My question is how I can use a relative path in the Add-command. -- Ben Engbers Grietjeshof 77 6721 VH Bennekom +31 6 23634840

3 2

Limit on Parallelism
by celano＠informatik.uni-leipzig.de 06 Dec '24

06 Dec '24

Is there a way to specify how many parallel processes Basex 11 is allowed to spawn (I am not using the database)? In combination with GNU parallel, it becomes difficult to have control on parallelism. Best, Giuseppe

4 5

org/basex/BaseX has been compiled by a more recent version of the Java Runtime (class file version 55.0)
by Patrick Durusau 06 Dec '24

06 Dec '24

Greetings, Trying to run BaseX 11.6 on Windows 11 with Java: java -version java version "1.8.0_431" Java(TM) SE Runtime Environment (build 1.8.0_431-b10) Java HotSpot(TM) Client VM (build 25.431-b10, mixed mode, sharing) Error message: Exception in thread "main" java.lang.UnsupportedClassVersionError: org/basex/BaseX has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0 Apologies but I'm still on Windows but hope to return to Linux soon, but not today. Is this a known problem? Thanks! Patrick

3 4

RestXQ OAuth2 permission checks
by Jörn Willhöft 05 Dec '24

05 Dec '24

Hi all, I recently implemented a small OAuth2 / OpenID permission check library in XQuery, complete with a small example page and a docker compose setup, including an identity provider (FusionAuth in this case). I saw this popped up once or twice on the mailing list, but I could not make much use of the provided code, so I hope this might be of interest to anybody. The example project is available on Github: https://github.com/willhoeft-it/basex-oauth2 I would be glad to hear about any opinions or get some feedback. While working on this, I realized that BaseX' permission attributes unfortunately lack a small feature that would be quite useful: The "perm" parameter to the checking function provides the method and the path, but unfortunately not any URL parameters. In my case, I would like to remember the URL (including parameters) the user called before I redirect him to the authorization server to login, so I can afterward redirect him to the page he actually wanted. But in a more general context, I can imagine it would also be useful to do permission checks on the parameters, too. Or maybe I missed something? Kind regards Jörn Willhöft

3 5

BaseX 9.6: The Summer Edition
by Christian Grün 28 Nov '24

28 Nov '24

Dear all, We provide you with a new and fresh version of BaseX, our open source XML framework, database system and XQuery 3.1 processor: https://basex.org/ Apart from our main focus (query rewritings and optimizations), we have added the following enhancements: XQUERY: MODULES, FEATURES - Archive Module, archive:write: stream large archives to file - SQL Module: support for more SQL types - Full-Text Module, ft:thesaurus: perform Thesaurus queries - Fulltext, fuzzy search: specify Levenshtein limit - UNROLLLIMIT option: control limit for unrolling loops XQUERY: JAVA BINDINGS - Java objects of unknown type are wrapped into function items - results of constructor calls are returned as function items - the standard package "java.lang." has become optional - array arguments can be specified with the middle dot notation - conversion can be controlled with the WRAPJAVA option - better support for XQuery arrays and maps WEB APPLICATIONS - RESTXQ: Server-Timing HTTP headers are attached to the response For a more comprehensive list of added and updated features, look into our documentation (docs.basex.org) and check out the GitHub issues (github.com/BaseXdb/basex/issues). Have fun, Your BaseX Team

11 43

Fwd: db-rename unexpected behaviour
by Rob Stapper 25 Nov '24

25 Nov '24

I attached a complete demo project. > ---------- Oorspronkelijk Bericht ---------- > Van: Rob Stapper <r.stapper(a)lijbrandt.nl> > Aan: "basex-talk-owner(a)mailman.uni-konstanz.de" <basex-talk-owner(a)mailman.uni-konstanz.de> > Datum: 23-11-2024 11:17 CET > Onderwerp: db-rename unexpected behaviour > > > Hi Christian, > > It's been a while so I thought it was time to find some trouble, which I did. (;-) > > In my database I want the document-names to be consistent with the id-attribute of its root-element. So, a document named: "test.xml" should have a root--element with @id also: "test.xml". > When renaming a with an updated root-element updated document, I find db-rename not working[1]. > However creating a new with an updated root-element updated document under the new name and deleting the origional document does work[2]. > > I would think that if solution[2] works then also solution[1] would work. In both cases all database updating functions follow the same PUL-order. > Am I missing something here or is db-rename misbehaving? > > > [1] > declare %updating function this:rename-document-alt1 (: does NOT work :) > ( $serverName > , $itemName1 > , $itemName2 > ) > { db:put( $serverName > , this:get-element( $serverName > , $itemName1 > ) > => this:update-element-name( $itemName2 > ) > , $itemName1 (: <------------------------ updates org document with renamed root-element :) > ) > , db:rename( $serverName > , $itemName1 > , $itemName2 > ) > } ; > > [2] > declare %updating function this:rename-document-alt2 (: does work :) > ( $serverName > , $itemName1 > , $itemName2 > ) > { db:put( $serverName > , this:get-element( $serverName > , $itemName1 > ) > => this:update-element-name( $itemName2 > ) > , $itemName2 (: <------------------------ creates new document with renamed root-element :) > ) > , db:delete( $serverName > , $itemName1 > ) > } ; > > mvgr. > > Rob Stapper > mvgr. Rob Stapper

2 1

Question: trying to make a higher-order function in a Java module
by Nico Verwer (Rakensi) 20 Nov '24

20 Nov '24

This is a long question, and quite complicated, at least to me. I am trying to make a Java module, which is included in BaseX as a jar-file in `lib/custom`. The module contains one XQuery function: named-entity-recognition($grammar as item(), $options as map(*)?) as function(item()) as node()* This is a higher-order XQuery function that returns another (anonymous) XQuery function. The returned function is a parser (for named entities), similar to what the `invisible-xml` function returns. The relevant part (I think) is the following Java function: @Requires(Permission.NONE) @Deterministic @ContextDependent publicFuncItem namedEntityRecognition(Object grammar, Map<String, String> options) throwsQueryException { // Types of the arguments of the generated function. finalVar[] generatedFunctionParameters= { newVarScope().addNew(newQNm("input"), SeqType.ITEM_O, queryContext, null) }; // Type of the generated function. finalFuncType generatedFunctionType= FuncType.get(SeqType.NODE_ZM, generatedFunctionParameters[0].declType); // The generated function. NamedEntityRecognitionFunction nerf= newNamedEntityRecognitionFunction(grammar, options, generatedFunctionType, queryContext); // Return a function item. returnnewFuncItem(null, nerf, generatedFunctionParameters, AnnList.EMPTY, generatedFunctionType, generatedFunctionParameters.length, null); } The NamedEntityRecognitionFunction has a public Value value(final QueryContext qc) function that does the actual parsing. It starts by getting the value of its (only) parameter: Value inputValue = arg(0).value(qc); // Java The namedEntityRecognition function works fine when I use it like this (XQuery): let $ner-parse := ner:named-entity-recognition($grammar, map{}) return $input => $ner-parse() However, is does not work when the parsing function is put into a declared variable, like declare variable $ner-parse as function(item()) as node()* := ner:named-entity-recognition($grammar,map{}); $input => $ner-parse() In this case, the parameter value obtained by arg(0).value(qc) is null. When I debug this expression, it turns out that the parameter ($input) is not on the stack. The stack (which is qc.stack) is all nulls, and the begin and end indexes of the stack are both 0, meaning that the stack is empty.. This probably means that the query context of a local (let) variable is different from the query context of a global (declare) variable. Maybe I need to indicate that the namedEntityRecognition function returns a higher order function (but how)? The code for this can be found at https://github.com/nverwer/basex-ner-xar. If anyone can shed some light on this, that would be very much appreciated. Best regards, Nico Verwer

2 4

Improper use? Potential bug
by DK Singh 20 Nov '24

20 Nov '24

Hi I am using BaseX version 9.5, i am getting error while doing Query in database below error i am getting 500 Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.5 Java: Oracle Corporation, 1.8.0_191 OS: Windows Server 2016, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 234511809 - table size: 234511809 - first/next pre value: 234511724/234511809 - #total/used pages: 916434/916434 - accessed page: 916433 (916434 > 916433] at org.basex.util.Util.notExpected(Util.java:63) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:474) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:158) at org.basex.data.Data.kind(Data.java:312) at org.basex.query.value.node.DBNode$2.next(DBNode.java:295) at org.basex.query.value.node.DBNode$2.next(DBNode.java:288) at org.basex.query.expr.path.IterStep$1.next(IterStep.java:38) at org.basex.query.expr.path.IterStep$1.next(IterStep.java:32) at org.basex.query.QueryContext.next(QueryContext.java:352) at org.basex.query... 1567.06 ms ``` I tried to restore database but when any write operation happening then after write operation same issue is occurring Thanks Dharmendra

2 3

Re: [basex-talk] Potential bug in archive:extract-to
by Christian Grün 14 Nov '24

14 Nov '24

Hi (cc to the list), The filenames in your archive may be CP437-encoded, while many newer archives use Unicode. Unfortunately, the standard JDK ZIP library that we use is not smart enough to detect different filename encodings. We could add an $options argument to all Archive Functions that open and create/update archives [1]. For the moment, you will need to… • create archives with Unicode filenames (e.g., with "zip --unicode"), • avoid characters in the 80-FF range from CP437 [2], or • invoke an external unzipper, e.g. via proc:system. Sorry for that, Christian [1] https://github.com/BaseXdb/basex/issues/2344 [2] https://en.wikipedia.org/wiki/Code_page_437 On Thu, Nov 14, 2024 at 12:59 PM Grythe, Thomas Berge < thogry(a)innlandetfylke.no> wrote: > Hi! > > I ran the code you sent me. I then found out the cause of the error. The > reason for the error message 'malput input' is that there was the letter > 'å' in a file name of the zip file (see the attached image). > > When I changed the title "2 klage på vedtak" to "2 klage paa vedtak", the > program worked. > > Is there an easy way to fix this so that the code can handle special > characters like "æ, ø" and "å"? > > Best regards, Thomas. > ------------------------------ > *Fra:* Christian Grün <christian.gruen(a)gmail.com> > *Sendt:* onsdag 13. november 2024 16:11 > *Til:* Grythe, Thomas Berge <thogry(a)innlandetfylke.no> > *Emne:* Re: [basex-talk] Potential bug in archive:extract-to > > > Denne eposten er sendt fra en person utenfor organisasjonen. Ikke klikk på > lenker eller åpne vedlegg før du er sikker på hvem avsender er og at > innholdet er trygt. > > Hi Thomas, > > maybe we can first try to simplify the script. Could you check what the > following code does? > > let $inputpath :="E:\Transfer\vaaler_websak – Kopi\" > for $name in //record//entry/text() > where contains($name, '.bin') > let $input := $inputpath || $name > let $target := $inputpath || substring-before($name, '.') > return archive:extract-to($target, $input) > > If yes, could you possibly send the problematic archive file to me (it > needn’t be shared over the list)? > > Thanks, > Christian > > > On Wed, Nov 13, 2024 at 3:58 PM Grythe, Thomas Berge < > thogry(a)innlandetfylke.no> wrote: > > Hi! > > Thank you for your reply. Attached is the code of my program and also an > image of the extracted files from a zip-file. If I run the program with > this zip -file, I am getting the error message 'malformed input'. > > Can the file -names cause this problem? > > Best regards, Thomas. > ------------------------------ > *Fra:* Christian Grün <christian.gruen(a)gmail.com> > *Sendt:* onsdag 13. november 2024 14:32 > *Til:* Grythe, Thomas Berge <thogry(a)innlandetfylke.no> > *Kopi:* basex-talk(a)mailman.uni-konstanz.de < > basex-talk(a)mailman.uni-konstanz.de> > *Emne:* Re: [basex-talk] Potential bug in archive:extract-to > > > Denne eposten er sendt fra en person utenfor organisasjonen. Ikke klikk på > lenker eller åpne vedlegg før du er sikker på hvem avsender er og at > innholdet er trygt. > > Hi Thomas, > > As Martin indicated, it would be interesting what the xquery:eval function > call does. Could you possibly provide us with a little self-contained > example? > > With BaseX 11 or later, you can simply do: > > archive:extract-to('/path/to/target', '/path/to/archive') > > Best, > Christian > > > On Tue, Nov 12, 2024 at 10:28 AM Grythe, Thomas Berge < > thogry(a)innlandetfylke.no> wrote: > > Hi! > > I am an electronic archivist and I have recently tried to use BaseX to > unzip files in an archive. The two main lines I have used are: > > let $archive := file:read-binary(xquery:eval($filepath-corrected) > return archive:extract-to(xquery:eval($dir_corrected), $archive) > > The variables $dir_corrected and $archive are defined earlier in the > code. But I get the error message 'malformed input off : 10, length : 1' , > indicating that there is an issue with the input data being processed. > > Do you know what can cause this problem? And do you know of a possible > work - around? > > > > Med vennlig hilsen > > *Thomas Berge Grythe* > Rådgiver > Innlandet Fylkesarkiv/IKA Opplandene > > Telefon: 48 99 47 85 > E-post: thogry(a)innlandetfylke.no > > > > > > *Innlandet fylkeskommune* > Telefon: 62 00 08 80 > www.innlandetfylke.no > > > > > >

1 0

10.X Server to produce pretty printed XML results?
by Buddy Kresge 13 Nov '24

13 Nov '24

In BaseX 10.X, is there a way for the DB server to format/pretty-print that resulting XM? It did so by default in the 9.X versions, but as we upgraded to 10.X we are no longer seeing that behavior. Is there something that can be set to turn this on for the server? Thanks in advance! Buddy Disclaimer The information contained in this communication from the sender is confidential. It is intended solely for use by the recipient and others authorized to receive it. If you are not the recipient, you are hereby notified that any disclosure, copying, distribution or taking action in relation of the contents of this information is strictly prohibited and may be unlawful. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast, a leader in email security and cyber resilience. Mimecast integrates email defenses with brand protection, security awareness training, web security, compliance and other essential capabilities. Mimecast helps protect large and small organizations from malicious activity, human error and technology failure; and to lead the movement toward building a more resilient world. To find out more, visit our website.

2 1

Potential bug in archive:extract-to
by Grythe, Thomas Berge 13 Nov '24

13 Nov '24

Hi! I am an electronic archivist and I have recently tried to use BaseX to unzip files in an archive. The two main lines I have used are: let $archive := file:read-binary(xquery:eval($filepath-corrected) return archive:extract-to(xquery:eval($dir_corrected), $archive) The variables $dir_corrected and $archive are defined earlier in the code. But I get the error message 'malformed input off : 10, length : 1' , indicating that there is an issue with the input data being processed. Do you know what can cause this problem? And do you know of a possible work - around? Med vennlig hilsen Thomas Berge Grythe Rådgiver Innlandet Fylkesarkiv/IKA Opplandene Telefon: 48 99 47 85 E-post: thogry(a)innlandetfylke.no<mailto:thogry@innlandetfylke.no> [cid:cb942b57-4e06-4d32-b529-cd07173c2993] Innlandet fylkeskommune Telefon: 62 00 08 80 www.innlandetfylke.no<https://www.innlandetfylke.no/>

3 2

Unable to paste into external variable dialogue box in the GUI-Basex 11.4
by brian＠kennison.name 25 Oct '24

25 Oct '24

Hello Everyone, Not a big deal but can’t paste into the external variable dialog box. I have a script that has several external variables (urls) which are long so I paste them in the dialog box in the GUI (Basex-11.4). Anybody else experiencing this? Thanks for your time —Brian

6 9

Write files in parallel?
by Thompson, Timothy 17 Oct '24

17 Oct '24

Hello, Is it possible to call file:write-text-lines in parallel inside a fork-join operation? I have multiple databases that I would like to run a query over, in parallel, and write the results as JSON Lines to a file per database. When I try this, it doesn’t seem to parallelize. Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research Interim Manager, Metadata Services Unit Yale University Library www.linkedin.com/in/timathompson<http://www.linkedin.com/in/timathompson>

3 7

How to recognize a byte-order-mark?
by Hans-Juergen Rennau 11 Oct '24

11 Oct '24

Dear BaseX people, there is a serializatioin parameter for adding a byte-order-mark when serializing. Such a document cannot be parsed using fn:doc() - error message: [FODC0002] "C:/projects/ofx-works/work/test-bom.xml" (Line 1): Content ist nicht zulässig in Prolog. This message is rather unspecific. My question: is there a way how to determine if a byte-order-mark is used in a given file? Kind regards,Hans-Jürgen

2 2

Re: [basex-talk] Setting multiple CSV EXPORTER options is not documented on docs.basex.org
by Christian Grün 03 Oct '24

03 Oct '24

Hi Navel, > BaseX Xquery CSV module is for dealing with CSV files which we don't have. With this module, you can serialize XML data as CSV (and parse CSV back to XML). But that’s certainly just one way to do it. Hi Owen, > However, I wonder how BaseX might deal with more than a million records. Feel free to get back to us once you encounter any limits. Best, Christian Naval Sarda <nsarda(a)epicomm.net> schrieb am Do., 3. Okt. 2024, 14:45: > Hi Owen, Christian, > > We are working on Stratml files which are in XML format. BaseX Xquery CSV > module is for dealing with CSV files which we don't have. > > We can scale up BaseX by adding more servers and splitting the data > between more servers if the record counts goes high. > > Naval > > > On 02/10/24 10:54 pm, Owen Ambur wrote: > > Naval, can you answer Christian's question? > > My sense is that a lot of features have been built into BaseX that we > could use but I don't have the knowledge or expertise to understand how > best to do so. At least, I hope we're not reinventing capabilities that > are already available to address our technical objectives > <https://aboutthem.info/SQS.xml> as well as our broader conceptual > objectives <https://aboutthem.info/ATI.xml>. > > Christian, this morning we had a very encouraging Zoom meeting with folks > at GSA who are finally getting around to figuring out how to help Uncle > Sam's agencies comply with section 10 > <https://www.linkedin.com/pulse/trustworthy-institutions-owen-ambur/> of > the GPRA Modernization Act. I encouraged them not to reinvent the StratML > schemas and it would be great if the BaseX community could help us > demonstrate the benefits of using them, not only by U.S. federal agencies > but agencies at all levels of government, worldwide, as well as tax-favored > organizations and others whose plans and reports should be matters of > public record. > > There are >5.8K plans in the StratML collection > <https://stratml.us/drybridge/index.htm> and indexed in the query > service. Their URLs are listed in sitemap format at > https://stratml.us/docs/sitemap.xml > > I am contemplating whether to hire someone to convert the relevant > elements of the IRS Form 990 database > <https://www.irs.gov/charities-non-profits/tax-exempt-organization-search-bu…> > to StratML format, using the templates at > https://stratml.us/drybridge/index.htm#MPR4CO However, I wonder how > BaseX might deal with more than a million records. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Wednesday, October 2, 2024 at 12:18:16 PM EDT, Christian Grün > <christian.gruen(a)gmail.com> <christian.gruen(a)gmail.com> wrote: > > > Hi Owen, > > Is it based on the BaseX XQuery CSV Module? > > Best, > Christian > > > > > Owen Ambur <owen.ambur(a)verizon.net> schrieb am Mi., 2. Okt. 2024, 18:12: > > I'm not sure how this exchange might relate but my developer has provided > CSV export capabilities for query results listings at StratML > <https://search.aboutthem.info/> > > > StratML <https://search.aboutthem.info/> > > > > Any comments or suggestions on how we might enhance the functionality of > our StratML-enabled query service would be most welcome. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Tuesday, October 1, 2024 at 04:42:12 AM EDT, Christian Grün < > christian.gruen(a)gmail.com> wrote: > > > Hi Omar, > > Thanks for the observation. For the SERIALIZER option, there was a > corresponding note which I have added to the EXPORTER option, along with > a little example for exporting CSV [1]. > > Best, > Christian > > [1] https://docs.basex.org/main/Options#exporter > > > > On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam(a)oeaw.ac.at> wrote: > > Hi, > > I just tried after some time to script a CSV export with a BXS file. I > forgot how to set multiple options for the csv serialization. In the end > this worked: > <set > option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> > I can not find it on docs.basex.org. Perhaps this should be added and > explained. > > Best regards > > -- > Mag. Ing. Omar Siam > Austrian Center for Digital Humanities and Cultural Heritage > Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences > Stellvertretende Behindertenvertrauensperson | Deputy representative for > disabled persons > Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria > T: +43 1 51581-7295 > omar.siam(a)oeaw.ac.at | www.oeaw.ac.at/acdh > >

1 0

Setting multiple CSV EXPORTER options is not documented on docs.basex.org
by Omar Siam 02 Oct '24

02 Oct '24

Hi, I just tried after some time to script a CSV export with a BXS file. I forgot how to set multiple options for the csv serialization. In the end this worked: <set option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> I can not find it on docs.basex.org. Perhaps this should be added and explained. Best regards -- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam(a)oeaw.ac.at | www.oeaw.ac.at/acdh

3 4

Equivalent of eXist's util:wait in BaseX?
by Joe Wicentowski 27 Sep '24

27 Sep '24

Hi all, I'm retrieving content from a list of URLs with BaseX (via the http:send-request function) and appear to be hitting rate limits on the remote server. I'd like to pause for 5 seconds between requests. In eXist, I'd use util:wait [1] to handle this pause. Is there an equivalent in BaseX? Or is there a different approach in BaseX? Thanks! Joe [1] https://exist-db.org/exist/apps/fundocs/view.html?uri=http://exist-db.org/x…

2 2

Re: [basex-talk] Error with function-lookup and static variable
by Rob Stapper 21 Sep '24

21 Sep '24

Perfect. Cascaded function-calls through variables within self-recursive constructs work fine now. mvgr. Rob Stapper

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk