BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Identify Unparseable XML Files in File System
by Eliot Kimber 26 Feb '22

26 Feb '22

My validation server loads all the XML documents it can from the file system. I have “skipcorrupt” set to true so that non-well-formed documents don’t fail the database creation or update attempt. However, as part of my validation services, I need to be able to report those documents that are not well formed and therefore didn’t make it into the database. I’m wondering what the easiest/most efficient way to do that would be within BaseX? I’m working with on the order of 36K files. The files as stored in BaseX have the same path and filename as the files on the file system relative to the directory I import from, so the correlation between files and docs in BaseX is direct and simple. One easy solution would be to simply get the disjoint of the list of files on the file system and the docs in the database and then attempt to load each file to verify that is in fact unparseable and not just not-yet-imported. But maybe there’s a more direct way that I’ve overlooked? Thanks, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 2

Integration with LDAP for Authentication?
by Eliot Kimber 26 Feb '22

26 Feb '22

For my validation application (now christened “Project Mirabel” after the Encanto character Mirabel Madrigal), I want to add user validation and authentication via connection to our internal LDAP server I think the solution is to build a custom version of BaseX server that replaces the build-in base User implementation with one that uses JNDI to talk to the LDAP server for user validation and authentication. Looking at the Java code I’m not quite sure what the best way to go about this is but I think it’s to provide a library that provides my custom LDAP-using User classes and then replace the built-in user module implementation with one that uses my User classes rather than the base User classes. Am I on the right track? I didn’t see anything that looked like a way to do a run-time configuration of the classes used for authentication. I kind of expected something like a UserValidator interface that is then used by the UserCheck implementation, which would allow for different UserValidator implementations to be set at runtime but the code is much simpler than that, which is obviously sufficient for the majority of BaseX uses. Thanks, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 0

Multithreading
by Philip Oliver 26 Feb '22

26 Feb '22

There are some very old messages regarding the subject of multithreading in the BaseX server but nothing recent that I can find. With the proliferation of CPUs with large core counts, it seems logical to revisit the topic so that a BaseX server can make efficient use of that resource. Has this been considered lately? BaseX is a fantastic system but I'm afraid that it receives less attention than it should because competitors, particularly Elasticsearch/OpenSearch, are architected to take advantage of multithreading and clustering. In my case, the vast majority of the time, the engine is used on a static database, for full text searching. Even a constrained case of permitted multithreading on a (temporarily) read-only database would be very useful.

1 0

Develop a module, HOWTO
by Ben Engbers 25 Feb '22

25 Feb '22

Hi, I know that it is possible to create a module with functions (I have even done that once), but I can't find the documentation anymore on how to do that. Could please someone provide the URL to this information? Thanks, Ben Engbers

3 3

.
by Christian Grün 24 Feb '22

24 Feb '22

It’s a dire day. We wish safety and the rapid establishment of peace to our fellows and friends in Ukraine. BaseX 9.7 was scheduled for today, it will be postponed.

3 4

string-join with a newline separator?
by Ben Engbers 24 Feb '22

24 Feb '22

Hi, My xml has the structure <base> <element1> <al-group> <al>bla</al> </al-group> </element1> <element1> <al-group> <al>bla</al> </al-group> <al-group> <al>bla</al> </al-group> </element1> </base> The <al-group> element contains 1 to many <al> elements. let $tekst := fn:string-join(fn:data($par//al/text()), ".") concatenates this to: bla.bla.bla But I want it to return: bla bla bla Is it possible to add a newline item-separator to fn:string-join? Ben Engbers

4 4

How to call XQuery function from Java?
by Paul L. Merchant Jr. 23 Feb '22

23 Feb '22

Is it possible for a Java function called from XQuery in BaseX to call back to an XQuery function that's passed to it in BaseX? I haven't been able to find any documentation or examples of this. I got the following example to work, but it doesn't feel right. Is there a better way that might take advantage of the automatic type conversions BaseX performs and doesn't require calling something named "...Internal"? Thanks! ------------------- xquery ------------------- import module namspace java = 'java:my.Module; declare function local:hello($p as xs:string) as xs:string { concat("Hello ", $p) }; java:invoke(local:hello#1) ------------------- Java ------------------- package my; import java.io.UnsupportedEncodingException; import org.basex.query.QueryException; import org.basex.query.QueryModule; import org.basex.query.value.type.AtomType; import org.basex.query.value.item.FuncItem; import org.basex.query.value.item.Str; import org.basex.query.value.Value; import org.basex.util.InputInfo; public class Module extends QueryModule { public String invoke(final FuncItem func) throws UnsupportedEncodingException, QueryException { InputInfo ii = new InputInfo("my.Module.invoke", 0, 0); String s = "Java"; Str p1 = new Str(s.getBytes("UTF-8"), AtomType.STRING); Value[] args = new Value[] {p1}; String r = (String) func.invokeInternal(queryContext, ii, args).toJava(); return r; } }

2 1

Content is not allowed in prolog
by Ben Engbers 23 Feb '22

23 Feb '22

Hi, I have a directory with 12 testfiles. In the BaseX-GUI, the command: CREATE DB Parl_Test /home/bengbers/R/x86_64-redhat-linux-gnu-library/4.1/RBaseX/extdata/xml_files/ Creates database "Parl_Test" and loads the xml-files. In my R-client, Session$Create("Parl_Test") creates database "Parl_test"=> OK I want to create the same database with my client. I initialize the variable "XML_Files" with "/home/bengbers/R/x86_64-redhat-linux-gnu-library/4.1/RBaseX/extdata/xml_files". The client translates the command: Session$Create("Parl_Test", XML_Files) into a raw vector: '\bParl_Test\0/home/bengbers/R/x86_64-redhat-linux-gnu-library/4.1/RBaseX/extdata/xml_files' which is sent to the server. But the server responds with: "\"Parl_Test.xml\" (Regel 1): Content is not allowed in prolog." I didn't touch the xml-files. Where is the content inserted? Ben Engbers

3 13

feature request: opening database at arbitrary file path
by Eric Levy 22 Feb '22

22 Feb '22

I recently learned that BaseX offers no true support for access to a database given directly by its path. In contrast, opening a database by file path is a well-established pattern in embedded databases, seen for example in SQLite, which permits use of any database given by an arbitrary path, without any dependence on external configuration or other data elsewhere on the system. I wish to submit as a feature request the suggestion that BaseX include similar support.

6 23

Faster in the cloud?
by Jonathan Robie 22 Feb '22

22 Feb '22

If I am running my queries and updates on a typical laptop, would they run much faster if I ran them on a suitably configured instance in the cloud? I know this is a very general question, but I'm wondering what experiences y'all have had with this. Jonathan

6 8

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk