BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

right way to create a db in the middle of processing?
by Graydon Saunders 28 Nov '22

28 Nov '22

Hello -- So I've got a pattern where I want to: 1. perform some processing using proc:execute() on a directory tree of XML files (easy) 2. load the result of the processing (a parallel structure tree of XML files) into a new db (in principle, easy; db:create() does this) 3. extract information from the newly created db and write that to a file (easy) 4. use proc:execute() to run different processing on the file written in step 3 (easy, I think) 5. load the result (thankfully a single file) and process it with a query (easy, I can stuff that in a function) Ideally, this winds up as something invoked from a single query file as a sequence of functions because its eventual fate is to be part of an automated test that would ideally be a "run this one thing, look at the boolean result". I hang up on step 2; so far as I can tell, there isn't a way to say "go create a database and then make it usable to these other modules that are guaranteed not to happen until db:create() has completed" but this seems like such a common thing to want to do that I feel like I must be missing something. Thanks! Graydon

5 8

Logging in JSON format
by Huib Verweij 28 Nov '22

28 Nov '22

Hi, from https://docs.basex.org/wiki/Logging I understand all logging in BaseX uses a fixed text format. For our Kibana/Elastic Search logging solution in OpenShift it is recommended to use JSON as the logging format. Is it possible to make BaseX generate logs in JSON format? If not, does anyone have any experience importing the BaseX logs into Kibana/Elastic Search? Hartelijke groet, Huib Verweij.

2 1

Fulltext search with wildcards
by Johannes Bauer 23 Nov '22

23 Nov '22

Hi, I have another question regarding fulltext search performance with wildcards. Our fulltext index is rather big with 1.3 GB and about 500.000 entries. When I use the following search where there are no matches: *ft:search('db', 'CT020/.*/P', map{'wildcards':true()})* it takes about 10 seconds to get the empty result. The query requires a big amount of free memory. If I use this query here (that also has no matches): *ft:search('db', 'CT.*/20/P', map{'wildcards':true()})* it only takes about some milliseconds. Any ideas why the placement of the wildcard has such big impact on the performance? Best Regards Johannes

2 1

Working with custom stores
by Tim Thompson 22 Nov '22

22 Nov '22

Hello, Using the store module, is it possible to read and merge multiple custom stores into main memory, or to set a particular store as context for a query? Or, do I need to serialize the stores, e.g., as JSON and then create databases for them? Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research www.linkedin.com/in/timathompson timothy.thompson(a)yale.edu

2 7

Pretty print
by Giuseppe G. A. Celano 19 Nov '22

19 Nov '22

Hi, I am trying to prettyprint an XML file. I tried the serialization option “indent”=“yes”, but it does not work as expected. On BaseX 9, the prettyprint was the default setting: how to get the same result in BaseX 10 (and later)? Thanks. Best, Giuseppe

8 13

BaseX unreachable behind load balancer
by Harry King 19 Nov '22

19 Nov '22

Hi, I’m wondering if someone might be able to offer a hint or two. I’m attempting to run BaseX in AWS behind a Network Load Balancer (NLB) using the 9.5.2 docker image with the default config to start with. I’ve setup a TCP target group and the healthcheck appears happy on port 1984.Reachability analyser suggests firewall is good to go. From the local box I can telnet localhost 1984: telnet localhost 1984 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. BaseX:3334891053316136 I get a similar response if I use the server’s private IP address: telnet 10.x.x.x 1984 Trying 10.x.x.x... Connected to 10.x.x.x. Escape character is '^]'. BaseX:3335242111998298 So far, so good. If I attempt the same via the NLB I get a timeout, which suggests to me either firewall issue or the application is refusing to listen for some reason. The documentation, seems to suggest by default, basex should respond to requests from any IP or hostname, do I understand that correctly, or do I need to alter the default config? Thanks in advance!

3 3

Dynamic combination search on specific path in BaseX
by DK Singh 15 Nov '22

15 Nov '22

HI I want to perform combination (AND OR) search on the basis of the provided parameter by the user, where user will select the field name e.g.(title, isbn, author) and their value from front-end so here field name will be the parameter for the BaseX. Currently i am asking front-end person the generate below combination query ( (title = "United States" or isbn = "2345371242192") and author ="Jhon" ) Now the all parameter value will be compared to specific XPATH , like below. let $Author := 'David Hare' let $title := "United States " let $isbn:= '2345371242192 ' return db:open('test')/*[(( normalize-space(string-join((*:info/*:author)[1]/*:personname//text()) ) = $Author or $title = *:info/*:title ) and $isbn="*:info/isban")]/base-uri() In the above code XPATH is hardcoded, but I want it to concatenate on the fly once string query comes front-end then it will be passed to Basex . Is there any other way to achieve this? or how should i ask combinations query from front-end so that i could achieve this. Thanks Dharmendra Kumar Singh

2 4

How to store text files in a data base
by Hans-Juergen Rennau 13 Nov '22

13 Nov '22

Hello, I wonder what is the recommended way how to store text files in a database. What occurs to me is the use of db:put-value / db:get-value: Storage: db:put-value($db, $filePath ! file:read-text(.), $dbPath) Retrieval: db:get-value($db, $dbPath) Would you recommend a different approach, e.g. storing and retrieving as a binary? With kind regards,Hans-Jürgen

1 0

GUI doesn't quit on Mac
by Majewski, Steven Dennis (sdm7g) 10 Nov '22

10 Nov '22

I’ve been having a problem for a while where after attempting to quit the Mac GUI, it doesn’t actually exit and has to be force quit. I’m sorry I wasn’t able to track how this tracks with MacOS / JDK / BaseX updates and when it actually started happening. Wondering if anyone else has had this issue, and whether it’s Mac specific or JDK version specific. MacOS 12.6.1 but problem goes back at least to earlier 12.6 versions Openjdk from home-brew install — currently openjdk/19.0.1, but was happening on earlier versions. And the current and last several versions of BaseX — Steve M.

4 7

Reported memory usage in GUI with Store Module
by Tim Thompson 08 Nov '22

08 Nov '22

Hello, I've been experimenting with the new Store module, which seems very handy. I have a custom store that is about 2GB in size. In the GUI (BaseX 10.3 beta), when I try to load it into memory with store:read(), the reported memory usage appears to max out (with 32GB of available memory): Total Memory: 32 GB Reserved Memory: 32 GB Used Memory: 32 GB However, monitoring memory usage with htop shows a smaller increase in memory usage: from 5GB at baseline, it peaks around 15GB, then goes down to 9GB, all while the BaseX GUI appears to be frozen. After a couple of minutes, the store does load, but GUI performance seems to be degraded, and it continues to report max memory usage. Any thoughts? Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research Yale University Library www.linkedin.com/in/timathompson

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk