BaseX-Talk

basex-talk@mailman.uni-konstanz.de

4 participants
5268 discussions

Optimize broke my database(s)
by Florian Wagner 24 Sep '18

24 Sep '18

Hey everone, we're close to going live with a project built upon BaseX with largish Databases (the biggest one being about 6 GB unoptimized). We have a regular nightly full-optimize job. One run this weekend seems to have broken two of our databases. There's single error message per broken database in our logs: java.io.FileNotFoundException: /var/db/basex/[...]_1151592207/inf.basex (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:162) at org.basex.io.IOFile.outputStream(IOFile.java:158) at org.basex.io.out.DataOutput.<init>(DataOutput.java:47) at org.basex.io.out.DataOutput.<init>(DataOutput.java:36) at org.basex.data.DiskData.write(DiskData.java:137) at org.basex.data.DiskData.close(DiskData.java:160) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:145) at org.basex.query.up.primitives.db.DBOptimize.apply(DBOptimize.java:124) at org.basex.query.up.DataUpdates.apply(DataUpdates.java:175) at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) at org.basex.query.up.Updates.apply(Updates.java:157) at org.basex.query.QueryContext.iter(QueryContext.java:346) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) at org.basex.core.jobs.QueryJob.run(QueryJob.java:165) at java.lang.Thread.run(Thread.java:748) The DBAs "Databases" page still lists the broken dbs including the size and a last-modified date of the Job time. But clicking them gets you a detail page with no details, documents, no Add... / Delete / Copy.. buttons and the backup buttons being disable. Ideas how to go from here are greatly appreciated? Any chance getting our database contents back? Grüße Florian Wagner --- Universitaetsbibliothek Tuebingen Wilhelmstr. 32, 72074 Tuebingen IT-Abteilung, Raum B102 +49(0)7071/29-77860 http://www.ub.uni-tuebingen.de

2 1

Wiki Question
by Bridger Dyson-Smith 24 Sep '18

24 Sep '18

Hi all - A quick question about a function name in the wiki: is the convert function: `convert:binary-to-integer()` or `convert:binary-to-integers()`[1]? Thank you and have a nice weekend! Bridger [1] http://docs.basex.org/wiki/Conversion_Module#convert:binary-to-integers

2 2

.basex setup
by kalibuk＠centrum.cz 24 Sep '18

24 Sep '18

Hi all, I'm wondering with my colleague Radim how to setup settings in .basex file. We have not found any detailed documentation what the concrete field set. We had problems with interrupting file upload to database so we played around and so changing the PARALLEL from 8 to 60(!) helped. Also increasid CACHETIMEOUT and TIMEOUT for different reasons. Anybody have detailed documentation of what we set up, what all it affects, what are the ranges of values, and such for these settings? Regards, Jan

2 1

basexhttp errors
by radim-havlicek＠post.cz 20 Sep '18

20 Sep '18

Hello. When I start basexhttp.bat, following errors display: Starting Process basexhttp SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/C:/Program%20Files%20(x86)/BaseX/lib/slf4 j-simple-1.7.13.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/C:/Program%20Files%20(x86)/BaseX/lib/slf4 j-simple-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.SimpleLoggerFactory] [main] WARN org.eclipse.jetty.xml.XmlConfiguration - Config error at <Call name="addConnector"><Arg> <New id="httpConnector" class="org.eclipse.jetty.server. ServerConnector"><Arg name="server"><Ref refid="Server"/></Arg><Set name= "host">0.0.0.0</Set><Set name="port">8984</Set><Set name="idleTimeout">60000 </Set><Set name="reuseAddress">true</Set></New> </Arg></Call> java.lang.IllegalStateException: No object for id=null How can I correct it? Thank you in advance for your help. Best regards, Radim Havlicek

2 1

web:response-header & Set-Cookie
by Bogdan Bogucki 18 Sep '18

18 Sep '18

Hello, When I try invoke following code: return ( web:response-header( map { 'media-type': web:content-type($path) }, map { 'Cache-Control': 'max-age=3600,public' }, map { 'Set-Cookie': 'JSESSIONID=' || session:id() || ';max-age=1800' } ), file:read-binary($path) } I receive error: [XPTY0004] Unknown option 'Set-Cookie'. I am able to set cookie using <rest:response>. Following code is working: return ( <rest:response> <http:response status="200" message="OK"> <http:header name="media-type" value="{web:content-type($path)}"/> <http:header name="Content-Type" value="text/html"/> <http:header name="Cache-Control" value="max-age=3600,public"/> <http:header name="Set-Cookie" value="{'JSESSIONID=' || session:id() || ';max-age=1800'}"/> </http:response> </rest:response>, file:read-binary($path) ) I think function web:response-header should allow set cookie. Regards Bogdan Bogucki

2 1

First non-null value?
by Graydon Saunders 14 Sep '18

14 Sep '18

let $possible1 as xs:string* := (: go looking for a value via one route :) let $possible2 .... (: all the other routes in preference order :) .... let $foundIt as xs:string := ($possible1,$possible2,$possible3,$possible4,$possible5,'FAILED')[1] This works nicely in terms of "I got the value by the least-bad route". What I'm blanking on is "how do I tell which was the first possibility to match?" without resorting to sprawl of if-then-else statements. I have the idea that there must be a compact way but I have no idea what it is if there is. Any suggestions? Thanks! Graydon

3 3

dB:update()
by ＠pyschny.de 12 Sep '18

12 Sep '18

I want to solve the following problem: For $doc in $list-of-docs detect differences in doc against the basex-db and add the changed records to the basex-db. After differences of each doc are added to the basex-dB create a new index for basex-dB which is required for the next $doc How can I solve the problem that the added records are not visible for the index creation? Michael

2 1

comparing basex and csv datasets
by ＠pyschny.de 10 Sep '18

10 Sep '18

Dear basex and xquery experts, I have to solve the following problem: On a daily basis I get data packages in csv format (approx.. 20.000 records) I imported the 1st package to basex-DB and want to import further changed or new records from the daily deliveries. I tried several solutions but cannot get a solution which is performant enough to be executed every day. While importing complete packages takes a few seconds – comparing against records in the database requires hours. So I decided to use the index variant which is described by Christian Grün. My core code looks as follows: let $db = db:open(‘mydb’) let $ndx = db:open(‘mydb-index’) let $xml := csv:parse($csv, map { "header": true(), "separator": ';' }) let $xml := ( for $x in subsequence($xml//record,2) count $c return if( local:recordUpdated( $x, ‘mydb’, $ndx)) then ( element {'record'} { attribute {'recno'} {$c}, $x/child::*} ) else () ) (: Aufnahme der Differenzen in die DB :) db:replace( $dbname, $tpalow||"/"||$seqno, $xml) declare function local:recordUpdated( $rec, $dbname, $ndx as item()*) as xs:boolean { let $id := $ndx//vp[@ptn=$rec/_14_TPA-Key_VP/text() and @tarif=$rec/_28_TPA-Key_Tarif/text()]/id return if( $id) then ( let $oldrec := db:open-id($dbname, $id)/.. return not(deep-equal($oldrec/child::*, $rec/child::*)) ) else true() }; Both databases ‘mydb’ and ‘mydb-index’ are created with attribute and text indexes. After each run the index is newly created to point to the newest records for the given key values. Can anybody point out why this process takes more than a second per each single record to compare? Thanks for your time

1 0

Example xquery needed to write output to an local xml file
by Marco Roling 06 Sep '18

06 Sep '18

Dear all, I am new on the block here, and trying to find my way around BaseX, which seems to meet my needs for my research on digital museum collection data analysis. I have a very large collection of xml files (> 600000 files) that I am querying, and I want to write the returned result immediately in a file. The following xquery (see below) is not working, which probably comes as no surprise to you all. But to get me started, I would like to have a simple example that works. Any example would do. Hope anyone can help me out with this. Thanks very much, best, Marco. ===== declare variable $data := collection(PRODRMCollectionItems); declare variable $output := 'C:\DATAQUERY\BaseX\Q001\outputPROD'; (:This is where all the work is happening:) declare function local:process-data ($nodes as item()*) as element (root) { <RMCollectionItemsDATA created="{current-dateTime()}"> { for $a in $nodes//artObjectGetResponse/artObject[objectNumber eq 'NG-NM-1395-A'] return <item>{$a}</item> } </RMCollectionItemsDATA> }; (:here we store stuff:) let $filename := concat($output, "marco.xml") return file:write($filename, local:process-data($data)) =====

4 5

diacritics sensitive not working
by Ron Katriel 03 Sep '18

03 Sep '18

Hi, The following from your website (docs.basex.org/wiki/Full-Text) appears to be syntactically incorrect "'Äpfel' will not be found..." contains text "Apfel" diacritics sensitive In the BaseX GUI the keyword diacritics is underlined in red and the following error is reported Unexpected end of query: 'diacritic sens...'. This happens in version 8.6.4 and also the latest (9.0.2). Thanks, Ron *Ron Katriel, Ph.D. *| Principal Data Scientist | Medidata Solutions <http://www.mdsol.com/> 350 Hudson Street, 7th Floor, New York, NY 10014 rkatriel(a)mdsol.com <tbrophy(a)mdsol.com> | direct: +1 201 337 3622 <//201%20337%203622> | mobile: +1 201 675 5598 <//mobile:%20+1%20201%20675%205598> | main: +1 212 918 1800 <//+1%20212%20918%201800>

4 15

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk