BaseX-Talk

basex-talk@mailman.uni-konstanz.de

5251 discussions

Performance of Query joining two documents
by wd＠creativosdigitales.co 07 Feb '18

07 Feb '18

Hi, Im using BaseX to compare two XML documents with a list of items <asset> identified by an element <assetid> and with a Now I need to consolidate them in only one document with the value of the <category> element in both documents (one of them renamed to <prev-category>). Attached are samples of these documents., and the quey Im using is this: declare function local:compare( $actual, $prev ){ for $c in $actual/asset return <asset> { $c/*} <prev-category> { $prev/asset[assetid = $c/assetid]/category/text() } </prev-category> </asset> }; declare variable $act external := "2017-07"; declare variable $prv external := "2016-07"; return local:compare(/portfolio[projectid=$act], /portfolio[projectid=$prv] ) The query takes 42 seconds when run over the files. If I load the files to a database and activate the text index, it takes 125 seconds. This is a very common query in relational databases that takes only few seconds to run joining two tables or two subqueries. Is there a way to make it run faster in BaseX? Thanks for your advice, William David Velásquez Creativo de Software Creativos Digitales S.A.S. Calle 30A # 83 - 53 Local 1033 Tel: 322 1730 - 311 709 8421 Medellín, Colombia <http://creativosdigitales.co/> http://creativosdigitales.co

3 2

One document per database or multiple?
by Jonathan Robie 06 Feb '18

06 Feb '18

If I have a set of related documents (a text, a lexicon, frequency counts, a discourse analysis, etc), how should I decide when to put more than one document in a single database at different paths, as opposed to putting one document in each database? When I create a database from the GUI, it seems to prefer one document per database. Should I take that as a hint? Jonathan

3 3

how to declare an updating function parameter in a high-order function signature ?
by Fabrice ETANCHAUD 06 Feb '18

06 Feb '18

Dear all, I cannot find a way to tell the xquey engine that a function parameter of my high-order function is updating : declare %updating function etebac:build-updating($file as xs:string, $builder as %updating function(*) ) { for tumbling window $line in (file:read-text-lines($file)) start $start-item when etebac:record-header($start-item) = '01' end $end-item when etebac:record-header($end-item) = '07' let $doc := etebac:build-json($line) let $start := format-date(xs:date($doc/date-ancien-solde), '[Y0001][M01][D01]') let $stop := format-date(xs:date($doc/date), '[Y0001][M01][D01]') let $doc-id := string-join(($doc/rib, $start, $stop), '-') let $doc-path := string-join( ($doc/(banque, guichet, compte), $start || '-' || $stop), '/') let $out-file := concat($doc-path, '.json') where count($doc/operations/_) > 0 return $builder( $doc-path, element json { attribute type { 'object' }, element meta { attribute type { 'object' }, element type { 'releve-operations' }, element id { $doc-id } }, element data { $doc/(*|@*) } } ) }; I have a [XPTY0004] Function must not be updating: %updating function($path,$doc) a... error. The outer call is : import module namespace etebac = 'http://pch.cerfrance.fr/basex/modules/etebac' at 'etebac.xqm'; etebac:build-updating('D:\edi\banque\input\10278\10278_CMLACO_20160701.183', db:replace('test', ?, ?) ) What have I to do to tag my $builder function reference as updating in the main body ? Best regards from the snowy french atlantic coast, Fabrice

2 2

How to send Mails
by Navin Rawat 05 Feb '18

05 Feb '18

Hi Team, Is there any way to send mails through BaseX to the users? Regards, Navin

2 1

Dynamic xpath
by France Baril 05 Feb '18

05 Feb '18

I'm trying to do something similar to this because I'll have to deal with xpaths provided by end users as parameters to a rest query: var xpath='div/p' for $i in db:open('en-us'){$xpath} return $i I saw that it's possible to do it with other tools, but I didn't find if it's possible with xquery and BaseX. How SQL dbs do it: SET @XML1=' <Root> <Device> <Inspection> <Status>OK</Status> </Inspection> </Device> </Root>' SET @PATH = '/Root[1]/Device[1]/Inspection[1]/Status[1]' SELECT @XML1.query(@PATH) Any suggestion that doesn't involve analyzing the query string and trying to rebuild it in some way? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 2

Big Surprise from outputs in version 7.3.1 and 8.6.7 ?
by Bang Pham Huu 02 Feb '18

02 Feb '18

Hello, I've been using BaseX to query an XML file in version 7.3.1 and it worked well. However, because of this problem https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg10241.ht… and I was suggested to use version 8.6.7 then I changed to use this version in a Java Web application which queries the old BaseX files from version 7.3.1. However, I didn't know that this version changes created a very surprise result between version 7.3.1 and 8.6.7 (i.e: data is missing in version 8.6.7 from output result !!!). Could someone tell me why it happens and how to use BaseX version 8.6.7 on BaseX database from version 7.3.1. Here is the difference between 2 outputs on same old BaseX database version 7.3.1 (left: 8.6.7, right: 7.3.1) with same XQuery: https://www.diffchecker.com/iCgLhRUx The XQuery is: declare namespace gml = "http://www.opengis.net/gml/3.2"; declare function local:get-children() { let $x := collection('userdb')//gml:identifier/text() return if (exists($x)) then for $i in $x return $i else <empty/> }; let $x := distinct-values(local:get-children()) for $i in $x return $i Thanks,

4 13

SqlExecutePrepared, Oracle and getParameterCount again
by Jan Dölle 01 Feb '18

01 Feb '18

Hi, I found any other issue on using Oracle SQL in BaseX by SqlExecutePrepared. It caused by stmt.getParameterMetaData().getParameterCount(). The current workaround ignores the thrown Exception and will continue the statement execution. But produce may open cursors on in the Database. So finally it will run into ora-1000 "Maximum open cursors exceeded." By totally avoiding the call of getParameterCount this issue will avoid. So I will provide an other fix. What do you prefer: a) check for "Oracle" in stmt.getConnection().getMetaData().getDatabaseProductName() and skip the parameter test at all or b) add an other option "checkParameters" (default true) like "timeout" and skip getParameterCount if it is set to false. I personal prefer a). Cheers, Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

2 3

BaseX 9.0 (still to come): Improved text compression
by Christian Grün 01 Feb '18

01 Feb '18

Hi all, with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1]. Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well. All the best, Christian [1] https://github.com/BaseXdb/basex/issues/1536

2 4

xml element beginning and end space loss
by Stefania Axo 01 Feb '18

01 Feb '18

Hi all! is there a way to preserve the beginning and ending spaces in the Database xml elements? In other words If I execute this xQuery db:replace("MyDB", "doc.xml", "<a> stefy </a>") the resulted document will be <a>stefy</a> As you can see I lost my beginner and ending spaces. thanks Stefania

3 4

Stateless server without sessions
by Christoph Gaukel 01 Feb '18

01 Feb '18

Hi Team, i designed a service that uses web tokens to identify the users and i try to run this service really stateless, that says without creating any sessions. The service runs as basexhttp and uses Jetty. Is there a parameter, that prevents it from creating sessions at all? Currently curl writes: < HTTP/1.1 406 Not Acceptable < *Set-Cookie: JSESSIONID=1tgnabd2l6y3p1jpg8qv3hb53d;Path=/* < Expires: Thu, 01 Jan 1970 00:00:00 GMT < Content-Type: text/plain;charset=UTF-8 < Content-Length: 19 < Server: Jetty(8.1.18.v20150929) and the service adds a new session per call: sessions: "1gnn17n91gsmuc9grvk417ne 1xim2bo4bmtvr11e4a8tap8cl8 kiy3rq9j5lyq1hf6gf8vy4td2 s5luvfkvdpjv19ikpzqeev9k2 mn50c33fxflz17jv24oc68baw 1tgnabd2l6y3p1jpg8qv3hb53d" Best regards, Christoph

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk