- BaseX-Talk - mailman.uni-konstanz.de

inspect:functions does not return updating functions
by Rob Stapper 21 Feb '18

21 Feb '18

Hi Christian, After a period of focussing on Angular I'm back at to BaseX ;-). I found that the inspect:functions function does not return updating functions. Is that by design? I would like to be able to use the inspect:functions function for triggering my update function on the server side, which of course are updating functions TIA for you reply, Cheers, Rob Stapper

3 7

oXygen XML, content negotiation and #1220
by Omar Siam 20 Feb '18

20 Feb '18

Hi list! I like my oXygen editor to request raw XML data from my RESTxq endpoints to test XSL stylesheets. When I do this with RESTxq paths that have different %rest:produces it fails with the BASX0003 multiple functions error. Turns out oXygen sends application/xml, */* as Accept header without any quality. I understand that as documented in https://github.com/BaseXdb/basex/issues/1220 this is known not to work. My/our workaround is to branch in a single XQuery function using sth. like: if (some $a in tokenize(request:header("ACCEPT"), ',') satisfies $a = ('text/xml', 'application/xml')) then $xml else $xhtml I hope this is still on the agenda for 8.7. Best regards Omar Siam

3 7

Preparing BaseX 8.5.4 (please don't forget Issue #1341)
by Jan Dölle 20 Feb '18

20 Feb '18

Hi, we noticed you prepare release 8.5.4. Please don't forget to fix issue: SQL with BaseX 8.5.3 #1341 Thx Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

4 5

General XQuery Help: identity transform best practices
by Bridger Dyson-Smith 19 Feb '18

19 Feb '18

Hi list -- apologies if you've seen this message in other mailing lists or IRC. This isn't BaseX-specific, and so I hope that's not troublesome. I'm trying to develop a better understanding of how to leverage the identity transform pattern (or whatever the best term would be) in XQuery. Based on some web searching, typeswitch seemed to be the recommended method; e.g. [1]. But I would run into problems with using `case element($node[@name='first') return local:do-something-specific-with-this($node)`. After some chat with Liam on IRC yesterday, he gave me the idea of trying a plain(er) `switch` but I couldn't quite work out the comparison of a local-name($node) to the atomized value, especially when I needed to evaluted an XPath expression as part of the `case`. Eventually I settled on if-then-else; e.g. [2]. It feels a little unwieldy. Note that in my (typical) usecases I'm transforming entire documents, see [3] for example output. I can't help but wonder though: it there a better way to handle this? Am I missing something obvious with the typeswitch method? I started with XSLT and I feel like maybe I'm doing something wrong :). Thanks for any suggestions or pointers you can offer. Best, Bridger PS Again, hopefully this isn't too off-topic for the list. (: [1] identity transform with typeswitch :) declare variable $input := <docs> <doc> <title>ABC: The Alphabet</title> <author>Some Person</author> <fields> <field name="first">First Field</field> <field name="second">Second Field</field> </fields> </doc> </docs>; declare function local:passthru( $node as node()* ){ local:dispatch($node/node()) }; declare function local:dispatch( $nodes as node()* ) as item()* { for $node in $nodes return typeswitch($node) case text() return $node case element(docs) return local:passthru($node) case element(doc) return local:docf($node) case element(title) return local:title($node) case element(author) return local:author($node) case element(fields) return local:passthru($node) case element(field) return () (:return empty sequence:) default return local:passthru($node) }; declare function local:docf($node) { <new>{local:dispatch($node/node())}</new> }; declare function local:title($node) { <new-title>{local:dispatch($node/node())}</new-title> }; declare function local:author($node) { <new-author>{local:dispatch($node/node())}</new-author> }; local:dispatch($input) (: [2] identity transform with if-then-else :) declare function local:dispatch( $nodes as node()* ) as item()* { for $node in $nodes return( if ($node instance of text()) then $node/data() else (), if (fn:local-name($node) = 'docs') then local:passthru($node) else (), if (fn:local-name($node) = 'doc') then local:docf($node) else (), if (fn:local-name($node) = 'title') then local:title($node) else (), if (fn:local-name($node) = 'author') then local:author($node) else (), if (fn:local-name($node) = 'fields') then local:passthru($node) else (), if (fn:local-name($node) = 'field' and $node/@name='first') then local:field-1($node) else (), if (fn:local-name($node) = 'field' and $node/@name='second') then local:field-2($node) else () ) }; (: [3] sample output :) <new> <new-title>ABC: The Alphabet</new-title> <new-author>Some Person</new-author> <new-subject>First Field</new-subject> <new-section> <new-entry>Second Field</new-entry> </new-section> </new>

3 4

JSON input files
by Jonathan Robie 08 Feb '18

08 Feb '18

I would like to add a JSON file to a collection that is otherwise composed of XML files. I'm hitting two issues: 1. Is there any way to import both JSON and XML files at the same time when creating a database? 2. I would like to import the JSON as an XQuery/XPath map, without mapping it to XML. Any way to do that? Thanks! Jonathan P.S. the input JSON looks like this: { "ααρων": { "gk": 2, "strongs": [ 2 ], "lemma": "Ἀαρών", "transliteration": "Aarōn", "frequencyCount": 5, "definition": "Aaron, pr. name, indecl., the brother of Moses (Exod. 4:14), Lk. 1:15; Acts 7:40; Heb. 5:4; 7:11; 9:4*" }, When I import it, I get this: <json type="object"> <ααρων type="object"> <gk type="number">2</gk> <strongs type="array"> <_ type="number">2</_> </strongs> <lemma>Ἀαρών</lemma> <transliteration>Aarōn</transliteration> <frequencyCount type="number">5</frequencyCount> <definition>Aaron, pr. name, indecl., the brother of Moses (Exod. 4:14), Lk. 1:15; Acts 7:40; Heb. 5:4; 7:11; 9:4*</definition> </ααρων> <αβαδδων type="object"> <gk type="number">3</gk> etc.

2 1

Performance of Query joining two documents
by wd＠creativosdigitales.co 07 Feb '18

07 Feb '18

Hi, Im using BaseX to compare two XML documents with a list of items <asset> identified by an element <assetid> and with a Now I need to consolidate them in only one document with the value of the <category> element in both documents (one of them renamed to <prev-category>). Attached are samples of these documents., and the quey Im using is this: declare function local:compare( $actual, $prev ){ for $c in $actual/asset return <asset> { $c/*} <prev-category> { $prev/asset[assetid = $c/assetid]/category/text() } </prev-category> </asset> }; declare variable $act external := "2017-07"; declare variable $prv external := "2016-07"; return local:compare(/portfolio[projectid=$act], /portfolio[projectid=$prv] ) The query takes 42 seconds when run over the files. If I load the files to a database and activate the text index, it takes 125 seconds. This is a very common query in relational databases that takes only few seconds to run joining two tables or two subqueries. Is there a way to make it run faster in BaseX? Thanks for your advice, William David Velásquez Creativo de Software Creativos Digitales S.A.S. Calle 30A # 83 - 53 Local 1033 Tel: 322 1730 - 311 709 8421 Medellín, Colombia <http://creativosdigitales.co/> http://creativosdigitales.co

3 2

One document per database or multiple?
by Jonathan Robie 06 Feb '18

06 Feb '18

If I have a set of related documents (a text, a lexicon, frequency counts, a discourse analysis, etc), how should I decide when to put more than one document in a single database at different paths, as opposed to putting one document in each database? When I create a database from the GUI, it seems to prefer one document per database. Should I take that as a hint? Jonathan

3 3

how to declare an updating function parameter in a high-order function signature ?
by Fabrice ETANCHAUD 06 Feb '18

06 Feb '18

Dear all, I cannot find a way to tell the xquey engine that a function parameter of my high-order function is updating : declare %updating function etebac:build-updating($file as xs:string, $builder as %updating function(*) ) { for tumbling window $line in (file:read-text-lines($file)) start $start-item when etebac:record-header($start-item) = '01' end $end-item when etebac:record-header($end-item) = '07' let $doc := etebac:build-json($line) let $start := format-date(xs:date($doc/date-ancien-solde), '[Y0001][M01][D01]') let $stop := format-date(xs:date($doc/date), '[Y0001][M01][D01]') let $doc-id := string-join(($doc/rib, $start, $stop), '-') let $doc-path := string-join( ($doc/(banque, guichet, compte), $start || '-' || $stop), '/') let $out-file := concat($doc-path, '.json') where count($doc/operations/_) > 0 return $builder( $doc-path, element json { attribute type { 'object' }, element meta { attribute type { 'object' }, element type { 'releve-operations' }, element id { $doc-id } }, element data { $doc/(*|@*) } } ) }; I have a [XPTY0004] Function must not be updating: %updating function($path,$doc) a... error. The outer call is : import module namespace etebac = 'http://pch.cerfrance.fr/basex/modules/etebac' at 'etebac.xqm'; etebac:build-updating('D:\edi\banque\input\10278\10278_CMLACO_20160701.183', db:replace('test', ?, ?) ) What have I to do to tag my $builder function reference as updating in the main body ? Best regards from the snowy french atlantic coast, Fabrice

2 2

How to send Mails
by Navin Rawat 05 Feb '18

05 Feb '18

Hi Team, Is there any way to send mails through BaseX to the users? Regards, Navin

2 1

Dynamic xpath
by France Baril 05 Feb '18

05 Feb '18

I'm trying to do something similar to this because I'll have to deal with xpaths provided by end users as parameters to a rest query: var xpath='div/p' for $i in db:open('en-us'){$xpath} return $i I saw that it's possible to do it with other tools, but I didn't find if it's possible with xquery and BaseX. How SQL dbs do it: SET @XML1=' <Root> <Device> <Inspection> <Status>OK</Status> </Inspection> </Device> </Root>' SET @PATH = '/Root[1]/Device[1]/Inspection[1]/Status[1]' SELECT @XML1.query(@PATH) Any suggestion that doesn't involve analyzing the query string and trying to rebuild it in some way? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 2

Big Surprise from outputs in version 7.3.1 and 8.6.7 ?
by Bang Pham Huu 02 Feb '18

02 Feb '18

Hello, I've been using BaseX to query an XML file in version 7.3.1 and it worked well. However, because of this problem https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg10241.ht… and I was suggested to use version 8.6.7 then I changed to use this version in a Java Web application which queries the old BaseX files from version 7.3.1. However, I didn't know that this version changes created a very surprise result between version 7.3.1 and 8.6.7 (i.e: data is missing in version 8.6.7 from output result !!!). Could someone tell me why it happens and how to use BaseX version 8.6.7 on BaseX database from version 7.3.1. Here is the difference between 2 outputs on same old BaseX database version 7.3.1 (left: 8.6.7, right: 7.3.1) with same XQuery: https://www.diffchecker.com/iCgLhRUx The XQuery is: declare namespace gml = "http://www.opengis.net/gml/3.2"; declare function local:get-children() { let $x := collection('userdb')//gml:identifier/text() return if (exists($x)) then for $i in $x return $i else <empty/> }; let $x := distinct-values(local:get-children()) for $i in $x return $i Thanks,

4 13

SqlExecutePrepared, Oracle and getParameterCount again
by Jan Dölle 01 Feb '18

01 Feb '18

Hi, I found any other issue on using Oracle SQL in BaseX by SqlExecutePrepared. It caused by stmt.getParameterMetaData().getParameterCount(). The current workaround ignores the thrown Exception and will continue the statement execution. But produce may open cursors on in the Database. So finally it will run into ora-1000 "Maximum open cursors exceeded." By totally avoiding the call of getParameterCount this issue will avoid. So I will provide an other fix. What do you prefer: a) check for "Oracle" in stmt.getConnection().getMetaData().getDatabaseProductName() and skip the parameter test at all or b) add an other option "checkParameters" (default true) like "timeout" and skip getParameterCount if it is set to false. I personal prefer a). Cheers, Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

2 3

BaseX 9.0 (still to come): Improved text compression
by Christian Grün 01 Feb '18

01 Feb '18

Hi all, with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1]. Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well. All the best, Christian [1] https://github.com/BaseXdb/basex/issues/1536

2 4

xml element beginning and end space loss
by Stefania Axo 01 Feb '18

01 Feb '18

Hi all! is there a way to preserve the beginning and ending spaces in the Database xml elements? In other words If I execute this xQuery db:replace("MyDB", "doc.xml", "<a> stefy </a>") the resulted document will be <a>stefy</a> As you can see I lost my beginner and ending spaces. thanks Stefania

3 4

Stateless server without sessions
by Christoph Gaukel 01 Feb '18

01 Feb '18

Hi Team, i designed a service that uses web tokens to identify the users and i try to run this service really stateless, that says without creating any sessions. The service runs as basexhttp and uses Jetty. Is there a parameter, that prevents it from creating sessions at all? Currently curl writes: < HTTP/1.1 406 Not Acceptable < *Set-Cookie: JSESSIONID=1tgnabd2l6y3p1jpg8qv3hb53d;Path=/* < Expires: Thu, 01 Jan 1970 00:00:00 GMT < Content-Type: text/plain;charset=UTF-8 < Content-Length: 19 < Server: Jetty(8.1.18.v20150929) and the service adds a new session per call: sessions: "1gnn17n91gsmuc9grvk417ne 1xim2bo4bmtvr11e4a8tap8cl8 kiy3rq9j5lyq1hf6gf8vy4td2 s5luvfkvdpjv19ikpzqeev9k2 mn50c33fxflz17jv24oc68baw 1tgnabd2l6y3p1jpg8qv3hb53d" Best regards, Christoph

2 3

INFO and dp:system() show different values
by Lars Johnsen 29 Jan '18

29 Jan '18

Hi all when restarting a http-server, the script for accessing no longer finds the databases using db:open(). The path to the database using INFO in command line basex says one thing, while output from db:system() is different db:system() .../basex-webapp/webapp/WEB-INF/data INFO: .../basex-webapp/data The folder /webapp is where the scripts are. There is only one file .basex which contain the same as shown with INFO, which resides under folder /basex-webapp. Any thoughts? Best Lars

2 1

Special Character Search - @, $,#
by Navin Rawat 24 Jan '18

24 Jan '18

Hi Team, Could I search @, $, # by full text API of bases? I am using following query but unable to get any success: let $query := '@' let $options := map { "mode": "any", "fuzzy": "off", "wildcards": true(), "ordered": "false" } return ft:search("database", $query, $options) Please suggest. Regards, Navin

2 1

BaseX File Module : access network folder on windows server
by Dieter Zanzinger 22 Jan '18

22 Jan '18

I am working with den BaseX-File-Module for a while and can access a local folder, for example: file:list('C:/'). Now I want the same in a Windows network. If I create a folder on the Desktop of the local machine = localhost and give it a "Freigabe" with "Freigabename" netzlaufwerktestF, it is possible to list it´s contents with: file:list('//WIN7PROPARPC/netzlaufwerktestF/'). Now I try the same with a folder on a server, which I can access by windows explorer. I expected the following to work: file:list('//SERVERNAME_or_IP/Freigabename/') But I get only errors. Does anybody know the right way to access a network folder with the file module of BaseX under windows? (I didn´t find anything in the wiki or by google). Thanks in advance Dieter Zanzinger

3 2

BaseX 9.0 sql:prepare not working
by Jan Dölle 22 Jan '18

22 Jan '18

Hi, the function sql:prepare it not longer working Best Regards Jan ( sql:init("org.sqlite.JDBC"), let $conn := sql:connect("jdbc:sqlite:database.db") let $prep := sql:prepare($conn, "select 'Nothing'") let $result := sql:execute-prepared($prep) return ( $result, sql:close($prep), sql:close($conn) ) ) -> Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.0 beta Java: Oracle Corporation, 1.8.0_151 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.Token.string(Token.java:87) at org.basex.query.func.sql.JDBCConnections.add(JDBCConnections.java:42) at org.basex.query.func.sql.SqlPrepare.item(SqlPrepare.java:27) at org.basex.query.func.sql.SqlPrepare.item(SqlPrepare.java:1) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:71) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:177) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:87) at org.basex.query.QueryContext.next(QueryContext.java:398) at org.basex.query.expr.List$1.next(List.java:119) at org.basex.query.QueryContext.next(QueryContext.java:398) at org.basex.query.scope.MainModule$1.next(MainModule.java:122) at org.basex.query.QueryContext.next(QueryContext.java:398) at org.basex.query.QueryContext.cache(QueryContext.java:620) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:112) at org.basex.core.cmd.AQuery.query(AQuery.java:86) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:430) at org.basex.gui.GUI.lambda$4(GUI.java:373) at java.lang.Thread.run(Thread.java:748) -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

2 1

Licensing issue
by Benoit Maisonny 19 Jan '18

19 Jan '18

Hello, I just realised that the basex-api Maven artifact depends on milton-api 1.8, which is released under GPLv3 (this is declared in its parent pom). That means that basex-api, and any software that is distributed with it, must be released under GPLv3 as well... Are BaseX developers aware of that? Note that the current milton library v2 is released under Apache license. Is there any intention to upgrade to milton v2 (is it even possible)? Thanks, Benoit

3 3

delete .jar without version using repo:delete()
by Wissemann, Bodo 19 Jan '18

19 Jan '18

2 2

Web Applications: permission handling
by Christian Grün 18 Jan '18

18 Jan '18

Hi everyone, With BaseX 9.0, permission handling in web applications will be further simplified. We have just finalized a new light-weight permission layer that allows you to: • attach permission strings to RESTXQ functions and • disallow evaluation of such functions via annotated security functions. More details can be found in the documentation [1]. Thanks to those who gave helpful feedback! A new snapshot is available [2]; the DBA has already been rewritten to take advantage of the new annotations. In future versions, we might provide built-in support for various authentication methods (LDAP, OAuth, etc.), and the permission layer could possibly be extended to the other BaseX APIs as well. Looking forward to your feedback, Christian [1] http://docs.basex.org/wiki/Permissions [2] http://files.basex.org/releases/latest/

1 0

proc:system and bash redirecting
by Kristian Kankainen 18 Jan '18

18 Jan '18

Hello! I need to redirect the content of a file into a program using stdin. In my shell I would do like this (silly example): wc < somefile Is this possible to do with proc:system? Giving "<" as an argument to the command doesn't work: proc:system("wc", ("<", "somefile")) outputs [BXPR0001] wc: <: No such file or directory Is there any way around this? The program I need to call can only read from stdin. Best regards, Kristian K

2 1

Can BaseX support absolute/relative paths in validation:xsd(doc) if no second argument provided?
by Aleksandr Shapovaov 17 Jan '18

17 Jan '18

Hello, I've just discovered BaseX and decided to make some experiments. One of them is, suppose I have several documents (data + schemas), something like this: sys/core.xsd <?xml version="1.0"?> <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns="urn:SYS-CORE" targetNamespace="urn:SYS-CORE"> <xs:attribute name="category" type="xs:normalizedString"/> </xs:schema> lib/album.xsd <?xml version="1.0"?> <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:SYS-CORE ../sys/core.xsd" xmlns:sys="urn:SYS-CORE" xmlns="urn:LIB-ALBUM" targetNamespace="urn:LIB-ALBUM"> <xs:import namespace="urn:SYS-CORE"/> <xs:element name="album"> <xs:complexType> <xs:sequence> <xs:element ref="title" minOccurs="1" maxOccurs="1"/> </xs:sequence> <xs:attribute ref="sys:category" use="required"/> </xs:complexType> </xs:element> <xs:element name="title" type="xs:normalizedString"/> </xs:schema> usr/albums/album1.xml <?xml version="1.0"?> <album xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="urn:LIB-ALBUM ../../lib/album.xsd" xmlns:sys="urn:SYS-CORE" sys:category="albums" xmlns="urn:LIB-ALBUM"> <title>Album #1</title> </album> I'm uploading these documents using a Python script (I'm using BaseXClient) preserving the file system hierarchy structure I defined above. If I open the documents in IntelliJ IDEA, I can be sure that the documents are valid (I mean, I don't see XSD validation errors), therefore I'm assuming they are valid by fact. However, if I'm trying to validate the XML documents on the BaseX side session.execute('XQUERY for $doc in collection("%s") where fn:ends-with(fn:base-uri($doc), ".xml") return validate:xsd($doc)' % database) I'm getting the following error [bxerr:BXVA0001] Validation failed: 1:186: schema_reference.4: Failed to read schema document '../../lib/album.xsd', because 1) could not find the document; 2) the document could not be read; 3) the root element of the document is not <xsd:schema>. I'm wondering, what am I doing wrong trying to validate documents directly in BaseX? Can BaseX resolve absolute/relative paths in this case? Thanks in advance! P.S. Apologies if I made something wrong (wrong subject, mailing list, non text/plain email, etc), this is my first time sending an email to a mailing list. P.P.S. This email may contain an ad footer since I use this free email service. If possible, please trim the ad away before it's sent/archived. Thanks! -- реклама ----------------------------------------------------------- http://FREEhost.UA - Купи хостинг или домен и получи сертификат Google AdWords номиналом 900 грн.в подарок! - http://goo.gl/EcgF4I

3 3

Historical reasons in the Database Module
by Kristian Kankainen 17 Jan '18

17 Jan '18

Hello I once again ran into giving the arguments in wrong order to the db:replace function. The docs state, that "For historical reasons, the order of the 2nd and 3rd argument is different to db:add and db:create". Since XQuery is typed, wouldn't it be possible to add to new "cosmetic" functions with the arguments in the "right" order like the following: db:replace($db as xs:string, $input as item(), $path as xs:string) as empty-sequence() db:replace($db as xs:string, $input as item(), $path as xs:string, $options as map(*)?) as empty-sequence() Since the arguments are typed with different types (xs:string vs item()) this over-loading would work without colliding with the historical and swapped ones. Am I wrong? Cheers, Kristian K

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk