BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Same query returns different amount of records
by Sebastian Guerrero 18 May '20

18 May '20

Hi everyone! it's me again. Here is my doubt: If I execute this query: * (# db:enforceindex #) { for $db in ('US00','US01','US02') for $tmUS in db:open($db)/trademark-applications-daily/application-information/file-segments/action-keys/case-file where $tmUS/case-file-header/mark-identification/text() contains text { 'apple' } return $tmUS/case-file-header/mark-identification/text() }* I get 4k results in 139ms from three databases of 90GB and 13M of records. It works like a charm. [01] But, if I include that query into a *for* and then into a *switch* ( I tried with *if-then-else* too ), the same query returns only 11 results in 107ms [02]: *declare namespace gb="http://www.ipo.gov.uk/schemas/tm <http://www.ipo.gov.uk/schemas/tm>";* *let $text := "apple"* *let $registries := ('US')* *for $registry in $registries* *return * * switch ($registry)* * case "US"* * return * * (# db:enforceindex #) { * * for $db in ('US00','US01','US02')* * for $tmUS in db:open($db)/trademark-applications-daily/application-information/file-segments/action-keys/case-file* * where $tmUS/case-file-header/mark-identification/text() contains text { $text }* * return $tmUS/case-file-header/mark-identification/text()* * }* * case "GB"* * return* * (# db:enforceindex #) {* * for $tmGB in db:open('GB')/gb:MarkLicenceeExportList/gb:TradeMark* * where $tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text() contains text { $text }* * return $tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text()* * }* * default return "Unknown registry code"* I noticed that removing the case option "GB" ( even if it's not evaluated ), it works fine and returns the 4k records [03]: *declare namespace gb="http://www.ipo.gov.uk/schemas/tm <http://www.ipo.gov.uk/schemas/tm>";* *let $text := "apple"* *let $registries := ('US')* *for $registry in $registries* *return * * switch ($registry)* * case "US"* * return * * (# db:enforceindex #) { * * for $db in ('US00','US01','US02')* * for $tmUS in db:open($db)/trademark-applications-daily/application-information/file-segments/action-keys/case-file* * where $tmUS/case-file-header/mark-identification/text() contains text { $text }* * return $tmUS/case-file-header/mark-identification/text()* * }* * default return "Unknown registry code"* What I'm missing here? is this the right behaviour? Best regards, Sebastian [01] https://imgur.com/o4RUUyO [02] https://imgur.com/533c0rI [03] https://imgur.com/mCb3qEe

2 2

BaseX 9.3.2: Performance Tweaks, Bug Fixes
by Christian Grün 15 May '20

15 May '20

Dear all, We are glad to provide you with a new BaseX 9.3.2 maintenance release: http://basex.org In preparation to version 9.4, we have introduced numerous small query optimizations that speed up path, predicate and simple map operations and will rewrite your queries for index access more often than before. Feel free to check out the full list of added rewritings and enhancements on Github: https://github.com/BaseXdb/basex/issues?q=is%3Aissue+is%3Aclosed Have fun with the new release, Christian BaseX Team

3 5

Storing XML messages
by Ramzi Hammouda 14 May '20

14 May '20

Hello BaseX team, Using Resful API, I'm trying to make POST method update BaseX database, I want to insert an xml node to an existing document calastone.xml in calastone database , but the node contains '<', you replied to a previous email that I should use fn:parse-xml to make this happen without error. I tried using the function fn:parse-xml, I had success with using it in BaseX GUI like this: let $message := fn:parse-xml('<Id>CTN55</Id>') return insert nodes $message as last into doc("calastone/calastone.xml") But when I tried to do the same with POST method from my application with using this xquery: string xquery = "<query><text>let $message:= fn:parse-xml('<Id>CTN58</Id>')" + "return insert nodes $message as last into doc(\"calastone/calastone.xml\")</text>" + "<variable name = 'message' value = fn:parse-xml('<Id>CTN58</Id>'))/></query>"; I get the error: "" (Line 1): Element type "variable" must be followed by either attribute specifications, ">" or "/>" Can you help on how to do this insertion? Thanks. P Respectons ensemble l'environnement. N'imprimez ce message que si n?cessaire. Let's respect the environment together. Only print this message if necessary.

2 1

Directory and files are neither a file or a directory on Basex 9.3.2 when read from Docker volume
by France Baril 14 May '20

14 May '20

Hi, Here is my issue. I create a new container with Basex 9.3.2 I add a volume ContentDBs under my basex directory ContentDBs has 2 directories and 1 files I run this code from an xqm: let $src-dir-items := file:list('ContentDBs') let $debug := file:append('debug-a.xml', 'count: ' || count($src-dir-items) || '
') let $dirs := for $i in $src-dir-items (: Bug items are neither a dir or a file !? Because volume from docker? :) let $debug := file:append('debug-a.xml', 'item: ' || $i || ' is dir: ' || file:is-dir($i) || '
') let $debug := file:append('debug-a.xml', 'item: ' || $i || ' is file: ' || file:is-file($i) || '
') return $i In the debug file, I get. - The count for items is 3 - For all items, is-dir and is-file are false. I get a similar error if I try to db:create from one of the folders, it seems to recognize that I have a folder, but it chokes on subfolders with: Resource 'js/' does not exist. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

I am confused how to specify multiple possible reponses in RestXQ with %rest:produces
by Omar Siam 12 May '20

12 May '20

Hi, Today someone on the exist-open mailing list pointed out how they interpret %rest:produces: If your function produces more types of responses you specify all mime types just the same as with %rest:consumes: %rest:poroduces("application/xml", "application/json", ...) That is as a list of possible reponses all in one annotation. The BaseX docs at https://docs.basex.org/wiki/RESTXQ#Content_Negotiation however are ambigous about this I think. There is an example there with just two %rest:produces annotations on two lines with only one mime type (and a qs value). I think that lead me to belief that to specify multiple possible responses of different mime types you repeat %rest:produces. Rereading the section these two example annotations could also ilustrate the use of %rest:produces in two different functions. Can you please clarify this if possible? Best regards Omar Siam

3 3

GUI "create db" file patterns are not sticky
by Graydon Saunders 12 May '20

12 May '20

This is a very small feature request. Everything else about the Create Database GUI is sticky -- when changed it stays changed -- EXCEPT the file patterns. Would it be possible to make the file patterns sticky as well? I often need to create a new database repeatedly since I'm using XQuery to test output from XSLT processes during development. Remembering to add all the file patterns is not excessively burdensome but I would like to not have to do it. Thanks! Graydon

3 4

Query optimizer bug with nested for? - java.lang.NullPointerException at Path.index(Path.java:673)
by Sebastian Guerrero 11 May '20

11 May '20

Hi everybody! Maybe it's a newbie issue, but I would like your comments. I'm writing a RESTXQ method to search among a couple of databases. ( >100 databases ) Some databases are split into a couple of parts due to the number of nodes. For example US: it's separated into US00, US01 and US02. So, my problem is: if I replace "*for $usPart in ('US00')*" by "*for $usPart in ('US00','US01',''US02)*" in *QUERY [A]*, I get this error: *Improper use? Potential bug? Your feedback is welcome:* *Contact: basex-talk(a)mailman.uni-konstanz.de <basex-talk(a)mailman.uni-konstanz.de>* *Version: BaseX 9.3.2* *Java: Oracle Corporation, 1.8.0_251* *OS: Windows 10, amd64* *Stack Trace: * *java.lang.NullPointerException* * at org.basex.query.expr.path.Path.index(Path.java:673)* * at org.basex.query.expr.path.Path.optimize(Path.java:157)* * at org.basex.query.expr.gflwor.For.toPredicate(For.java:220)* * at org.basex.query.expr.gflwor.GFLWOR.optimizeWhere(GFLWOR.java:532)* * at org.basex.query.expr.gflwor.GFLWOR.optimize(GFLWOR.java:109)* * at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:100)* * at org.basex.query.expr.Extension.compile(Extension.java:45)* * at org.basex.query.expr.SwitchGroup.compile(SwitchGroup.java:40)* * at org.basex.query.expr.Switch.compile(Switch.java:60)* * at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:96)* * at org.basex.query.expr.gflwor.ForLet.compile(ForLet.java:43)* * at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:90)* * at org.basex.query.scope.MainModule.comp(MainModule.java:81)* * at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114)* * at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105)* * at org.basex.query.QueryContext.compile(QueryContext.java:312)* * at org.basex.query.QueryProcessor.compile(QueryProcessor.java:79)* Using "*for $usPart in ('US00')*" it works without any problem. With one element there is no problem, with two or more it fails. Any ideas about what I'm doing wrong? Here is the *QUERY [A]* ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- declare namespace gb="http://www.ipo.gov.uk/schemas/tm"; let $text:="christian" let $registries:=('GB','US') let $results := for $registry in $registries return switch ($registry) case "US" return (# db:enforceindex #) { for $usPart in ('US00') for $tmUS in db:open($usPart)/trademark-applications-daily/application-information/file-segments/action-keys/case-file where $tmUS/case-file-header/mark-identification/text() contains text {$text} using stemming return <trademark><ipo>US</ipo><text>{$tmUS/case-file-header/mark-identification/text()}</text></trademark> } case "GB" return (# db:enforceindex #) { for $tmGB in db:open('GB')/gb:MarkLicenceeExportList/gb:TradeMark where $tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text() contains text {$text} return <trademark><ipo>GB</ipo><text>{$tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text()}</text></trademark> } default return "" return <result> <total>{count($results)}</total> <trademarks> { for $result in $results return $result } </trademarks> </result> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Regards, Sebastian

2 7

repeatedly full-text marking the same text node
by Graydon Saunders 11 May '20

11 May '20

Hello -- Is there some way to iterate full-text matches to mark up in the node every found member of a sequence of phrases? I have a use case where I have a long list of phrases which may appear in the content set; if they do appear in the content set, these should be marked. The order of the list is significant; the longest phrases should be marked first. The idea would be to iterate through the list, marking up the node with any matches. However, so far as I can tell, full text only works directly on a database node. If I try to pass the node in a function, I get "No database node" errors from attempting full-text operations. (Making a copy of the DB with a full text index, applying the changes, updating the indexes, and continuing seems possible but also inherently inefficient.) Is there a straightforward way to do this that I'm missing? Thanks! Graydon

5 8

Stack overflow with random-number-generator
by Joe Wicentowski 11 May '20

11 May '20

Hi all, I encountered a stack overflow error with the following code, which is designed to return as many random numbers as the user requests. BaseX's error suggested, "Try tail recursion?" I think I am already using tail recursion. Changing the $n variable from 1407 to 1406 or lower avoids the error. Any number 1407 or higher triggers the error. Thank you for any hints! Joe ``` xquery version "3.1"; declare function local:get-random-numbers($how-many as xs:integer, $generator as map(*)) { if ($how-many ge 1) then ( $generator?number, local:get-random-numbers($how-many - 1, $generator?next()) ) else () }; declare function local:get-random-numbers($how-many as xs:integer) { local:get-random-numbers($how-many, random-number-generator()) }; let $n := 1407 return local:get-random-numbers($n) => count() ```

2 2

Performance loss between version 9.2.4 and 9.3.2 when executing specific xQuery
by BIRKNER Michael 11 May '20

11 May '20

Hi, I am observing a performance loss between BaseX versions 9.2.4 (which I was using so far) and 9.3.2 (to which I updated recently) when executing an xQuery like this: --- (: Open 2 databases and get all <record>s :) let $recsFromDb1 := db:open('db1')/record let $recsFromDb2 := db:open('db2')/record (: Get distinct IDs of all records in db1 :) let $idsFromRecsInDb1 := distinct-values($recsFromDb1/exampletag[@exampleattr='id']) (: Iterate over the distinct IDs of db1 and return the records from db2 with the same ID :) for $id in $idsFromRecsInDb1 let $recFromDb2WithSameId := $recsFromDb2[exampletag[@exampleattr='id']=$id] return $recFromDb2WithSameId --- In BaseX version 9.2.4 the query executes very fast (2 - 3 seconds). In 9.3.2 I didn't wait to the end ... I aborted after several minutes because I suspected that something must be wrong. Both BaseX instances have allocated the same amount of memory (4096MB). The databases (db1 and db2) were created in the respective BaseX version from scratch and contain attribute and text indexes. They were optimized before executing the query mentioned above. All options and preferences are the same in both BaseX instances. I am using the GUI in Ubuntu 18.04. Here are some more details about the two databases: db1: - Size: 2255MB - Nodes: 97598775 - Documents: 7489 - Uptodate: true db2: - Size: 883MB - Nodes: 46317512 - Documents: 1 - Uptodate: true Does someone have an idea why there is such a difference in performance between the two BaseX versions? Thanks for any answers and hints! Best regards, Michael Mag. Michael Birkner AK Wien - Bibliothek 1040, Prinz Eugen Straße 20-22 T: +43 1 501 65 12455 F: +43 1 501 65 142455 M: +43 664 88957669 michael.birkner(a)akwien.at<mailto:Michael.BIRKNER@akwien.at> wien.arbeiterkammer.at<http://wien.arbeiterkammer.at/> Besuchen Sie uns auch auf: facebook<http://www.facebook.com/arbeiterkammer/> | twitter<https://twitter.com/Arbeiterkammer> | youtube<https://www.youtube.com/user/AKoesterreich> -------------------------------------------------- Die AK setzt sich seit 100 Jahren für Gerechtigkeit ein. Damals. Heute. Für immer. arbeiterkammer.at/100<https://arbeiterkammer.at/100><https://arbeiterkammer.at/100><https://w.ak.at/zukunftsprogramm> [https://wien.arbeiterkammer.at/ak100_maildisclaimer.png]<https://arbeiterkammer.at/100> Beachten Sie, dass Sie uns ab sofort unter einer geänderten Rufnummer erreichen. Bitte speichern Sie gleich Ihren Kontakt zur AK Wien ein unter 501 65 1, gefolgt von der gewohnten Durchwahl. Dieses Mail ist ausschließlich für die Verwendung durch die/den darin genannten AdressatInnen bestimmt und kann vertrauliche bzw rechtlich geschützte Informationen enthalten, deren Verwendung ohne Genehmigung durch den/ die AbsenderIn rechtswidrig sein kann. Falls Sie dieses Mail irrtümlich erhalten haben, informieren Sie uns bitte und löschen Sie die Nachricht. UID: ATU 16209706 I https://wien.arbeiterkammer.at/datenschutz

4 11

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk