- BaseX-Talk - mailman.uni-konstanz.de

ignore previous mail, please!
by Rob Stapper 02 Sep '21

02 Sep '21

I need a holyday. Sorry about the previous mail. Need to use not()-function offcourse. Rob. Sent from Mail for Windows -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

1 0

Error executing an SQL query using «SQL Module»
by Artur Moor 27 Aug '21

27 Aug '21

*Dear all,* *When executing an SQL query with the SQL module:* sql:init("com.microsoft.sqlserver.jdbc.SQLServerDriver"), let $connection := sql:connect("jdbc:sqlserver://SQLHOST:1433;databaseName=DBNAME", "username", "pa$$w0rd") return sql:execute($connection, "SELECT * FROM TABLE") *I get the following error message:* Error: Stopped at /Users/sa/staging/file, 3/19: [sql:error] An SQL exception occurred: Das Resultset wurde geschlossen. Compiling: - inline let $connection_0 := sql:connect("jdbc:sqlserver://SQLHOST:1433;databaseName=DBNAME", "username", "pa$$w0rd") - simplify FLWOR expression: sql:connect("jdbc:sqlserver://SQLHOST:1433;databaseName=DBNAME", "username", "pa$$w0rd") ! sql:execute(., "SELECT * FROM TABLE") Optimized Query: (sql:init("com.microsoft.sqlserver.jdbc.SQLServerDriver"), sql:connect("jdbc:sqlserver://SQLHOST:1433;databaseName=DBNAME", "username", "pa$$w0rd") ! sql:execute(., "SELECT * FROM TABLE")) Query: sql:init("com.microsoft.sqlserver.jdbc.SQLServerDriver"), let $connection := sql:connect("jdbc:sqlserver://SQLHOST:1433;databaseName=DBNAME", "username", "pa$$w0rd") return sql:execute($connection, "SELECT * FROM TABLE") Query Plan: <QueryPlan compiled="true" updating="false"> <List type="item()*"> <SqlInit name="sql:init" type="empty-sequence()" size="0"> <Str type="xs:string" size="1">com.microsoft.sqlserver.jdbc.SQLServerDriver</Str> </SqlInit> <IterMap type="item()*"> <SqlConnect name="sql:connect" type="xs:integer" size="1"> <Str type="xs:string" size="1">jdbc:sqlserver://SQLHOST:1433;databaseName=DBNAME</Str> <Str type="xs:string" size="1">username</Str> <Str type="xs:string" size="1">pa$$w0rd</Str> </SqlConnect> <SqlExecute name="sql:execute" type="item()*"> <ContextValue type="xs:integer" size="1"/> <Str type="xs:string" size="1">SELECT * FROM TABLE</Str> </SqlExecute> </IterMap> </List> </QueryPlan> *Does anyone have an idea what the problem is?* *Any hints are welcome!*

2 9

XQuery output without namespace declaration
by Yann NICOLAS (ABES) 25 Aug '21

25 Aug '21

Hi all, I am looking for the equivalent instruction of XSLT attribute @omit-xml-declaration in XQuery. My input is : > <marc> > <marc:record *xmlns:marc="http://www.loc.gov/MARC21/slim" > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"*> > <marc:leader>01321nam a22002772a 4500</marc:leader> > <c level="item"> > <did> > <unitid type="division">1808001595</unitid> > </did> > </c> > </marc:record> > <marc> My query is : > declare namespace marc="http://www.loc.gov/MARC21/slim"; > > for $record in db:open('marcxml_full')/marc/marc:record > return > insert node $record/c into db:open('uk_parlement_ead')/dsc The ouput is : > <c *xmlns:marc="http://www.loc.gov/MARC21/slim" > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" *level="item"> > <did> > <unitid type="division">1808001595</unitid> > </did> > </c> As you can see, there are no marc: elements in this output, hence no need for the marc: namespace. How to get rid of @xmlns:marc and xmlns:xsi ? Thanks a lot for your help ! Regards Yann

3 8

EMail module and javax.activation.DataSource
by dudzikp＠yahoo.com 25 Aug '21

25 Aug '21

Dear all, I am trying to use a basex Email module http://files.basex.org/modules/org/basex/modules/email/EMail.jar. I downloaded a new basex instance (9.6 version) and added this jar to lib directory. Based on the xquery/email.xq file I created the following file: import module namespace email = 'http://basex.org/modules/email/EMail'; let $mail := <email> <from>myuser@machine-office</from> <to>myuser@machine-office</to> <host>localhost</host> <subject>Hello!</subject> <message>Enjoy</message> </email> return email:send($mail) While running the file I obtain: Stopped at /home/myuser/Downloads/basex/file, 12/13: [XPTY0004] javax.activation.DataSource. Caused by: org.basex.modules.email.EMail:send(element()). What's the problem? Shouldn't I use this module? BR

2 1

BaseX 9.6 - BaseX96.zip - missing? Image not found: /img/c_go.png and Image not found: /img/c_editopen.png
by Patrick Durusau 20 Aug '21

20 Aug '21

Great to see the new version! Running ./basexgui 2 image not found messages (omitting the at messages) Image not found: /img/c_go.png and Image not found: /img/c_editopen.png On Debian (Buster I think). Thanks for all the hard work! Patrick -- Patrick Durusau patrick(a)durusau.net Technical Advisory Board, OASIS (TAB) Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300 Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps) Another Word For It (blog): http://tm.durusau.net Homepage: http://www.durusau.net Twitter: patrickDurusau

3 4

org.basex.core.BaseXException with no error message
by Matthew Dziuban 17 Aug '21

17 Aug '21

Hi all, I'm using the java ClientSession class defined in the basex-api module and I'm seeing intermittent org.basex.core.BaseXException errors with an empty error message when executing long-running read queries or CREATE DB commands. The stack trace of the most recent error points to ClientSession.receive ( https://github.com/BaseXdb/basex/blob/9.5.2/basex-core/src/main/java/org/ba… ) org.basex.core.BaseXException: org.basex.api.client.ClientSession.receive(ClientSession.java:190) org.basex.api.client.ClientSession.send(ClientSession.java:178) org.basex.api.client.ClientSession.send(ClientSession.java:215) org.basex.api.client.ClientSession.create(ClientSession.java:128) ... Unfortunately since the message is empty it's difficult to debug what's going wrong. I've checked the log files in basex/data/.logs but haven't found any information about the failure. Is there another place I can look? Or do you have any other recommendations for debugging the errors? Thanks in advance, Matt

2 3

Polling break for loop
by Adam Law 15 Aug '21

15 Aug '21

If polling a url n times and breaking if response is 'completed', is the best to approach to use try catch and error() to get around immutability? I need the full response on complete so I redo the last http get. It is not a biggie requesting twice. Adam On Fri., 13 Aug. 2021, 6:00 pm , <basex-talk-request(a)mailman.uni-konstanz.de> wrote: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. XProc? (Jonathan Robie) > 2. Re: XProc? (Martin Honnen) > 3. Pretty-print the -V optimized query? See what indexes are > used? (Jonathan Robie) > 4. Re: XProc? (Imsieke, Gerrit, le-tex) > 5. org.basex.core.BaseXException with no error message > (Matthew Dziuban) > 6. Re: org.basex.core.BaseXException with no error message > (Christian Gr?n) > 7. Re: Pretty-print the -V optimized query? See what indexes are > used? (Christian Gr?n) > 8. Can XQuery return unique values present across multiple > databases? (Tamara Marnell) > 9. Re: Can XQuery return unique values present across multiple > databases? (Martin Honnen) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 12 Aug 2021 07:58:04 -0400 > From: Jonathan Robie <jonathan.robie(a)gmail.com> > To: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] XProc? > Message-ID: > < > CAOkFc+vMLcdXFUZBUvZZVLF8Wc3nKSLASpPKFWV_WPh7hRnEFw(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > What hooks does BaseX provide for XProc? Where can I find examples of > BaseX use in an XProc pipeline? > > Jonathan >

2 3

for-each issue on child-elements
by Rob Stapper 14 Aug '21

14 Aug '21

Hi Christian, I encountered this erroneous behavior while using the for-each-function on a set with child-elements. The evident work-around [2] workd fine. I’m using BaseX 9.6 RC2. I attached the code as attachment. Hope this helps. [1] let $context := <A><B1><C11></C11><C12></C12></B1><B2><C21></C21></B2></A> let $context.processor := function( $context as element( ) , $context.processor as function(*) ) as map(*) { map { $context => name() : $context/child::* => for-each( $context.processor( ? , $context.processor ) ) } } return $context => $context.processor( $context.processor ) [2] let $context := <A><B1><C11></C11><C12></C12></B1><B2><C21></C21></B2></A> let $context.processor := function( $context as element( ) , $context.processor as function(*) ) as map(*) { map { $context => name() : $context/child::* => for-each( function( $child as element( ) ) { $child => $context.processor( $context.processor ) } ) } } return $context => $context.processor( $context.processor ) Rob Sent from Mail for Windows -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 1

Can XQuery return unique values present across multiple databases?
by Tamara Marnell 14 Aug '21

14 Aug '21

Short question: Is it possible to write an XQuery FLWOR statement that can return a set of unique values present across multiple databases? Long question: Our new website in development displays EAD finding aids stored across 45 databases in BaseX. I've built "facet" databases that index terms in the EADs from controlled vocabularies like subjects, places, personal names, etc. The indexes follow this structure, where each EAD node contains a unique identifier: <terms type="subject"> <term text="Literature" db="1"> <ead>12345</ead> <ead>67890</ead> </term> <term text="Poetry" db="1"> <ead>abcde</ead> </term> {etc.} </terms> In the search interface, users can select multiple facets to apply to one search. For example, they could browse database 12 for EADs with the subject "Literature" *and* the place "Oregon," etc. I currently use the REST server to run an XQuery file that loops through each selected facet and prints *all* EAD IDs for each submitted term and database. Then after results are returned, I use PHP to count occurences of each EAD and print them only if the total count matches the count of facets used. declare variable $d as xs:string external; declare variable $f as xs:string external; let $db_ids := tokenize($d, '\|') return <facets>{ for $facet in tokenize($f, '\|') let $split := tokenize($facet, ':') let $facet_type := $split[1] let $facet_term := $split[2] let $facet_db := 'facet-' || $facet_type return <facet type="{$facet_type}" term="{$facet_term}">{ for $ead in db:open($facet_db)/terms/term[@text=$facet_term and @db=$db_ids]/ead return $ead }</facet> }</facets> So in the hypothetical example above, I'd pass "12" as d (or multiple selected databases separated by bars) and "subject:Literature|geogname:Oregon" as f, and I'd get back a document like: <facets> <facet type="subject" term="Literature"> <ead>12345</ead> <ead>67890</ead> </facet> <facet type="geogname" term="Oregon"> <ead>12345</ead> </facet> </facets> The count of "12345" will equal the count of the user's selected facets, so that result will be printed, but 67890 will not. Is there a more efficient way to do this? I'd prefer the XQuery to return only the EADs that meet all criteria, so only 12345 would be returned because it's in facet-subject under Literature *and* in facet-geogname under "Oregon," and then I don't have to do any post-processing. -Tamara -- Tamara Marnell IT Manager Orbis Cascade Alliance (orbiscascade.org <https://www.orbiscascade.org/>) Pronouns: she/her/hers

4 4

Pretty-print the -V optimized query? See what indexes are used?
by Jonathan Robie 12 Aug '21

12 Aug '21

Is there a way to pretty-print the optimized query from the -V option? What is the best way to see which indexes are being used? Jonathan

2 1

XProc?
by Jonathan Robie 12 Aug '21

12 Aug '21

What hooks does BaseX provide for XProc? Where can I find examples of BaseX use in an XProc pipeline? Jonathan

3 2

PR for DBA issue
by Marco Lettere 03 Aug '21

03 Aug '21

Dear Christian, I've just submitted a PR [1] that fixes an issue occurring with some combination of browser/proxy and that we stumbled upon in 9.5.3 beta. I attach a picture that shows how it looks like in DBA. To make error disappear it's sufficient to put a . in the query input. We propose to make query parameter optional in signature of RestXQ handling that call. Let us know if any further info is required. Regards, Marco. [1] https://github.com/BaseXdb/basex/pull/2030

1 0

Sequence of operations in a .bxs file?
by Jonathan Robie 29 Jul '21

29 Jul '21

What order dependencies are there for operations in a bxs file? I am setting up an environment that populates two databases from upstream sources. It runs queries to modify the structure somewhat, they adds an index, then calls optimize. After that it exports to a directory for comparison. Does order matter? What is a good order? CREATE DB wlc-trees ./trees RUN ./xquery/add-wlc-verses-words.xq CREATE INDEX ATTRIBUTE OPTIMIZE EXPORT ./out/wlc SET CHOP false SET EXPORTER indent=no,omit-xml-declaration=no CREATE DB oshb-morphology ./morphhb/wlc RUN ./xquery/oshb-pure-qere-reading.xq RUN ./xquery/merge-proper-nouns-oshb.xq CREATE INDEX ATTRIBUTE OPTIMIZE EXPORT ./out/oshb Thanks! Jonathan

2 1

Create a database and populate it with the result of a query
by Jonathan Robie 29 Jul '21

29 Jul '21

I would like to be able to create a database and populate it with the result of a query done on multiple databases. How do I do that? Jonathan

3 3

java.lang.RuntimeException: Data Access out of bounds
by Jonathan Robie 29 Jul '21

29 Jul '21

Any ideas what this might mean? What should I do? Jonathan

4 6

Merge/combine databases in memory constrained environment
by Matthew Dziuban 27 Jul '21

27 Jul '21

Hi all, I have two databases in BaseX, source_db and target_db, and would like to merge them by matching on the id attribute of each element and upserting the element with a `replace` or an `insert` depending on whether the element was found in the `target_db`. `source_db` has about 100,000 elements, and `target_db` has about 1,000,000 elements. The databases look like this:  <root> <element id="1"> <element id="2"> </root>  <root> <element id="1"> </root> And my query to merge the two looks like this: for $e in (db:open("source_db")/root/element) return ( if (exists(db:open("target_db")/root/element[@id = data($e/@id)])) then replace node db:open("target_db")/root/element[@id = data($e/@id)] with $e else insert node $e into db:open("target_db")/root ) When running the query, however, I keep getting memory constraint errors. Using a POST request to BaseX's REST interface I get "Out of Main Memory" and using the BaseX java client ( https://github.com/BaseXdb/basex/blob/master/basex-examples/src/main/java/o…) I get "java.io.IOException: GC overhead limit exceeded". Ideally I would like to just process one element from source_db at a time to avoid memory issues, but it seems like my query isn't doing this. I've tried using the `db:copynode false` pragma but it did not make a difference. Is there any way to accomplish this? Thanks in advance! Matt

3 7

Converting a Java Set to a BaseX sequence
by Reece Dunn 23 Jul '21

23 Jul '21

Hi, I'm making use of the Java bindings in BaseX, with some of the functions returning List<String> and Set<String> types. For List<String> I can adapt that to a sequence using: declare namespace List = "java:java.util.List"; declare function util:list-to-sequence($list) { for $n in 0 to List:size($list) - 1 return List:get($list, $n cast as xs:int) }; however, I'm not sure how to do the equivalent for Set<String> (or more generally, any Iterator<T>) without converting it to a list or array first, as Set only has size() and iterator() methods. Has anyone done this before? The best I can come up with is the following, which relies on the size of the set and the number of next calls in the iterator to be the same (where it should be checking hasNext): declare namespace Set = "java:java.util.Set"; declare namespace Iterator = "java:java.util.Iterator"; declare function util:set-to-sequence($set) { let $iterator := Set:iterator($set) for $n in 0 to Set:size($set) - 1 return Iterator:next($iterator) }; More generally, it would be helpful for BaseX to have adapters for Java arrays, Lists, Sets, Maps, and Iterables/Iterators to XQuery (XDM) types and functions to construct them in XQuery (like my util:list-to-sequence function above). Kind regards, Reece

2 12

Dropping namespaces on import, serialization
by Jonathan Robie 23 Jul '21

23 Jul '21

I am playing with datasets in which namespaces are unhelpful because they make output harder to read. For production use, though, I want the namespaces to be there. Ideally, I would like to tell BaseX to drop namespaces while serializing. Sometimes. Ideally, I would like to be able to set this as an option in a .bxs file. Is that possible? Thanks! Jonathan

3 2

Different result sets using positional predicates in path expression and where clause
by Kristian Kankainen 23 Jul '21

23 Jul '21

Hello, I noticed I get different result sets with the following queries and I can't understand how they differ from each other. 1) Correct behaviour, returns 3 records let $file := db:list("Snomed")[matches(.,"MRCM")][3] return for $record in (db:open("Snomed", $file)/csv/record) [position() = (1 to 3)] return $record 2) Unexpected behaviour, returns 21 records let $file := db:list("Snomed")[matches(.,"MRCM")][3] return for $record in (db:open("Snomed", $file)/csv/record) where position() = (1 to 3) return $record I have highlighted the one line that differs between them, e.g the first uses the positional predicate in a path expression and the second uses it in a where clause. Best regards, Kristian Kankainen

3 2

Autocomplete with RESTXQ
by Imsieke, Gerrit, le-tex 21 Jul '21

21 Jul '21

Hi List, Can anyone recommend a lightweight vanilla Javascript autocomplete library that can easily be used together with BaseX RESTXQ? Maybe even a readily cloneable/modifiable example? I don’t have a preference for a server response format. The RESTXQ service may be configured to return XML, JSON, or HTML No CORS restrictions need to be considered, the query host is the same that delivers the HTML pages. Gerrit

4 7

Solidarity and closeness
by Marco Lettere 18 Jul '21

18 Jul '21

We at Nubisware would like to express all our solidarity to all the members of the list who are currently affected by the flood disaster in Central EU. In particular, our closeness with Christian, Michael and the German BaseX team who has been backing our daily work for years. Looking forward to sustain whatever initiative will be organized to help out. Stay strong. Marco & the Nubisware team.

2 1

Preserving whitespace for XQuery Updates
by Jonathan Robie 16 Jul '21

16 Jul '21

I am doing some transformations of datasets, then submitting pull requests to upstream sources on GitHub. For instance, today I am inserting some attributes, but I may be restructuring in various ways or enhancing data in various ways. To make upstreams happy, I need to be disciplined about not changing whitespace. What do I have to do? Is it sufficient to preserve whitespace when importing, do an XQuery update, and export, or can that change whitespace beyond what the update operations explicitly say? Thanks! Jonathan

2 10

BaseX 9.5.2 simple query has slow Compilation time
by arcogabbo 13 Jul '21

13 Jul '21

Hi, I admit this is my first experience with BaseX and XQuery language, but this seems weird and i can't find anything on docs or issues related to this. I created a random dataset of calls and i wanted to query this dataset using XQuery, however it turns out compile time takes too long for a relatively simple query. The dataset can be found here <https://gist.github.com/arcogabbo/8042d08b1feb5c860f86ff46d4333e84> . The query is: doc("basex/etc/dataset25k.xml")/users/user[number= "605 6230540" and calls/call/location/@city = "Sandy Springs"]/fullName Timing: - Parsing: 0.61 ms - Compiling: 382.43 ms - Evaluating: 2.1 ms - Printing: 0.14 ms - Total Time: 385.28 ms Compiling: - rewrite fn:doc(uri) to document-node() item: doc("basex/etc/dataset25k.xml") -> document { "file:///home/arcogabbo/Scrivania/basex/etc/dataset25k.xml" } - rewrite to predicate: ((number = "605 6230540") and (calls/call/location/@city = "Sandy Springs")) - apply attribute index for "Sandy Springs" Even if i try a simple query on the example dataset of the application(factbook.xml) the compilation time takes too long, for example: Query: doc("basex/etc/factbook.xml")/mondial/country[@name="Norway"]/province/city Timing: - Parsing: 0.34 ms - Compiling: 82.29 ms - Evaluating: 1.05 ms - Printing: 1.49 ms - Total Time: 85.17 ms Compiling: - rewrite fn:doc(uri) to document-node() item: doc("basex/etc/factbook.xml") -> document { "file:///home/arcogabbo/Scrivania/basex/etc/factbook.xml" } - apply attribute index for "Norway" I also tried BaseX version 9.5 and on another computer, yet compilation times are approximately the same. Any help is appreciated.

2 1

Can the full text tokenizer be instructed not to tokenize at hyphens?
by Imsieke, Gerrit, le-tex 13 Jul '21

13 Jul '21

A customer wants to include composite terms such as 'third-generation' as single tokens so that they may be offered in a completion list. I don’t think this is configurable, or is it? Gerrit

2 2

Fuzzy full-text query
by Tim Thompson 06 Jul '21

06 Jul '21

Hello, I am trying to match a local dataset against entries in a full-text index. I ran into the following case and was confused about the fuzzy querying performance: <x>Baxter, Richard, 1615-1691</x>[text() contains text "Baxter, Richard, 615-1691" using fuzzy] The BaseX documentation says that the default fuzzy search will preserve a minimum of 1 error. However, the query above returns no result. If I add the "errors" parameter with a value of 1, it does work: <x>Baxter, Richard, 1615-1691</x>[text() contains text "Baxter, Richard, 615-1691" using fuzzy 1 errors] Is this expected behavior? Thanks in advance, Tim -- Tim A. Thompson Librarian for Applied Metadata Research Yale University Library

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk