BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Basex query for checking size of node
by Sarath Surisetty 03 Sep '22

03 Sep '22

Problem statement: one of the project stores the logs in BaseX, and size of the baseX increases nearly 1gb to 10gb . when the size of BaseX increases, while performing queries to baseX, noticed that the CPU utilization exceeded more than 200% and performance is degraded drastically, But when some of logs data removed from BaseX manually BaseX performance is good. could u help in , 1)We are getting issues from customers env , where we don't have access to analyze which node is consuming more storage or which query is consuming more cpu and customer are not supposed to use basex gui. Could you give the query(Xquery) to print list of nodes(xmls) and its sizes ? 2)could you share any suggestions to resolve the performance issues. thanks sarath Regards Sarath

1 0

Am I using proc:exec wrong?
by Graydon Saunders 03 Sep '22

03 Sep '22

Hello -- This is with BaseX 10.1 on a linux box: 18:02 graydon % java -version openjdk version "17.0.4" 2022-07-19 OpenJDK Runtime Environment (Red_Hat-17.0.4.0.8-1.fc36) (build 17.0.4+8) OpenJDK 64-Bit Server VM (Red_Hat-17.0.4.0.8-1.fc36) (build 17.0.4+8, mixed mode, sharing) I'm trying to invoke CoffeePot, https://coffeepot.nineml.org/ which is an ixml processor. In the BaseX GUI, proc:execute('/usr/bin/java','-version') gives me the expected version information as an error, despite a return code of zero: <result><error>openjdk version "17.0.4" 2022-07-19 OpenJDK Runtime Environment (Red_Hat-17.0.4.0.8-1.fc36) (build 17.0.4+8) OpenJDK 64-Bit Server VM (Red_Hat-17.0.4.0.8-1.fc36) (build 17.0.4+8, mixed mode, sharing) </error><code>0</code></result> >From a console, /usr/bin/java -cp /home/graydon/bin/coffeepot-package/coffeepot-1.99.8/coffeepot-1.99.8.jar org.nineml.coffeepot.Main works fine, in as much as I get the list of coffeepot usage information I expect if it's run without arguments. proc:execute('/usr/bin/java','-cp /home/graydon/bin/coffeepot-package/coffeepot-1.99.8/coffeepot-1.99.8.jar org.nineml.coffeepot.Main') returns <result><error>Unrecognized option: -cp /home/graydon/bin/coffeepot-package/coffeepot-1.99.8/coffeepot-1.99.8.jar org.nineml.coffeepot.Main Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. </error><code>1</code></result> I suspect I'm doing something wrong, but it's not at all clear to me what. Anyone have suggestions? Thanks! Graydon

3 2

Problem with validate:xsd-report
by Hans-Juergen Rennau 01 Sep '22

01 Sep '22

Dear BaseX people, I encounter a problem with validate:xsd-report(), more particular with using a schema importing the well-known xml.xsd. The imported attribute declaration (xml:base) is not found. I am pretty sure that it is my fault, but I just can't find my error - could you take a look? (1) Document: doc.xml <book xml:base="/a/b/c" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="schema.xsd"> <author>xyz</author></book> (2) Schema: schema.xsd <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" elementFormDefault="qualified"> <xs:import namespace="http://www.w3.org/XML/1998/namespace" schemaLocation="xml.xsd"/> <xs:element name="book"> <xs:complexType> <xs:sequence> <xs:element name="author" type="xs:string"/> </xs:sequence> <xs:attribute ref="xml:base"/> </xs:complexType> </xs:element></xs:schema> (In the same folder, a downloaded copy of xml.xsd is stored - for a snippet, see PS) (3) Query: validate.xq let $doc := 'doc.xml'let $xsd := 'schema.xsd'return validate:xsd-report($doc, $xsd) (4) Result: basex validate.xq=><report> <status>invalid</status> <message level="Fatal" line="9" column="43" url="file:/C:/projects/d2type/jats/test-validation/schema.xsd">src-resolve: Cannot resolve the name 'xml:base' to a(n) 'attribute declaration' component. </message></report> I do not understand why the import seems to be ignored. Validating with oXygen works fine, but I suppose that oXygen ignores the @schemaLocation. If you see the reason, please let me know. Cheers,Hans-Jürgen PS: Snippet from xml.xsd, stored in the same folder: <?xml version='1.0'?><!DOCTYPE xs:schema PUBLIC "-//W3C//DTD XMLSCHEMA 200102//EN" "XMLSchema.dtd" ><xs:schema targetNamespace="http://www.w3.org/XML/1998/namespace" xmlns:xs="http://www.w3.org/2001/XMLSchema" xml:lang="en"> ... <xs:attribute name="base" type="xs:anyURI"> <xs:annotation> <xs:documentation>See http://www.w3.org/TR/xmlbase/ for information about this attribute.</xs:documentation> </xs:annotation> </xs:attribute> ...</xs:schema>

2 2

Exception handling in XQuery-Java-Binding
by Andreas Hengsbach | nexoma 29 Aug '22

29 Aug '22

Hi, I am currently experimenting with java code loaded as a basex module. There I throw custom exceptions, which I want to catch and handle in XQuery. Unfortunately, the information about the thrown Java exception seems to get lost. What options do I have to throw my own error messages from my java module that do not immediately become "XPTY0004"? Many thanks and best regards Andreas

2 2

Re: [basex-talk] an Earley parser in XQuery?
by C. M. Sperberg-McQueen 25 Aug '22

25 Aug '22

On 23 August 2022, Graydon Saunders wrote: > On Mon, Aug 22, 2022 at 07:42:39PM +0200, Martin Honnen scripsit: > > On 22.08.2022 19:07, Graydon Saunders wrote: > > > I'm trying to test if some extracted sentences validate as productions > > > of a particular context-free grammar expressed in a BNF dialect. > > > > > > Is there an available implementation of a parser in XQuery that can do > > > this? > > > > > In the context of Invisible XML https://invisiblexml.org/ I have heard > > that term "Earley" parser a lot but I am not familiar enough with the > > various implementations to tell whether all are "Earley" parsers, > > https://github.com/cmsmcq/Aparecium is an XQuery implementation of > > Invisible XML. For what it's worth: Of the ixml processors I'm familiar with, all use (or can use) Earley parsers to parse the input string against the input grammar; Norm Walsh's Coffeepot and its related libraries also make a GLL parser available, which is sometimes faster and sometimes slower. About half use the same parser to parse the input grammar against the spec grammar; about half have a hand-written parser for the ixml spec grammar. > And thus interesting, but alas too slow for the application I have. If you are willing and able to send me a copy of your grammar and some sample data, I would be grateful; it might help me improve the situation with respect to Aparecium's performance. Both Norm Walsh's processor and John Lumley's processor are currently a lot faster than Aparecium, though I don't know a simple way to call them directly from XQuery. Another alternative, if you have speed issues and just one grammar you are interested in, is to use Gunther Rademacher's REx parser generator to compile the grammar you are interested in into a parser written in XQuery (other target languages are also available). https://bottlecaps.de/rex/ -- C. M. Sperberg-McQueen Black Mesa Technologies LLC http://blackmesatech.com

2 1

an Earley parser in XQuery?
by Graydon Saunders 23 Aug '22

23 Aug '22

Hello -- I'm trying to test if some extracted sentences validate as productions of a particular context-free grammar expressed in a BNF dialect. Is there an available implementation of a parser in XQuery that can do this? Thanks! Graydon

4 4

Very niche question about BaseX 9.5.1 and java bindings
by Andy Bunce 22 Aug '22

22 Aug '22

Hi, I am trying to write a Java property file using v9.5.1 and no new Java code. The code below runs in 9.7.3. Although it only uses 9.5 features in 9.5.1 it produces the error message props:store·java.io.Writer·String cannot be called with (Writer, String). but https://docs.oracle.com/javase/8/docs/api/java/util/Properties.html#store-j… I assume this is a 9.5.1 java binding bug? Any workaround suggestions or details of what the problem is? /Andy ----------------------------------------------- (:~ Using Basex 9.5.1 and assuming a file "test.properties" in folder containing this module:) import module namespace props = "java:java.util.Properties"; declare variable $source:= file:resolve-path("test.properties",file:base-dir()) !(prof:void(props:load·java.io.Reader(Q{java:java.io.FileReader}new(.))),.) ; props:store·java.io.Writer·String( Q{java:java.io.FileWriter}new($source), "The saucer has landed")

2 2

Basex 10.1, cannot execute query for a particular file name
by ykhabins＠bellsouth.net 19 Aug '22

19 Aug '22

Hello, Congrats on the release of BaseX 10.1 I decided to try XQuery 4.0 functionality right away. So, I typed a new query without saving it on the file system as follows: xquery version "4.0"; (1 to 5) -> {. + .} Executed it, and it is worked. I saved it as a file name: [xquery version 4.0] without square brackets. Extension is 0 And I cannot execute it anymore. Why is that? Just when I saved it as [xquery version 4.xq], I was able to execute it again. Just a peculiarity. Regards, Yitzhak Khabinsky

2 2

Memory footprint for a certain query is much higher usisng BaseX10 compared to 9
by Alexander Witzigmann 16 Aug '22

16 Aug '22

Hi, BaseX 10 has a different behavior in memory footprint for the following situation. To avoid passing around data you can create db using the following create (i did this with BaseX 9) declare variable $input := <root><sheet name="SAP">{for $idx in (1 to 10000) return <row>{for $e in $enames return element {$e} { attribute {"content"} {$idx}}}</row>}</sheet></root>; db:create("test-db",$input,"test.xml") Then using the following query on the created db: declare variable $input := db:open("test-db"); <root>{ for $s in $input//sheet[./@name => contains("SAP")] return <sheet>{$s/@*}{ for $r in $s//row let $no := $r/Objektkurztext/@content return <row>{$r/@*}{($r/*,<partno>{$no}</partno>)}</row> }</sheet> }</root> Using BaseX 9 the used memory for the query is round about 2 GB which is ok. Using BaseX 10 Out-of-Memory exception happens in my case used memory is > 12 GB Any thoughts what the reason is - any additional information required? Alex

2 5

New fails without warning when one file out of 27 is locked
by Patrick Durusau 15 Aug '22

15 Aug '22

Greetings! My mistake but I had one file out of 27 open in an editor when I tried to create a new database across the file set. Got the error message that basex 10.0 could not find (file-name), so I chose ok. Apparently basex failed at that point and did not skip the open file. No database was created. Not a problem because I closed the file and re-ran new but curious if that is the expected behavior? Or should it skip the locked file? Thanks for all the hard work! Patrick -- Patrick Durusau patrick(a)durusau.net Technical Advisory Board, OASIS (TAB) Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300 Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps) Another Word For It (blog): http://tm.durusau.net Homepage: http://www.durusau.net Twitter: patrickDurusau

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk