BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Re: [basex-talk] Huge No of XML files.
by Liam R. E. Quin 18 Dec '19

18 Dec '19

On Wed, 2019-12-18 at 11:10 +0530, Sreenivasulu Yadavalli wrote: > > > What exactly do you mean by moving collections around?. > > A: moving the collections in the same system. So, you use the Linux "mv" command to do this? Or what? What exactly do you mean by collections? I for one would find it easier if you would stop talking in riddles, as my telepathy skills are weak. > And every day we have to > update the existing collection with call data. So finding the > collection is > taking more time How do you look for the collection? Isn't it a separate BaseX database? > > Are you taking a database with 100 million documents and renaming > 50,000 of them? > > What operations exactly are slow? > > A: finding the existing collection. find / -name collection.db ? This is a little frustrating in that you are asking for people's help but not explaining the problem. Are you saying that fn:collection() is slow in BaseX? What arguments are you passing it exactly? What is the size, in gigabytes, of the database, on disk? How many documents are in it? Can you give step-by-step EXACT AND PRECISSE instructions so someone else could reproduce the problem you have having? Complete and exact instructions, with sample files if needed, so they can reproduce the problem on their own computer? A database with 80,000 files is easy to "find" here, and opens quickly, in a small fraction of a second. It doesn't take hours. Is something else running on your computer that makes it slow?? Note: please remember to copy the list in your replies, as the BaseX people are far more knowledgeable about BaseX than i am :) My goal as an analyst is to get you to explain the problem you are having clearly enough that you can get an answer :) Liam -- Liam Quin, https://www.delightfulcomputing.com/ Available for XML/Document/Information Architecture/XSLT/ XSL/XQuery/Web/Text Processing/A11Y training, work & consulting. Barefoot Web-slave, antique illustrations: http://www.fromoldbooks.org

1 0

Text index
by Giuseppe G. A. Celano 12 Dec '19

12 Dec '19

Hi, I am wondering whether it is possible to use indexes in a script even if a database is not created explicitly/previously. I see that sometimes, when comparing different XML texts accessed via doc(), text indexes are automatically created/used, but it is not clear to me whether/how I can specify/force the use of them also in the script. Thanks. Best, Giuseppe

2 1

Xslt:processor() and xslt:version() incorrect with Saxon 9.1B
by Majewski, Steven Dennis (sdm7g) 12 Dec '19

12 Dec '19

I have noticed that BaseX xslt:processor() and xslt:version() returns incorrect info when used with Saxon 9.1B It appears to identify it as a Saxon processor, and assumes it’s Saxon HE and version 3.0 . This is different from what the XSLT system-property function returns. ( I’m using Saxon9B because I have stylesheets based on that version that use external java functions. I’m going to be updating these to use BaseX XQuery functions to pass params into the stylesheet instead of those external functions internal to the stylesheets, and I was hoping I could use those xslt:processor() function to keep track of which Saxon library was active as I was migrating the stylesheets. Setting CLASSPATH on the command line works OK for that use case, but I’m working on RESTXQ web apps, so I need to keep track of config when web app was started. ) Xq/processor.xq: let $XS := <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0" > <xsl:output method="text" /> <xsl:template match="/" > <xsl:value-of select="system-property( 'xsl:vendor' )" />, <xsl:value-of select="system-property( 'xsl:vendor-url' )" /> XSLT Version=<xsl:value-of select="system-property( 'xsl:version' )" /> </xsl:template> </xsl:stylesheet> return (xslt:transform-text( <null/>, $XS ), concat('(', xslt:processor(), ', Version:', xslt:version(), ')') ) $ basex Xq/processor.xq Apache Software Foundation (Xalan XSLTC), http://xml.apache.org/xalan-j XSLT Version=1.0 (Java, Version:1.0) $ CLASSPATH=$SAXON9HE basex Xq/processor.xq Saxonica, http://www.saxonica.com/ XSLT Version=3.0 (Saxon HE, Version:3.0) $ CLASSPATH=$SAXON91B basex Xq/processor.xq SAXON 9.1.0.8 from Saxonica, http://www.saxonica.com/ XSLT Version=2.0 (Saxon HE, Version:3.0) I think it would be better to make XQuery xslt functions return the same values as XSLT system-property function. However, I would understand why you might not want to make an incompatible and slower change to current behavior, especially for a rather rare use case. If you keep the current behavior, I suggest a documentation note about how the function determines that value and that it may not be accurate in all circumstances. I can obviously write my own function as above to get correct values. ( I know I mostly only write to this list when I have a problem or find an issue, however this *really* is a very solid implementation. Thank You! ) — Steve Majewski

2 1

running in parallel
by celano＠informatik.uni-leipzig.de 09 Dec '19

09 Dec '19

Hi, I am trying to run two BaseX scripts in parallel using: xquery:fork-join( ( function() {xquery:eval(xs:anyURI('extract_from_ocr1.xq'))} , function (){xquery:eval(xs:anyURI('extract_from_ocr2.xq'))} ) ) As far as I can understand (read below), the scripts are kind of run in parallel, but still the time benefit of that does not seem much in comparison with running in sequence (~25s vs ~28s). The files contain the same function, which reads files from a directory, performs some calculation, and saves the result in a file (the two scripts work on different directories). I infer that the previous script is run in parallel because the files for the results are created at the same time. I tried to do the same with GNU parallel, and in that case the files are actually run in parallel. Do we know why the execution time is not (more or less) halved in BaseX? Thanks. Ciao, Giuseppe

5 5

Weird: mixed content trimmed unexpectedly
by Arjan Loeffen 09 Dec '19

09 Dec '19

Dear BaseX People, after many (happy!) projects using BaseX I have found that curl -i -X PUT --basic --user admin ^ -H "Content-Type: application/xml" -d "<text> test for <element/> me </text>" "http://localhost:8984/rest/LeapinLists/test.xml" stores <text>test for<element/>me</text> To the database. Notice the spaces in the XML string. What may have caused this behavior? Any suggestions on what to do here? I tried it on Basex 9.3, the latest edition right now. -- *Arjan Loeffen* Armatiek BV & Armatiek Solutions BV 06-12918997

6 8

file pattern when creating DB
by radim-havlicek＠post.cz 09 Dec '19

09 Dec '19

Hello, I would like to ask about filters. I'd like to call XQuery db:create("DB", "c:/Temp/defaultDocuments/", "/") but with filter pattern * becase without that pattern it adds *.xml files only. I would like to add all files from that directory and sub-directories. Is it possible to put the filter pattern there? I discovered ADD TO / "C:/Temp/defaultDocuments" does exactly what I want, but I would much rather use XQuery like db:create or db:add("DB", "Temp/defaultDocuments", "/") but the db:add filters the files with *.xml. Is it posssible to add all files with any XQuery? Thank in advance for your reply. Best regards, Radim Havlicek

3 6

Optimization issue? - maps and count
by Johannes Echterhoff 06 Dec '19

06 Dec '19

All, The following query: let $lookupSequence := ('a','b') let $map := map {'c': 'x'} let $mapLookupEvaluation := $map?($lookupSequence) return ( 'Evaluation of the map lookup is: ' || string-join($mapLookupEvaluation,", "), 'count($mapLookupEvaluation) is: ' || count($mapLookupEvaluation) ) Results in: Evaluation of the map lookup is: count($mapLookupEvaluation) is: 2 I would have expected 0 instead of 2. Am I missing something? Best regards, Johannes

2 1

Issue with years-from-duration!?
by France Baril 06 Dec '19

06 Dec '19

Hi, The following function returns P4511D: 0 but I expect P4511D: 12 Bug or bad usage? let $d1 := xs:date('2007-07-31') > let $d2 := xs:date('2019-12-06') > let $duration := $d2 - $d1 > let $years := years-from-duration($duration) > return $duration || ': ' || $years -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 5

BaseX 9.3: The Winter Edition; {position()>1] vs. [./position()>1
by Alexander Witzigmann 05 Dec '19

05 Dec '19

the results of equivalent semantics: e.g. //row[position()>1] is no more equal to in latest 9.3 release to //row[./position()>1] the later results in not correct result. Alex

2 2

WG: Anführungszeichen bei der Serialisierung
by benjamin.tobler＠sbb.ch 05 Dec '19

05 Dec '19

Guten Tag Ich möchte ein xml zu einem csv file wandeln. Dazu verwende ich die serialize function von BaseX. Um die Strings der einzelnen Felder würde ich gerne Anführungszeichen hinzufügen. Dazu verwende ich die Option 'quotes' : 'yes'. Leider funktioniert dies nicht. Ich habe Ihnen einen Beispielcode angehängt. Dieser generiert die Ausgabe: John;Travolta. Ich hätte aber gerne die Ausgabe: "John";"Travolta". Gibt es diese Möglichkeit? Vielen Dank für Ihre Hilfe! Lieber Grüsse Benjamin Tobler

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk