BaseX-Talk August 2020

basex-talk@mailman.uni-konstanz.de

25 participants
28 discussions

Re: [basex-talk] BaseX - CORS
by Andy Bunce 27 Aug '20

27 Aug '20

Hi Elina, (cc: basex-talk) Happy to help. That email correspondence is a bit old, and the code referenced is ancient. I suspect your problems creating the headers in XQuery restxq are due to default namespace prefix changes, rest vs restxq, way back when. You are correct that enabling the supplied CORS filter in web.xml works for GET and POST but not PUT. The reason is that PUT is not in the default AllowedMethods [1] As an exercise I have created a little sample that uses only RESTXQ facilities. [2] It assumes the web.xml CORS filter is not enabled. As supplied it has: A cors.html file, to be opened directly in the browser, i.e. using the file protocol. A cors.xqm intended to be put in the webapp folder of a local basexhttp running on 8984 Only the PUT request is allowed as I have commented out the Xquery generation of the CORS headers for GET and POST. Note PUT is a non-simple CORS request and will result in the browser sending an additional request using the OPTIONS method [3] This can be seen in the screenshot and is handled in the cors.xqm code. Hope this helps /Andy [1] https://www.eclipse.org/jetty/documentation/current/cross-origin-filter.html [2] https://gist.github.com/apb2006/ea6a901a570b04f94e0e0e21098a5402 [3] https://developer.mozilla.org/en-US/docs/Web/HTTP/CORS#Preflighted_requests [image: image.png] On Fri, 7 Aug 2020 at 13:53, Elina Koskentalo <ekoskent(a)gmail.com> wrote: > Hello Andy, > > I hope you don't mind me contacting you, I found this email corresponding > between you and another person about BaseX and adding > the Access-Control-Allow-Origin header to the response. > https://mailman.uni-konstanz.de/pipermail/basex-talk/2017-February/011782.h… > > I have a very similar issue than what you are talking about there. I don't > manage to define a rule in the restxq file that would simply add > Access-Control-Allow-Origin header to or requests. I already manipulated > the filters in the web.xml file which now works for GET but for PUT I still > get the CORS issue back. > > Would you have any tips for me? Thank you very much in advance! > > Best regards, > Elina Koskentalo > ekoskent(a)gmail.com >

3 4

Stack Overflow on 9.4.2
by AirQuick 25 Aug '20

25 Aug '20

This `test.xq` file works on BaseX 9.4.1: ``` xquery version "3.1"; import module "urn:x-xspec:common:deep-equal" at "https://github.com/xspec/xspec/raw/c629869560ab2bce3a6199569917de70ede4bbc3…"; let $r := Q{urn:x-xspec:common:deep-equal}deep-equal((), (), '') return element test { $r } ``` $ BaseX941/basex/bin/basex test.xq /tmp/BaseX941/basex/.basex: writing new configuration file. <test>true</test> But it fails on 9.4.2: $ BaseX942/basex/bin/basex test.xq /tmp/BaseX942/basex/.basex: writing new configuration file. [basex:overflow] Stack Overflow: Try tail recursion? Is it possibly a regression in 9.4.2? -- AirQuick

2 2

XQDoc Parser requires leading colons in doc-comment for @token documentation
by Andreas Mixich 25 Aug '20

25 Aug '20

Hello, when using `inspect:xqdoc#1` on a module, where the lines of doc comments do not start with a leading colon, as shown by the following example: (:~ Description @comment-token :) the output will be missing the element for the @comment-tokens (i.e.:`xqdoc:function/xqdoc:comment/xqdoc:param`). They only get provided, if the leading colons are set, as in: (:~ : Description : : @comment-token :) Since I dislike to add the leading colons I opened up an issue at [1], but according to Loren Cahlander the parser does not seem to require them. Therefore I assume, that this could be implementation dependent. The spec does not require the leading ':', but it seems, that BaseX does. Could the lack of leading colons be tolerated? That would be nice! Thank you. [1]: https://github.com/xqdoc/xqdoc/issues/4 -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 2

BaseX GUI: XPath suggestions / completion
by andre.aepli＠gmx.ch 25 Aug '20

25 Aug '20

2 2

improving query performance
by Bill Osmond 23 Aug '20

23 Aug '20

Hi all, I'm attempting to query a fairly large database, with 136,938 resources and a size of 12,257,686,099. The basex server itself is an AWS EC2 instance with 4 cores & 16 gigs of ram, using -Xmx12g. The database contains audio DDEX information which (to me at least) is fairly complicated XML. The query I'm running against the database works and gives me the result I want, but takes upwards of 15 minutes to execute. I've taken a look at the wiki documentation regarding indexes, but it's not clear to me that any of the non-default indexes would help for the query I'm running. That query is: declare namespace ernm="http://ddex.net/xml/ern/411"; for $r in /ernm:NewReleaseMessage for $track_release in $r/ReleaseList/TrackRelease for $party in $r/PartyList/Party for $sound_recording in $r/ResourceList/SoundRecording for $release in $r/ReleaseList/Release where $track_release/ReleaseLabelReference = $party/PartyReference and $track_release/ReleaseResourceReference = $sound_recording/ResourceReference and $track_release/ReleaseResourceReference = $release/ResourceGroup/ResourceGroup/ResourceGroupContentItem/ReleaseResourceReference return <identity> <isrc>{ $track_release/ReleaseId/ISRC/text() }</isrc> <artist>{ fn:string-join($sound_recording/DisplayArtistName, '/') }</artist> <title>{ $sound_recording/DisplayTitleText/text() }</title> <album>{ $release/DisplayTitleText/text() }</album> <icpn>{ $release/ReleaseId/ICPN/text() }</icpn> <sublabel>{ $party/PartyName/FullName/text() }</sublabel> </identity> Am I wrong, and would an additional value index help here? Or is my query just bad? Thanks, Bill p.s. The BaseX GUI client is awesome - especially the treemap view. Really helps with wrangling these XML files!

4 16

Re: [basex-talk] documentation flaw
by Christian Grün 22 Aug '20

22 Aug '20

Hi Rob, you are right. I have replaced "or" with "and". Thanks for the hint. – Best, Christian On Sat, Aug 22, 2020 at 12:57 PM RobStapper <r.stapper(a)lijbrandt.nl> wrote: > Hi, > > > > I have my doubts about the expressions used at the “tertium non > datur”-principle in the documentation [1]. > > Or the expression should be “$a or not($a)” or the rewritten expression > should be “false()” . > > > > [1]: https://docs.basex.org/wiki/XQuery_Optimizations#Pure_Logic > > > > Best regards, > > > > Rob Stapper > > > > Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for > Windows 10 > > > > > <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. > www.avast.com > <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> > <#m_-2765550508791472733_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> >

1 0

documentation flaw
by RobStapper 22 Aug '20

22 Aug '20

Hi, I have my doubts about the expressions used at the “tertium non datur”-principle in the documentation [1]. Or the expression should be “$a or not($a)” or the rewritten expression should be “false()” . [1]: https://docs.basex.org/wiki/XQuery_Optimizations#Pure_Logic Best regards, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

1 0

Error: Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist.
by Srikumar Choudhury 21 Aug '20

21 Aug '20

Hi Christian, Why I am getting below error message, even though 0601904f80007547.xml file exist in database. if we will open the corresponding database using basexgui.bat(i.e., open "JunitDocbaseDB" database in GUI), then xqPreparedExpr.executeQuery() java api is returning proper 0601904f80007547.xml data(see below log), otherwise throwing same below error message. How I can resolve this issue or it is bug? BXCE001 - Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist. Open basex.bat: ================= > XQUERY db:open('JunitDocbaseDB', '6301904f80000114/0601904f80007547.xml')  <testSuiteConfig version="2.0"> <testSuiteEnv> <paths> <path type="input" value="../data"/> </paths> </testSuiteEnv> <package name="com.documentum.test.xhive_integration.uc_1.uc_1_1"> <test name="TC_1_1_1" className="TC_1_1_1"/> </package> </testSuiteConfig> Query executed in 12.59 ms. > XQUERY for $article in doc('6301904f80000114/0601904f80007547.xml') return $article Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist. Run same xquery from java program: ================================== XQPreparedExpression xqPreparedExpr = null; XQResultSequence resultSeq = null; String xQuery = "for $article in doc('6301904f80000114/0601904f80007547.xml') return $article"; xqPreparedExpr = m_conn.prepareExpression(xQuery); resultSeq = xqPreparedExpr.executeQuery(); Log: ==== [13:17:10.034] TRACE: XQConnection-1.prepareExpression(String) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:17:10.034] TRACE: XQConnection-1.prepareExpression(String, XQStaticContext) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:17:10.035] TRACE: XQPreparedExpression-1.executeQuery() invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:17:10.036] TRACE: XQPreparedExpression-1.executeQuery(), raw XQuery resolved to: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article javax.xml.xquery.XQException: BXCE001 - Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist. Run same xquery using above same java program:(after opening basexgui.bat and open "JunitDocbaseDB" database in GUI) ============================================== log: ==== [13:22:49.313] TRACE: XQConnection-2.prepareExpression(String) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.313] TRACE: XQConnection-2.prepareExpression(String, XQStaticContext) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.315] TRACE: XQPreparedExpression-1.executeQuery() invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.315] TRACE: XQPreparedExpression-1.executeQuery(), raw XQuery resolved to: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.318] DEBUG: XQPreparedExpression-1.close() invoked. Finished executing xquery with query Start iterating through the xquery results for query 0 Result :  <testSuiteConfig version="2.0"> <testSuiteEnv> <paths> <path type="input" value="../data"/> </paths> </testSuiteEnv> <package name="com.documentum.test.xhive_integration.uc_1.uc_1_1"> <test name="TC_1_1_1" className="TC_1_1_1"/> </package> </testSuiteConfig> Thanks, Srikumar

2 16

multi-line queries in the command line client
by Bill Osmond 20 Aug '20

20 Aug '20

Hi all, First, thanks for making BaseX! I'm in the process of learning it (and XQuery) after an ill-fated attempt to coerce complicated XML data into a relational database, and I'm optimistic about the prospects of success. But there is one thorn in my side: it seems like xquery commands have to all be on a single line when run from the command line client. Multiple lines/indentation goes a long way towards helping me mentally structure the queries I'm (trying to) run, but it seems I have to join them together on a single line in order to actually run them. I've tried the standard \ character with no luck, and I couldn't find anything in the documentation about it. Is there any solution, or is that just the way it is? Thanks, Bill

2 2

problems using Archive module with certain zip files
by Lizzi, Vincent 20 Aug '20

20 Aug '20

Hello, I'm using BaseX in several file conversion projects that involve unpacking a zip file using the Archive module, modifying the files that are found inside with the File module and XSLT module, and creating new zip file(s) using the Archive module again. BaseX is very useful for these kinds of transformations and makes it quick to develop a transformation complete with unit tests. I'm running in to 2 kinds of problems with certain zip files and getting the following error messages from the Archive module. 1. When attempting to extract certain zip files archive:extract-to() or archive:entries() produce this error message "Operation failed: only DEFLATED entries can have EXT descriptor." The zip files that produce this error can be extracted using another program such as 7zip, which might be better at handling variations in the structure of some zip files. 2. When attempting to create a zip file larger than about 2 Gb. After extracting a zip file larger than about 2 Gb using archive:extract-to (which works), when trying to create a new zip file file:write-binary($newZip, archive:create-from($tempDir)) produces a stack trace that begins with: java.lang.ArrayIndexOutOfBoundsException: Maximum array size reached. at org.basex.util.Array.checkCapacity(Array.java:322) at org.basex.util.Array.newCapacity(Array.java:313) at org.basex.util.Array.newCapacity(Array.java:301) at org.basex.io.out.ArrayOutput.write(ArrayOutput.java:32) at java.base/java.io.OutputStream.write(OutputStream.java:157) at java.base/java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:253) at java.base/java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:211) at java.base/java.util.zip.ZipOutputStream.write(ZipOutputStream.java:332) at java.base/java.io.FilterOutputStream.write(FilterOutputStream.java:108) at org.basex.query.func.archive.ZIPOut.write(ZIPOut.java:44) at org.basex.query.func.archive.ArchiveCreate.add(ArchiveCreate.java:138) I'm currently using BaseX version 9.4.1 and Java 64-bit openjdk version "11.0.7" 2020-04-14. This might be a bug in BaseX handling of zip files. Is there any solution or workaround? Thanks, Vincent ______________________________________________ Vincent M. Lizzi Head of Information Standards | Taylor & Francis Group 530 Walnut St., Suite 850, Philadelphia, PA 19106 E-Mail: vincent.lizzi(a)taylorandfrancis.com Phone: 215-606-4221 Web: www.tandfonline.com Taylor & Francis is a trading name of Informa UK Limited, registered in England under no. 1072954 "Everything should be made as simple as possible, but not simpler." Information Classification: General

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk August 2020