- BaseX-Talk - mailman.uni-konstanz.de

Unconfirmed bug: NPE using cached transformer
by Andrew Sales 29 Apr '20

29 Apr '20

Hello, I'd like to run a transform on multiple documents using a cached transformer, accumulating any errors that occur. This minimal example - for $doc in (<a/>,, <c/>) return try{ xslt:transform( $doc, <xsl:transform xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version='2.0'> <xsl:template match='/'><xsl:sequence select='error()'/></xsl:template> </xsl:transform>, map{}, map{'cache':'true'} ) } catch * {$err:description} - results in: Error in xsl:sequence/@select on line 1 column 135 of [...]: FOER0000: Error signalled by application call on error()Improper use? Potentia l bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.3.2 Java: Oracle Corporation, 1.8.0_241 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.io.out.ArrayOutput.write(ArrayOutput.java:32) at java.io.OutputStream.write(Unknown Source) at java.io.PrintStream.write(Unknown Source) at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) at sun.nio.cs.StreamEncoder.flushBuffer(Unknown Source) at java.io.OutputStreamWriter.flushBuffer(Unknown Source) at java.io.PrintStream.write(Unknown Source) at java.io.PrintStream.print(Unknown Source) at java.io.PrintStream.println(Unknown Source) at net.sf.saxon.lib.StandardLogger.println(StandardLogger.java:121) at net.sf.saxon.lib.Logger.error(Logger.java:45) at net.sf.saxon.lib.StandardErrorListener.fatalError(StandardErrorListen er.java:305) at net.sf.saxon.Controller.reportFatalError(Controller.java:958) at net.sf.saxon.Controller.transform(Controller.java:1914) at net.sf.saxon.s9api.XsltTransformer.transform(XsltTransformer.java:579 ) at net.sf.saxon.jaxp.TransformerImpl.transform(TransformerImpl.java:185) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java: 135) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java: 62) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:40) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.expr.Try.value(Try.java:94) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:72) at org.basex.query.QueryContext.next(QueryContext.java:353) at org.basex.query.scope.MainModule$1.next(MainModule.java:104) at org.basex.core.cmd.AQuery.query(AQuery.java:109) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.api.client.LocalSession.execute(LocalSession.java:132) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:92) at org.basex.BaseX.<init>(BaseX.java:107) at org.basex.BaseX.main(BaseX.java:43) The exception does not occur if 'cache' is set to 'false'. Relatedly, if I amend the query to this: for $doc in (<a/>,,<c/>) return try{ xslt:transform( $doc, <xsl:transform xmlns:xsl="http://www.w3.org/1999/XSL/Transform" xmlns:xs="http://www.w3.org/2001/XMLSchema" version='2.0'> <xsl:template match='/'> <xsl:sequence select='if(a) then error(xs:QName("err"), "oops") else .'/> </xsl:template> </xsl:transform>, map{}, map{'cache':'true'} ) } catch * {<err>{$err:description}</err>} the error message is passed through for the first item in the sequence (<a/>), but is lost, resulting in <err/> when adjusted to error on subsequent items ( or <c/>). Again, this works as expected if the transformer is not cached. Thanks and regards, Andrew <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 3

RuntimeException: Key should not exist
by Braunschweig, Björn 28 Apr '20

28 Apr '20

Hey there, I use basex in production for a couple of years now without problems. However on Saturday I got the error messages down below [1]. My storage architecture is that documents are saved throughout the day in a single database. For the next day a new database is created. When I got these errors and created a new database documents could be saved again. I think it has something to do with the index structures. The error messages were all similar but with different values after "key should not exist". Deployment method: docker BaseX 9.3.1 [Standalone] Try 'help' to get more information. > info General Information: Version: 9.3.1 Used Memory: 10 MB Global options: AUTHMETHOD: Basic CACHETIMEOUT: 3600 DBPATH: /srv/basex/data DEBUG: false FAIRLOCK: false GZIP: false HOST: localhost HTTPLOCAL: false IGNORECERT: false IGNOREHOSTNAME: false KEEPALIVE: 600 LANG: English LANGKEYS: false LOG: true LOGMSGMAXLEN: 1000 LOGPATH: .logs NONPROXYHOSTS: PARALLEL: 8 PARSERESTXQ: 3 PASSWORD: PORT: 1984 PROXYHOST: PROXYPORT: 0 REPOPATH: /srv/basex/repo RESTPATH: RESTXQERRORS: true RESTXQPATH: SERVERHOST: SERVERPORT: 1984 STOPPORT: 8985 TIMEOUT: 30 USER: WEBPATH: /srv/basex/webapp Local options ADDARCHIVES: true ADDCACHE: false ADDRAW: false ARCHIVENAME: false ATTRINCLUDE: ATTRINDEX: true AUTOFLUSH: true AUTOOPTIMIZE: false BINDINGS: CASESENS: false CATFILE: CHECKSTRINGS: true CHOP: true COMPPLAN: true COPYNODE: true CREATEFILTER: *.xml CREATEONLY: false CSVPARSER: DEFAULTDB: false DIACRITICS: false DTD: false ENFORCEINDEX: false EXPORTER: FORCECREATE: false FTINCLUDE: FTINDEX: false FULLPLAN: false HTMLPARSER: INLINELIMIT: 100 INTPARSE: false JSONPARSER: LANGUAGE: en LSERROR: 0 MAINMEM: false MAXCATS: 100 MAXLEN: 96 MAXSTAT: 30 MIXUPDATES: false PARSER: xml QUERYINFO: false RUNQUERY: true RUNS: 1 SERIALIZE: true SERIALIZER: SKIPCORRUPT: false SPLITSIZE: 0 STEMMING: false STOPWORDS: STRIPNS: false TAILCALLS: 256 TEXTINCLUDE: TEXTINDEX: true TEXTPARSER: TOKENINCLUDE: TOKENINDEX: false UPDINDEX: false WITHDB: true WRITEBACK: false XINCLUDE: true XMLPLAN: false [1] Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.3.1 Java: IcedTea, 1.8.0_212 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: Key should not exist: 'urn:diasid:fty:kopal:0200507050000000000047' at org.basex.util.Util.notExpected(Util.java:61) at org.basex.index.value.UpdatableDiskValues.add(UpdatableDiskValues.java:77) at org.basex.data.Data.indexAdd(Data.java:1090) at org.basex.data.Data.insert(Data.java:828) at org.basex.query.up.atomic.Insert.apply(Insert.java:44) at org.basex.query.up.atomic.AtomicUpdateCache.applyUpdates(AtomicUpdateCache.java:294) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:278) at org.basex.core.cmd.Replace.replace(Replace.java:106) at org.basex.core.cmd.Replace.access$000(Replace.java:20) at org.basex.core.cmd.Replace$1.run(Replace.java:58) at org.basex.core.cmd.ACreate.update(ACreate.java:90) at org.basex.core.cmd.Replace.run(Replace.java:55) at org.basex.core.Command.run(Command.java:257) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:93) at org.basex.http.rest.RESTExec.run0(RESTExec.java:31) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.core.Command.execute(Command.java:116) at org.basex.http.rest.RESTServlet.run(RESTServlet.java:31) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1391) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:760) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:547) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:590) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1607) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1297) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1577) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1212) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:500) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:270) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.lang.Thread.run(Thread.java:748) Regards, Björn

2 3

Doc-available() function, behavior?
by Arjan Loeffen 26 Apr '20

26 Apr '20

Dear Basex People, I have this fragment: let $xml-doc := 'MyDatabase/bogus-entry.xml' let $list := *if (doc-available($xml-doc)) then doc($xml-doc)/** else () return $list I'd expect BaseX to return the empty sequence when the document is not in the collection. But Basex returns an error: [basex:doc] Database path 'MyDatabase/bogus-entry.xml' yields no documents. What am I doing wrong? I thought I was following the example in https://docs.basex.org/wiki/Databases#XML_Documents nicely... Thanks in advance!! -- *Arjan Loeffen* Armatiek BV & Armatiek Solutions BV 06-12918997

3 4

Grouping words in phrasal matches with full-text indexes
by Graydon Saunders 26 Apr '20

26 Apr '20

Hello -- So my overall goal is to take a bunch of XML, mark all the (generally phrasal) terms of art, take that modified content and mark all the (possibly phrasal) glossary terms, and then go through and remove all the glossary markers that happen to be inside terms of art and then remove all the term-of-art markers. (There's an intermediate step between "found all the possible glossary terms" and "have applied the glossary terms" where the list of candidate terms gets sent off for semantic approval, so the "find a term" steps and "change the documents in which the terms are found" steps have to be distinct.) My initial problem was marking phrasal terms; the full-text index is very fast and solves the "this rapidly becomes a nightmare with regular expressions, especially regular expressions with no "whole words only" switch, problem, but it marks every word in the phrasal term individually. I think I have figured out a way to connect the adjacent marked words in the phrasal term into a single mark element. I cannot convince myself that this is the right way; is there a better approach than tumbling windows? (: db:create("DB", <para id="GUID-12354" >Diverse and various words, some of which are going to be tagged for review as glossary terms.</para>, 'test.xml', map { 'ftindex': true() }) :) (: example phrasal term :) let $term as xs:string := 'Diverse and various' for $ft in (db:open('DB')//*[text() contains text { $term } phrase using case sensitive]) return <changed>{ let $contents as node()+ := ft:mark($ft[text() contains text { $term } phrase using case sensitive],'mark') return element {name($contents)} { $contents/@*, (: has to handle hyphens as well as spaces :) for tumbling window $w in $contents/node() start $s when true() end $e previous $eprev next $enext when ( $enext[not(self::mark)] and ($enext[normalize-space()][not(matches(.,'^-$'))]) ) or ($enext[self::mark] and $e[normalize-space()][not(matches(.,'^-$'))]) return if ($w[self::mark]) then {string-join($w,'')} else $w } }</changed> thanks! Graydon

4 4

analyze-string
by Graydon Saunders 23 Apr '20

23 Apr '20

So if I create a query in the BaseX 9.3.2 GUI, thus: declare function local:processMatch($in as text(),$matchPattern as xs:string) as item()+ { let $search as element() := analyze-string(normalize-space($in),$matchPattern) return $search }; let $example := <para>These are a bunch of words, and some of the words are special words.</para> for $text in $example//text() return local:processMatch($text,'bunch|special') I get: <fn:analyze-string-result xmlns:fn="http://www.w3.org/2005/xpath-functions"> <fn:non-match>These are a </fn:non-match> <fn:match>bunch</fn:match> <fn:non-match> of words, and some of the words *are*</fn:non-match> </fn:analyze-string-result> <fn:analyze-string-result xmlns:fn="http://www.w3.org/2005/xpath-functions"> <fn:match>special</fn:match> </fn:analyze-string-result> <fn:analyze-string-result xmlns:fn="http://www.w3.org/2005/xpath-functions"> <fn:non-match>words.</fn:non-match> </fn:analyze-string-result> The trailing space after the *are* in the second fn:non-match element is gone. Should that happen? Can I make it stop happening by invoking the function differently? Thanks! Graydon

2 1

A question about RESTXQ rest:form-param()
by Zimmel, Daniel 23 Apr '20

23 Apr '20

Hi, in an HTML form with a RESTXQ POST action, do I really have to declare %rest:form-param() for every param, or is there a way to pass the full query component in one parameter? Best, Daniel

2 7

Create a document in a created database
by Ramzi Hammouda 20 Apr '20

20 Apr '20

Hello BaseX team, This may sound simple, but didn't find how to do it, what is the xquery for creating an empty xml document in a chosen database. Thanks. P Respectons ensemble l'environnement. N'imprimez ce message que si n?cessaire. Let's respect the environment together. Only print this message if necessary.

3 2

Error in the text for the server protocol?
by Ben Engbers 16 Apr '20

16 Apr '20

Hi Michael, I only noticed today that in the server procol (https://docs.basex.org/wiki/Server_Protocol) there are 2 different instructions for adding a new resource. On page 3: ADD \09 {name} {path} {input} On page 6: void add(String path, InputStream input) I has been pure luck that I mixed both instructions. I have implemented ADD as \09 {path} {input} and that works perfectly. Session$Add("Test.xml", "<Line_1 line='1'>Content 1</Line_1>") adds resource Test.xml with the xml as content. Meanwhile it is very easy for me to change the instructions that are send to the server so I tried to add {name} to the ADD command. That results in errors. My guess is that you should use either {name} or {path} and that ADD only works on the database in use. Is that correct? Cheers, Ben

1 0

Binding a variable to a sequence
by Ben Engbers 14 Apr '20

14 Apr '20

Hi, I am still trying to improve my R-package and at the moment I am working (again) on the 'Binding' command. I have added this XML to a database: <book title="XQuery" author="Walmsley"/> <book title="Advanced R" author="Wickham"/> This query: for $t in collection("TestDB/Books")/book where $t/@author = "Walmsley" return $t/@title/string() returns: XQuery My command: Bind(Query_3, "$name", list("Walmsley", "Wickham")) sends the following byte-sequence to the server: 57 61 6c 6d 73 6c 65 79 01 57 69 63 6b 68 61 6d 00 00 And this sequence is accepted by the server. In Query_3, I try to bind $name to the sequence: declare variable $name external; for $t in collection('TestDB/Books')/book where $t/@author = $name return $t/@title/string() The query is executed but no results are given. (I had expected that it would return the sequence {"XQuery", "Advanced R"} How should I correct the query-statement? Cheers, Ben

2 1

Unescaping revritten element name
by Mauro Mugnaini 11 Apr '20

11 Apr '20

Hi all, After parsing strings in XML with direct representation (e.g. with CSV and JSON module parsing) the specific entries are represented via elements and their names are rewritten. In particular (as per documentation): "underscores are rewritten to two underscores (__), and characters that are not valid in element names are rewritten to an underscore and the character’s four-digit Unicode.” It is possible to convert back the element’s node name with an XQuery function present in some module? Regards, Mauro

2 2

Write output using proc:execute
by Tim Thompson 09 Apr '20

09 Apr '20

Hello, Is it possible to redirect output from a system command within the proc:execute function? I would like to do something like: proc:execute("echo", ("hello!", "> hello.txt")) but the ">" does not seem to be recognized. Thanks in advance, Tim -- Tim A. Thompson Discovery Metadata Librarian Yale University Library

2 2

Issue - Data Access out of bounds
by Arjan Loeffen 08 Apr '20

08 Apr '20

Dear BaseX people, Got this message and lost my database contents. Any clue on what may have happened? Using BaseX 8.5.3. I know, you'll suggest upgrading, but still, ... 08:46:43.905 127.0.0.1:51534 admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs-regression 08:46:43.990 127.0.0.1:51534 admin 400 Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.5.3 Java: Oracle Corporation, 1.8.0_202 OS: Windows 10, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - table size: 3033 - first/next pre value: -1/-1 - #total/used pages: 0/0 - accessed page: -1 (0 > -1] at org.basex.util.Util.notExpected(Util.java:62) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:455) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) at org.basex.data.Data.kind(Data.java:293) at org.basex.query.value.node.DBNode.<init>(DBNode.java:52) at org.basex.core.cmd.OptimizeAll$DBParser.parse(OptimizeAll.java:209) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.DiskBuilder.build(DiskBuilder.java:82) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:139) at org.basex.core.cmd.OptimizeAll.run(OptimizeAll.java:48) at org.basex.core.Command.run(Co... 86.87 ms 08:46:43.997 127.0.0.1:51534 admin REQUEST [POST] http://localhost:8984/rest/imvertor-models 08:46:44.010 127.0.0.1:51534 admin 404 Database 'imvertor-models' is being updated, or update was not completed. 12.85 ms 08:46:44.013 127.0.0.1:51534 admin REQUEST [POST] http://localhost:8984/rest/imvertor-models-regression 08:46:44.085 127.0.0.1:51534 admin 400 Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.5.3 Java: Oracle Corporation, 1.8.0_202 OS: Windows 10, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - table size: 27452 - first/next pre value: -1/-1 - #total/used pages: 0/0 - accessed page: -1 (0 > -1] at org.basex.util.Util.notExpected(Util.java:62) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:455) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) at org.basex.data.Data.kind(Data.java:293) at org.basex.query.value.node.DBNode.<init>(DBNode.java:52) at org.basex.core.cmd.OptimizeAll$DBParser.parse(OptimizeAll.java:209) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.DiskBuilder.build(DiskBuilder.java:82) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:139) at org.basex.core.cmd.OptimizeAll.run(OptimizeAll.java:48) at org.basex.core.Command.run(C... 72.26 ms arjan -- *Arjan Loeffen* Armatiek BV & Armatiek Solutions BV 06-12918997

2 2

One of the map element causes SEPM0017 error
by Arkadiusz Bok 06 Apr '20

06 Apr '20

Hi, I'm trying to run one of unchanged code example from book "XQuery: Search Across a Variety of XML Data 2nd Edition" from publisher O'Reilly Media. |(: XQuery by Priscilla Walmsley (c) 2016 Priscilla Walmsley:) | |(:Example 13-4 Serialization parameters in a map :) xquery version "3.1"; declare namespace prod = "http://datypic.com/prod"; let $map := map { "method": "xml", "version": "1.0", "indent": true(), "cdata-section-elements": (xs:QName("prod:desc"),xs:QName("prod:name")), "use-character-maps": map { "«":"<%", "»":">%" } } let $element := <prod:name>Fleece Pullover</prod:name> return serialize($element,$map) | I'm using BaseX 9.3.2 to do this. But when I'm trying to run code, I get error: |Stopped at C:/Users/Arek/AppData/Local/Temp/example1304.xqy, 16/17: [SEPM0017] item() expected, xs:QName+ found: (Q{http://datypic.com/prod}desc, Q{http://datypic.com/prod}name). | When i remove 9 line with /cdata-section-elements/ element, code runs. Whether is it problem with XQuery implementation or with code? ||||

2 2

Problem with attribute parsing?
by Peter Villadsen 05 Apr '20

05 Apr '20

Hello I was doing some experiments and I ended up with this: let $c := <Class Source='{ttt'></Class> return $c/@Source When this is compiled in the BaseX GUI app, an error message ensues: Error: Stopped at ... /file3, 1/30: [XPST0003] Expecting '}', found '''. Query: let $c := <Class Source='{ttt'></Class> return $c/@Source Query plan: <QueryPlan compiled="false" updating="false"/> Surely that is not correct? If I add a } there, everything is fine: let $c := <Class Source='{ttt}'></Class> return $c/@Source I don't think there is an XML requirement forcing escaping start brace ('{') inside an attribute value? I know that XQuery supports <X A='{...}' /> where the inside of the {} is evaluated to give the value for the A attribute, but the example above is not XQuery, just an XML literal. I am sure I would have noticed this if it were a general problem. Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

2 1

EXPath package dependencies
by Clark, Ash 01 Apr '20

01 Apr '20

Hello, I’m trying to define the dependencies for a general-purpose EXPath package, one which I plan to use in both eXist-db and BaseX. So far I’ve got this in expath-repo.xml*: <dependency processor="basex"/> <dependency processor="http://exist-db.org" semver-min="4.0.0"/> Based on the spec, I gather that `//dependency/@processor` is supposed to be non-exclusive. However, when I try to install the package into BaseX, I get the error “Package version is not supported.” Is this a bug? Is there something else I should do? Warmly, Ash * https://github.com/NEU-DSG/wwp-public-code-share/blob/counting_robot/counti… Ashley M. Clark (she/her) XML Applications Developer Digital Scholarship Group Northeastern University Libraries as.clark(a)northeastern.edu (617) 373-5983

1 0

Re: [basex-talk] How to apply array:for-each on an array of arrays?
by Martin Honnen 31 Mar '20

31 Mar '20

On 31.03.2020 18:32, Ben Engbers wrote: > Hi, > > For (my personal) clarity, I have split up the original function in two > parts: > > declare function local:step_one($nodes as node()*) as array(*)* > { > let $text := for $node in $nodes > return $node/text() => > tokenize() => distinct-values() > let $idf := $text => > tidyTM:wordCount_arr() > return $idf > }; > > In local:step_one(), I first create a sequence with the distinct tokens > for each $node. All the sequences are joined in $text. > I then call wordCount_arr to count the occurences of each word in $text: > > declare function tidyTM:wordCount_arr( > $Words as xs:string*) > as array(*) { > for $w in $Words > let $f := $w > group by $f > order by count($w) descending > return ([$f, count($w)]) > } ; > > I would say that tidyTM:wordCount_arr returns a sequence of arrays but I > am not certain if I have specified the correct return-type? Reading the code I agree that the return type seems to be a sequence of arrays but therefore I wonder why you don't get a similar error as later on with declaring array(*) and not array(*)* > Calling local:step_one(tidyTM:remove_Stopwords($nodes, "Stp", $Stoppers)) > returns: > ["probleem", 703] > ["opgelost.", 248] > .... > > I had hoped that calling the following local:wordFreq, would add the > idf to each element but instead I get an error > > declare function local:wordFreq_idf($nodes as node()*) as array(*) > { > let $count := count($nodes) > let $idf := local:step_one($nodes) > let $result := for-each( $idf, > function($z) {array:append ($z, math:log($count div $z(2) ) ) } ) > return $result > }; > [XPTY0004] Cannot promote (array(xs:anyAtomicType))+ to array(*): $idf > := ([ "probleem", 703 ], [ "opgelost.", 248 ], ...). The message tries to tell you that the declared return type array(*) is a single array while the function returns a (non-empty) sequence of arrays so using declare function local:wordFreq_idf($nodes as node()*) as array(*)* would remove that error. To insert the third value into each array I think you want let $result := $idf ! array:append(., math:log($count div .(2) ))

2 1

How to apply array:for-each on an array of arrays?
by Ben Engbers 31 Mar '20

31 Mar '20

Hi, In textmining, the 'idf' or inverse document frequency is defined as idf(term)=ln(ndocuments / ndocuments containing term). I am working on a function that should return this idf. This function: declare function local:wordFreq_idf($nodes as node()*) as array(*) { let $count := count($nodes) let $text := for $node in $nodes return $node/text() => tokenize() => distinct-values() let $idf := $text => tidyTM:wordCount_arr() return $idf }; returns: ["probleem", 703] ["opgelost.", 248] ["dictu", 235] ["opgelost", 217] ["medewerker", 193] ... For "probleem", the idf should be calculated as ln($count/703). Since there are 1780 nodes this would result in 0.929011751. I tried to exten the 'let $idf' line with: => array:for-each(function($idf) {array:append($idf, math:log($count div $idf[2]) )}) which should result in ["probleem", 703, 0.929011751] but no mather what I do, every time I get this error: [XPTY0004] Cannot promote (array(xs:anyAtomicType))+ to array(*): ([ "probleem", 703 ], [ "opgelost.", 248 ], ...). Is it possible to apply array:for-each on an array of arrays? Ben

4 7

collection('/test-db-1/bib')//Q{}libro versus collection('/test-db-1/bib')//libro
by Martin Honnen 30 Mar '20

30 Mar '20

Using BaseX 9.3.2, why does a query collection('/test-db-1/bib')//Q{}libro return 6 items while collection('/test-db-1/bib')//libro gives 0 items? If I run collection('/test-db-1/bib')//Q{}libro, collection('/test-db-1/bib')//libro the info window shows Compiling: - rewrite fn:collection([uri]) to document-node() item: collection("/test-db-1/bib") -> db:open-pre("test-db-1", 12000002) - merge steps: descendant::element(libro) - rewrite fn:collection([uri]) to document-node() item: collection("/test-db-1/bib") -> db:open-pre("test-db-1", 12000002) - remove step without results: element(libro) - rewrite iter step to empty sequence: element(libro) -> () - rewrite cached path to empty sequence: db:open-pre("test-db-1", 12000002)/descendant-or-self::node()/() -> () - rewrite expression list to iter path: (db:open-pre("test-db-1", 12000002)/descendant::element(libro), ()) -> db:open-pre("test-db-1", 12000002)/descendant::element(libro) Optimized Query: db:open-pre("test-db-1", 12000002)/descendant::element(libro) Query: collection('/test-db-1/bib')//Q{}libro, collection('/test-db-1/bib')//libro Result: - Hit(s): 6 Items - Updated: 0 Items - Printed: 1455 b - Read Locking: test-db-1 - Write Locking: (none)

2 2

Re: [basex-talk] serialize with SerialMethod.XML
by jfrm.maurel＠gmail.com 30 Mar '20

30 Mar '20

Hi Christian, Le 30/03/2020 à 15:51, Christian Grün a écrit : > You should always close instances of classes that inherit the > Closeable interface. Thank you for the tip. I will change my code. Regards. -- Jean-François MAUREL PIMECA http://www.pimeca.com

1 0

serialize with SerialMethod.XML
by jfrm.maurel＠gmail.com 25 Mar '20

25 Mar '20

Hi, I am currently learning how to use BaseX with Java in embedded mode. When I use the following code with SerialMethod.BASEX every thing is fine however if I replace it with SerialMethod.XML I obtain an empty file without any error message. Could you please tell me what I am doing wrong in the second case (with SerialMethod.XML) ? ====================== public static void serialize(String query, String outputFileUri) { try { QueryProcessor processor = new QueryProcessor(query, context); File outputFile = FileProc.newFile(outputFileUri); SerializerOptions so = new SerializerOptions(); so.set(SerializerOptions.ENCODING, "UTF-8"); so.set(SerializerOptions.METHOD, SerialMethod.BASEX); // so.set(SerializerOptions.METHOD, SerialMethod.XML); so.set(SerializerOptions.OMIT_XML_DECLARATION, YesNo.NO); Serializer serializer = Serializer.get(new FileOutputStream(outputFile), so); Item item = processor.iter().next(); serializer.serialize(item); processor.close(); } catch (QueryException e) { e.printStackTrace(); } catch (IOException e) { e.printStackTrace(); } } ====================== BaseX 9.3.3 from github Java 8 Windows 10 Regards -- Jean-François MAUREL PIMECA http://www.pimeca.com

1 0

Unwanted XML output when using RestXQ custom response
by Mickael Desfrenes 19 Mar '20

19 Mar '20

Hello, This is my first post here, I hope this is the right list for such questions. I am using RestXQ to send assets to the browser. Given that I want to control some headers ("expires" and such), I thought I could use RestXQ custom responses. Here's what I came up with: declare %rest:path("/plugins/{$filePath=.*}") function max.file:pluginUIFile($filePath as xs:string){ let $path := file:parent(file:parent(static-base-uri())) || "/plugins/" || $filePath return (<rest:response> <http:response status="200"> <http:header name="expires" value="Wed, 21 Oct 2222 07:28:00 GMT"/> </http:response> </rest:response>, max.util:rawFile($path)) }; The HTTP response does have the wanted header. However, the body has some unwanted XML at the top: <rest:response xmlns:rest="http://exquery.org/ns/restxq"> <http:response xmlns:http="http://expath.org/ns/http-client"/> <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization"> <output:media-type value="text/ecmascript"/> </output:serialization-parameters> </rest:response> class DocumentBasket { constructor(basket_id = "basket") { this.storage = localStorage; this.basket_id = basket_id; } _fetch_basket_data() { let basket_data = this.storage.getItem(this.basket_id); if (basket_data === null) { basket_data = []; } else { basket_data = JSON.parse(basket_data); } return basket_data; } [more js below] Since I'm fairly new to the basex framework, I'm not sure if I'm doing something wrong or if it's some kind of bug. Thank you for your help, M. Desfrênes

2 1

Copy data from one database to another(basex)
by DK Singh 18 Mar '20

18 Mar '20

Hi I have to copy content from one database to another database, database containing xml files and word files. When i try to copy using function db:copy('test','test1') where 'test' is source database and 'test1' is destination database then it copies only xml files word files are not copied, can anyone suggest how can i achieve this. Regards Dharmendra Kumar Singh

2 1

running Xunit tests from maven
by Duncan Paterson 15 Mar '20

15 Mar '20

HI Basex folks, i m looking into building two expath packages one for exist and one for bases using maven. I have the build configured and get proper xars, but i m struggling with running basex’s Xunit tests as part of the maven build. I didn’t find anything on the mailing list or in the docs about that. If somebody has an example project they could point me towards that would be greatly appreciated. Basically i want to know if this is possible at all, and if so what dependencies / libs i need to declare inside my pom for this to work. Greetings Duncan Ceterum censeo exist-db.org esse conriganda

2 1

Problem with file in db
by Jason Davis 13 Mar '20

13 Mar '20

Hello, I have a confounding problem involving a database that is deployed to a web server. The database will support a web app that provides an SPA interface to the database and lists resources through various APIs. When I test the app locally, everything works fine. However, when I deploy the database to a web server, one file in particular grounds the app to a halt. Apparently, this particular document does not exist in the database: [basex:doc] Database path 'd4st^newco-docs^master/shared/KuduVariables.xml' yields no documents. In addition, I can use the CLI to list the database contents and it's clearly listed there. When I attempt to delete it (i.e. delete shared/KuduVariables.xml), the result is 0 resources deleted. What would cause something like this to happen? Is there a preferred method for deploying the db that would prevent weird things like this happening? Thanks, Jason -- Jason Davis Staff Tools Engineer, Content Development jason.davis(a)cloudera.com Mobile: 510-225-8281

2 4

New version for RBaseX
by Ben Engbers 13 Mar '20

13 Mar '20

Hi, I am glad that version 0.2.4 from my R-package 'RBaseX' has been accepted by CRAN (https://cran.r-project.org/package=RBaseX)! Large parts of the earlier version from the R-package 'RBaseX' have been rewritten and the resulting code is much cleaner. I have added tests and thanks to those test, I found (and fixed) several bugs. To my knowledge, the full server-protocol has now been implemented. One of the main differences concerns error-handling. All client-requests to the basexserver end with either a \00 byte or a \01. I have used this feature to add an extra layer of error-handling. The default is still the regular tryCatch method. But after setting 'intercept' to TRUE, you can now define your reaction upon errors. See the following example: Session <- BasexClient$new("localhost", 1984L, username = "admin", password = "admin") Session$set_intercept(TRUE) Session$Execute("drop DB TestDB") Session$Execute("Open TestDB") if (!Session$get_success()) { Session$Create("TestDB") Session$Add("Test.xml", "<Line_1 line='1'>Content 1</Line_1>") } Session$Execute("Close") Session$restore_intercept() I am already working on a new version in which I will implement more specific R-related topics (populating dataframes with XQuery-results. Ben

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk