- BaseX-Talk - mailman.uni-konstanz.de

Java binding - variable arguments
by Luan Bui 23 Apr '19

23 Apr '19

Hello all, How can I call a method with variable arguments in BaseX with Java binding? I am trying to do this: |let $string := 'Format string: %1$d - %2$s'|| || let $i := 1|| || let $j := 'text'|| || return Q{java.lang.String}format·java.lang.String·java.lang.Object*($string, $string, $i, $j)| However, I got the error: [XPDY0002] {java.lang.String}format·java.lang.Stri...: Context is undeclared. Thank you for your time.

3 4

Query profiling and debugging support in BaseX
by Reece Dunn 22 Apr '19

22 Apr '19

Hi, I'm wondering how you would go about profiling a query in BaseX to determine how long various query statements take, so you can look at the places where you need to modify the query to be faster. I have added MarkLogic's profiling support into my XQuery plugin that does this and am wondering how this can be done in BaseX. I'm aware of the prof functions, but these are more useful for manually instrumenting sections of a query, and not an automated way of getting the timing information for all the queries and parts of the query. Specifically for integrating into an IDE. I could display the timings, like in the BaseX GUI. Is there a way to get this information using the org.basex.api.client interfaces? Is there a way to get the query plan, pre-evaluation mapping, and optimized query for the given query? It would be helpful to link these back to the source file, so things like optimisation hints can link back to the file being edited. Finally, I am looking into debugging support and am wondering if this is possible to do for BaseX queries. What approach would be best for this, especially in terms of integrating it into an IDE? Kind regards, Reece

2 8

RESTXQ, multipart/form-data, out of memory saving to file
by James Ball 21 Apr '19

21 Apr '19

Hello everyone, I’m trying to use BaseX RESTXQ to upload some large (around 300MB) Zip files using HTML forms (multipart/form-data), save them to disk and then process them. But I am getting server errors with large files (small files work perfectly). HTTP ERROR 500 Problem accessing /test.htm. Reason: Server Error Caused by: java.lang.OutOfMemoryError: Java heap space Powered by Jetty:// 9.4.9.v20180320 <http://eclipse.org/jetty> It seems to be when reading the file from the map of files. 1) Upload large file but do nothing with it - WORKS 2) Upload large file and just write the whole POST data to file - WORKS 3) Upload large file and write file from map - ERROR This is the file writing function I’m using: file:write-binary( "/Users/me/Desktop/delete2.zip”, $files(map:keys($files)[1]) ) Running BaseX 9.1 Is there something really obvious that I’m doing wrong? (There usually is :) ) Many thanks, James

3 6

map:merge() does not handle wrong $option parameter
by Andreas Mixich 21 Apr '19

21 Apr '19

Given: let $d1 := map {"key1":"value1"} let $d2 := map {"key2":"value2"} return map:merge($d1, $d2) where the two maps to be merged should have been included as sequence, but were, mistakenly, not, the function should return an error, since the second map gets evaluated as $options, but none of the $options are to be found inside. It seems, that only a type-check is done, to assure valid $options, since, in another case, I got a [XPTY0004]. -- Minden jót, all the best, Alles Gute, Andreas Mixich

2 1

Can't locate reason for a [XQST0049] Duplicate declaration of static variable
by Andreas Mixich 20 Apr '19

20 Apr '19

Hi, I get a `[XQST0049] Duplicate declaration of static variable $string:debug` and can't find out why. I checked the sources and the variable is declared only once. This happens in a scenario, where I have a co-dependency on several modules and each load the modules they need, some load the same modules as another module. I thought about a circular dependency, but I do not find it. Could it be made so, that upon such an error, the places, in which the 'other' declaration was found get referenced as well in the error message? That would be very practical (I also had problems like this with function declarations, in the past, some are still unresolved). Thanks, and congrats to the 9.2 update. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 2

java.lang.NullPointerException at org.basex.query.expr.TypeswitchGroup.equals(TypeswitchGroup.java:173)
by Andreas Mixich 19 Apr '19

19 Apr '19

Hello, I don't really understand what just happened, so I attached the testcase and stacktrace to circumvent any malformation by the mail software in use. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 3

my first baseX db
by Robert Kirkpatrick 18 Apr '19

18 Apr '19

Hello, Novice, newbie request: GUI snapshot: Command: CREATE DB science C:/Users/rober/Google Drive/science/ Error: "Configurations2/accelerator/current.xml" (Line 1): Premature end of file. TIA, Robert.

2 2

BaseX/GUI v9.1.2 memory use
by Rick Graham 18 Apr '19

18 Apr '19

Hello, Thanks again, as always, for a great product. I just installed BaseX v9.1.2 (upgrading from a previous v9.1.2 snapshot), launched the GUI and then got interrupted. When I returned, almost all of the JVM's memory was being used. I hit "GC" several times but it didn't seem to help. I had no database loaded/open. Seems like some memory isn't getting freed properly. Here's my "INFO" General Information: > Version: 9.1.2 > Used Memory: 1593 MB > Global options: > AUTHMETHOD: Basic > CACHETIMEOUT: 3600 > DBPATH: /usr/local/src/basex/data > DEBUG: false > FAIRLOCK: false > HOST: localhost > HTTPLOCAL: false > IGNORECERT: false > IGNOREHOSTNAME: false > KEEPALIVE: 600 > LANG: English > LANGKEYS: false > LOG: true > LOGMSGMAXLEN: 1000 > LOGPATH: .logs > NONPROXYHOSTS: > PARALLEL: 8 > PARSERESTXQ: 3 > PASSWORD: > PORT: 1984 > PROXYHOST: > PROXYPORT: 0 > REPOPATH: /usr/local/src/basex/repo > RESTPATH: > RESTXQPATH: > SERVERHOST: > SERVERPORT: 1984 > STOPPORT: 8985 > TIMEOUT: 30 > USER: > WEBPATH: /usr/local/src/basex/webapp > Local options > ADDARCHIVES: true > ADDCACHE: false > ADDRAW: false > ARCHIVENAME: false > ATTRINCLUDE: > ATTRINDEX: true > AUTOFLUSH: true > AUTOOPTIMIZE: false > BINDINGS: > CASESENS: false > CATFILE: > CHECKSTRINGS: true > CHOP: true > COMPPLAN: true > COPYNODE: true > CREATEFILTER: *.xml > CREATEONLY: false > CSVPARSER: > DEFAULTDB: false > DIACRITICS: false > DOTCOMPACT: false > DOTPLAN: false > DTD: false > ENFORCEINDEX: false > EXPORTER: > FORCECREATE: false > FTINCLUDE: > FTINDEX: false > HTMLPARSER: > INLINELIMIT: 100 > INTPARSE: false > JSONPARSER: > LANGUAGE: en > LSERROR: 0 > MAINMEM: false > MAXCATS: 100 > MAXLEN: 96 > MAXSTAT: 30 > MIXUPDATES: false > PARSER: xml > QUERYINFO: true > RUNQUERY: true > RUNS: 1 > SERIALIZE: true > SERIALIZER: > SKIPCORRUPT: false > SPLITSIZE: 0 > STEMMING: false > STOPWORDS: > STRIPNS: false > TAILCALLS: 256 > TEXTINCLUDE: > TEXTINDEX: true > TEXTPARSER: > TOKENINCLUDE: > TOKENINDEX: false > UPDINDEX: false > WRITEBACK: false > XINCLUDE: true > XMLPLAN: true Best regards, Richard

6 15

name condition in predicates
by Alexander Witzigmann 18 Apr '19

18 Apr '19

the following query > for $hit in //*[./name() ="p"] > > return > <out >{$hit}</out> leads to > Improper use? Potential bug? Your feedback is welcome: > Contact: basex-talk(a)mailman.uni-konstanz.de > Version: BaseX 9.2 > Java: Oracle Corporation, 10 > OS: Windows 7, amd64 > Stack Trace: > java.lang.NullPointerException > at org.basex.query.expr.SimpleMap.get(SimpleMap.java:43) > at org.basex.query.expr.path.Path.optimize(Path.java:202) > at org.basex.query.expr.path.Path.compile(Path.java:153) > at org.basex.query.expr.Arr.compile(Arr.java:42) > at org.basex.query.expr.Preds.compile(Preds.java:46) > at org.basex.query.expr.path.Step.compile(Step.java:95) > at org.basex.query.expr.path.Path.compile(Path.java:142) > at org.basex.query.expr.gflwor.ForLet.compile(ForLet.java:43) > at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:88) > at org.basex.query.scope.MainModule.comp(MainModule.java:81) > at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) > at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) > at org.basex.query.QueryContext.compile(QueryContext.java:312) > at org.basex.query.QueryProcessor.compile(QueryProcessor.java:79) > at org.basex.core.cmd.AQuery.query(AQuery.java:93) > at org.basex.core.cmd.XQuery.run(XQuery.java:22) > at org.basex.core.Command.run(Command.java:257) > at org.basex.core.Command.execute(Command.java:93) > at org.basex.gui.GUI.exec(GUI.java:422) > at org.basex.gui.GUI.lambda$execute$4(GUI.java:365) > at java.base/java.lang.Thread.run(Unknown Source) > Compiling: > - pre-evaluate root to document-node() sequence: root() -> > (db:open-pre("publication-toc", 0), ...) > Optimized Query: > for $hit_0 in (db:open-pre("publication-toc", 0), > ...)/descendant-or-self::node()/*[(name() = "p")] return element out { > ($hit_0) } > Query: > for $hit in //*[./name() ="p"] return <out >{$hit}</out> might be some side effect from latest improvements? Alex

2 1

FTP client module
by Fabrice ETANCHAUD 17 Apr '19

17 Apr '19

Hi all ! I am happy to get back to basics, after a lot of SQL ;-) On november 2017, Christian proposed to broadcast a FTP client module to the list, I must have missed the link, I cannot find the module. Is it still possible to get it ? Thank you, Best regards, Fabrice

3 2

BaseX 9.2: The Spring Edition
by Christian Grün 17 Apr '19

17 Apr '19

Dear all, We are more than pleased to announce version 9.2 of BaseX, our XML framework, database system and XQuery 3.1 processor: http://basex.org/ This time, we have put a special focus on performance improvements: XQUERY PERFORMANCE - comparisons will more often be rewritten to hash joins - optimized access to subsequences and single sequence items - consistent propagation of static types to evaluation results - improved static typing of function items (maps, arrays) - more aggressive pre-evaluation at compile time STORAGE PERFORMANCE - large databases will be opened faster - regular storage offset will be computed at runtime GENERAL XQUERY FEATURES - no need to import basex-api modules anymore! - Archive Module: archive:create-from, new options - Database Module: directory-based access via db:dir - Profiling Module: new functions (prof:gc, prof:runtime) - Validation Module: assign XSD validation features - WebSocket Module: query scheduling via ws:eval - Utility Module: various new helper functions - XSLT Module: support for XML Catalogs (thank you Liam) NEW OPTIONS - RESTXQERRORS: Suppress parsing errors at runtime - FULLPLAN: comprehensive query plan information FULLTEXT FEATURES - stemmer for Arabic texts added USER INTERFACES - GUI: better support for latest JDK versions (incl. OpenJDK) - DBA: revised search features in log panel For a more comprehensive list of added and updated features. please check out our documentation: http://docs.basex.org/. We are looking forward to your feedback. Have fun with the new release, Your BaseX Team

5 5

Func def & performance: element()* vs item()*
by Chuck Bearden 12 Apr '19

12 Apr '19

BaseX is a great tool for analyzing & characterizing large amounts of XML data. I have used it both at work and on personal projects. I hope the following observation is useful. When I define a function that recurs over a sequence of elements in order to build a map of element name counts, I find that when I specify the type of the element sequence as 'element()*', the function runs so slowly that I give up after 5 minutes or so. But when I specify the type as 'item()*', it finishes in 40 seconds or less. Here's an example: -----begin code snippet----- declare namespace local="w00fw00f"; declare function local:count($elems as element()*, $elem_counts as map(*)) as map(*) { let $elem := head($elems), $elem_name := $elem/name(), $elems_new := tail($elems), $elem_name_count := if (map:contains($elem_counts, $elem_name)) then map:get($elem_counts, $elem_name) + 1 else 1, $elem_counts_new := map:put($elem_counts, $elem_name, $elem_name_count) return if (count($elems_new) = 0) then $elem_counts_new else local:count($elems_new, $elem_counts_new) }; let $coll := collection('pure_20190402'), $elems := $coll/result/items/*, $elem_names_map := local:count($elems, map {}) return json:serialize($elem_names_map, map {'format' : 'xquery'}) -----end code snippet----- In the function declaration, changing "$elems as element()*" to "$elems as item()*" makes the difference in performance. Replacing the JSON serialization with a standard XML one does not change the performance. I am running BaseX 9.1.2 under Ubuntu 16.04.6. All the best, Chuck Bearden

4 6

Nooby/#CitizenScientist REQUEST for HELP: Python implementation of this XQuery
by Jim Salmons 11 Apr '19

11 Apr '19

To the BaseX Community, I am a 68-year-old #PayItForward cancer-survivor independent #CitizenScientist doing applied research in #DigitalHumanities and #MachineLearning and I need your help, please. And please forgive me for posting such a TL;DR post. I am not lazy nor a dilettante, I am simply under tight time pressure to get some development done on my Python-based metadata discovery and curation toolkit which my fellow cancer-surviving wife, Timlynn, and I will be showcasing via our poster presentation accepted for next month's #DATeCH2019 conference in Brussels (http://datech.digitisation.eu/). Our poster is entitled "#MAGAZINEgts and #dhSegment: Using a Metamodel Subgraph to Generate Synthetic Data of Under-Sampled Complex Document Structures for Machine-Learning" (ResearchGate preprint: https://is.gd/factminers_datech2019_poster). #MAGAZINEgts is the XML-based ground-truth storage format Timlynn and I are developing based on an ontological "stack" of #cidocCRM/FRBRoo/PRESSoo using a metamodel subgraph design pattern. The goal of our design is to support an integrated complex document structure and content depiction model for digital collections of print magazines and newspapers. (For more, see our #DATeCH2017 poster: https://is.gd/factminers_datech2017_poster) We are evolving a reference implementation of the #MAGAZINEgts format for the collection of Softalk magazine at the Internet Archive. The collection is here: https://archive.org/details/softalkapple?&sort=date, and the MAGAZINEgts file (~10+ MB) is linked from the About page of the collection but is provided here as a shortened link: https://is.gd/softalk_magazinegts_xml_file. MY IMMEDIATE GOAL: Rather than keep with the awkward workflow of generating intermediary JSON metadata files and, in batches, converting to XML and copy-pasting into appropriate positions in the master publication file, I want to incorporate direct incremental updating of fine-grained #MAGAZINEgts metamodels, metadata, and their associated source-document-specific datasets via integrating BaseX into the FactMiners Toolkit (fmtk). We would _really_ like to be showing this significant enhancement of our toolkit at the DATeCH conference (8-10 May). MY CURRENT CONTEXT: I have the latest BaseX installed, working well, and I have done as much "fast track" learning as I can to come up to "toddler" speed on BaseX and its Python-based API. I have the Python API extension installed and working within my PyCharm IDE, and I am on Windows 10. MY CURRENT NEED: I have used the BaseX GUI to develop a sample XQuery for updating/adding a machine-learning data spec for curating the bounding boxes of advertisements on a page within a magazine. The query below is not parameterized for programmatic dynamic execution. It is simply a hard-coded test of my evolving understanding of doing BaseX interactions. So the dataset name ("all_ads"), the issue-page filename (softalk_v2n02pg002.png) and the various dimension numbers, etc. are explicit rather than variable, etc., within this sample query. When I run this query and do an export of the MAGgts master file, the update is there and looks great. Even though my knowledge and skills with BaseX are small but growing, I feel I have enough grip on things to forge ahead to at least get BaseX integrated for the #ML image training dataset feature that we will showcase at #DATeCH2019. (BTW, I stripped the #MAGgts schema's XML namespace during BaseX database creation to make things easier during learning. I expect to simply restore it in the header after exporting and before uploading a new release of Softalk's reference implementation of this ground-truth format. Either that, or I will tweak the eventual Python-implementation of the queries to include the namespace and just leave it intact when importing into the local BaseX database.) HERE IS THE SAMPLE QUERY: === declare option db:WRITEBACK 'true'; declare variable $new_spec := <ML_training_img_spec file_name="softalk_v2n02pg002.png"> <ML_image_dim width="940" height="1280"/> <ML_label_bbox label="ad" status="predicted" left="500" top="680" width="444" height="580"/> <ML_label_bbox label="ad" status="actual" left="490" top="620" width="440" height="575"/> </ML_training_img_spec>; update:output("Update successful."), insert node $new_spec as last into doc("MAGgts") //Metadata//ML_maxpixel_datasets[@max_pixels = "1000000"] /ML_dataset[@name="all_ads"]//ML_training_img_specs === MY REQUEST FOR ASSISTANCE: It would be _extraordinarily_ helpful, and Timlynn and I would be most grateful, if someone within the BaseX community that has familiarity with doing Python-based BaseX integration could provide a brief implementation -- similar to the examples supplied in the Client integration samples -- that would show me how to take a BaseX GUI-developed query and convert it to a usable state in a Python program. BY WAY OF THANK YOU: If anyone can help us short-circuit my path to integrating BaseX into our #DATeCH2019 poster presentation, we will gladly cite you and your assistance in the acknowledgements of the poster and its 2-page companion handout. Again, I am sorry for hitting folks with such a long and detailed request for nooby assistance. In advance, thank you for any help you Good Folks may provide. I look forward to significantly improving the functionality of the FactMiners Toolkit by incorporating BaseX into its core platform. Happy-Healthy Vibes from Colorado USA, -: Jim Salmons :- https://www.researchgate.net/profile/Jim_Salmons

2 3

Add & replace documents
by Johannes Bauer 11 Apr '19

11 Apr '19

Hi, this may seem like a dumb question, but how can I add & replace a number of documents in a database? I have a directory with some files that I want to import. Some of the documents may already exist in the database. If I use the db:replace('db', '', '/path/to/my/files') function it adds the missing docs and overwrites the existing ones. But it also deletes all other documents from the database. I cannot work with db:add() because it does not overwrite existing docs. Any suggestions? Best regards Johannes

2 4

concurrent performance issues?
by Michael Perkonigg 08 Apr '19

08 Apr '19

Hallo, ich versuche gerade, BaseX hier für eine zentrale XML-DB zu evaluieren. Die DB ist read-only. Wir haben also keinerlei Updates. Wir haben verschiedene XQuery-Queries(?), die abgesetzt werden, dabei ist aufgefallen, dass wenn ich mehrere Queries parallel starte die Antwortzeiten unverhätnismässig steigen. Einzeln: Query1: 500ms Query2: 1200ms Parallel brauchen beide zusammen dann zwischen 3 und 5 Sekunden. Erstaunlicherweise sind die Antwortzeiten mit der Option PARALLEL=1 am geringsten, d.h. bei der Defaulteinstellung PARALLEL=8 (und auch schon bei PARALLEL=2) steigen die Antwortzeiten. Ich frage mich nun, ob BaseX als Datenbank für eine verteilte Applikation mit zentraler DB überhaupt geeignet ist und ob ich vielleicht mit irgendwelchen Optionen BaseX für meine Zwecke optimieren kann. Ganz theoretisch könnte die DB ja mit hundert parallelen Anfragen belastet werden. -- mit freundlichen Grüßen

3 2

Two questions on use of the serialize function and character maps
by Martin Honnen 08 Apr '19

08 Apr '19

I am struggling to use the "serialize" XPath 3.1 function as specified by the W3C with BaseX 9.1.2: 1) Is there any way to provide the "use-character-maps" parameter supplied the XPath 3.1 way with a second argument to "serialize" as a map: serialize("a,b", map { 'method' : 'text', 'use-character-maps' : map { "'" : "&apos;" }}) I get an error saying [SEPM0017] Invalid 'use-character-maps' value 'map { "'": "&apos;" }'; must be a string. 2) When I try the XPath 3.0 way of providing the serialization parameters as an XML element I also get an error: When I run declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:method "text"; serialize( ( <text>'</text>, "'", map { "Ä":"\'C4", "Ö":"\'D6", "Ü":"\'DC", "ß":"\'DF", "ä":"\'E4", "ö":"\'F6", "ü":"\'FC" } ), <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization"> <output:method value="adaptive"/> <output:use-character-maps> <output:character-map character="'" map-string="&apos;"/> </output:use-character-maps> </output:serialization-parameters> ) in BaseX it tells me [SEPM0017] Character map 'character-map=,' is not defined. Saxon 9.9 and Altova 2018 run that example without giving an error (although not with the same serialization result, but that is a different issue).

2 7

BigInteger
by Andre Bovy 05 Apr '19

05 Apr '19

Hi Chistian, I am trying to use a very Big Integer in BaseX (9.1.2) With this value : declare namespace BigInteger = "java:java.math.BigInteger"; BigInteger:new("12345678901234567890”) I received : Cannot convert xs:string to xs:integer: "12345678901234567890”. The java method that I used returns a BigInteger, but I just need the value as a String. I tried : BigInteger:toString(BigInteger:new("12345678901234567890”)) without success (same error) Is there a workaround to this behaviour ? without writing a Java class. Thank you in advance André

3 5

jobs:eval as a service, "no variables allowed"
by Zimmel, Daniel 03 Apr '19

03 Apr '19

Hi, when I try to register jobs:eval as a service, BaseX 9.2 says: "no variables allowed". Is it not possible to register a service with a variable? Not working: jobs:eval("declare variable $xml external; $xml", map { 'xml': 'XML' }, map { 'id':'TEST', 'start':'11:31:50', 'interval':'P1D', 'service': true() }) working: jobs:eval("declare variable $xml external; $xml", map { 'xml': 'XML' }, map { 'id':'TEST', 'start':'11:31:50', 'interval':'P1D', 'service': false() }) http://docs.basex.org/wiki/Jobs_Module#jobs:eval Thanks, Daniel

2 2

Tumbling window
by Giuseppe G. A. Celano 03 Apr '19

03 Apr '19

I have written the following code: for tumbling window $s in ("this", "is", "an", "example", "." , "this", "is", "another", "[", "example", ".", "]", "Another", "example", ".") start $a when fn:true() end $b next $r when ($b = "." and $r = "]") or $b = "." return <s>{$s}</s> which returns: <s>this is an example .</s> <s>this is another [ example .</s> <s>] Another example .</s> but I am looking for <s>this is an example .</s> <s>this is another [ example . ]</s> <s>Another example .</s> I am playing around with if-clauses, but I am wondering whether there is a more direct way to force the end of a sentence at "]" when it is preceded by "." or at "." when there is no following "]". Thanks. Ciao, Giuseppe

2 2

Hitting the Tail Recursion wall
by Andreas Mixich 02 Apr '19

02 Apr '19

Hi, I am trying to implement the algorithm outlined at https://tools.ietf.org/html/rfc3986#section-5.2.4 (Two other implementations are at [1] and [2]) The following function is my work in progress. It seems, all goes fine, till the last `else`, which is commented with `(: E :)`. I hit the tail recursion barrier and I do not see why. The function may not (yet) make sense, since I am still experimenting. `local:remove-dot-segments("/a/b/c/./../../g",[])` ``` (:~ Remove dot segments from a URI path component according to RFC 3986 Section 5.2.4 @param $path the path component of an URL @param $out an empty (!) array @return the path component with the relative part (dot segments) removed and resolved to the absolute path. @see https://tools.ietf.org/html/rfc3986#section-5.2.4 :) declare function local:remove-dot-segments( $path as xs:string, $out as array(*)) as item()* { concat("in: ", $path, " out: ", string-join(array:flatten($out))), if (not(contains($path, "."))) then $path else if (string-length($path) > 0) then (: A :) if (substring($path,1,3) = "../") then local:remove-dot-segments(substring($path, 4), $out) else if (substring($path, 1, 2) = "./") then local:remove-dot-segments(substring($path, 3), $out) else (: B :) if (substring($path,1,3) = "/./") then local:remove-dot-segments(concat("/", substring($path, 4)), $out) else if (substring($path, 1, 2) = "/.") then local:remove-dot-segments(concat("/", substring($path, 3)), $out) else (: C :) if (substring($path, 1, 4) = "/../") then let $ret := array:remove($out, array:size($out)) return local:remove-dot-segments(concat("/", substring($path, 5)), $ret) else if (substring($path, 1, 3) = "/..") then let $ret := array:remove($out, array:size($out)) return local:remove-dot-segments(concat("/", substring($path, 4)), $ret) else (: D :) if ($path = ".." or $path = ".") then local:remove-dot-segments(concat(substring((), 4), ""), $out) else (: E :) let $ret := if (starts-with($path, "/")) then array:append($out, concat("/", substring-before(substring($path,2), "/"))) else array:append($out, substring-before(substring($path,1), "/")) return local:remove-dot-segments($path, $ret) else $path }; ``` Sorry for throwing such a big function at you, but I do not find the place, where the stack overflow gets triggered. It does not happen, if I return an empty sequence at `else (: E :)`. If I replace that part (after `else (: E :)`) with `local:remove-dot-segments($path, $out)` I get the stack overflow as well, which is, what confuses me the most. [1]https://github.com/ariutta/remove-dot-segments/blob/master/index.js [2] https://gist.github.com/rdlowrey/5f56cc540099de9d5006 -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 4

Using local xqj
by Gardner, Arthur 01 Apr '19

01 Apr '19

Hi! I've downloaded BaseX 9.2 (Windows distro). One thing I want to try is the xqj implementation, running locally on the server. I found the class net.xqj.basex.local.BaseXXQDataSource But when I try getConnection() on an instance of this, I get the following: java.lang.NoClassDefFoundError: org/basex/core/Proc I've searched for this class, but without success. Any ideas out there? Arthur Gardner | Infosys Ltd MetLife | Clarks Summit, PA Office 570-587-6898 | Mobile 262-442-7472 The information contained in this message may be CONFIDENTIAL and is for the intended addressee only. Any unauthorized use, dissemination of the information, or copying of this message is prohibited. If you are not the intended addressee, please notify the sender immediately and delete this message.

2 2

Quick Windows issue: Invalid reply on port 1984, works fine on port 8984
by Jim Salmons 01 Apr '19

01 Apr '19

Hello BaseX folk, I have just installed version 9.1.2 and am starting to learn BaseX in support of my post-cancer #PayItForward Bonus Round #CitizenScientist research in #DigitalHumanities and #MachineLearning. My goal is to "cut out the middleman" of writing intermediate JSON and XML fragment files in order to update the #MAGAZINEgts ground-truth storage file that I am developing for a digital collection of Softalk Apple magazine at the Internet Archive. With BaseX and its Python interface, I want to write new and updated document structure and content depiction metadata directly to a local copy of this ground-truth master file which will then be easily popped out of the database as an XML file for uploading to the Softalk Apple collection at the Internet Archive. I hit a bump, reported to the Github Issue queue, where my Windows 10 installation can not open the BaseX GUI exe launcher. The work-around, as noted in my issue report, is to use the Getting Started advice to execute the jar directly. By creating a desktop icon that launches the execuable jar in the installation folder, the GUI launches as expected. With that minor issue behind me, I am wondering why my attempts to connect to the server via localhost:1984 port does not work while everything is fine and dandy when hitting port 8984. Port 1984 returns an invalid HTTP response. (Note: Other ports that are not assigned to anything else return a connection refused, so this invalid response is not the same as the server not being there.) If I keep a Powershell window open with the server running, every once in a while (after several minutes or more) the server throws this error: java.lang.NullPointerException at org.basex.core.Context.perm(Context.java:252) at org.basex.core.Command.run(Command.java:250) at org.basex.core.Command.run(Command.java:143) at org.basex.core.cmd.Close.close(Close.java:54) at org.basex.server.ClientListener.close(ClientListener.java:232) at org.basex.BaseXServer$1.run(BaseXServer.java:157) at java.base/java.util.TimerThread.mainLoop(Timer.java:556) at java.base/java.util.TimerThread.run(Timer.java:506) which may be related to port 1984 not responding, a firewall issue perhaps? Honestly, I don't see anything that looks like a BaseX process or service running in Task Manager (other than a generic 'Java(TM) Platform SE binary' process, and there is nothing that looks related in the Windows Firewall entries. I'm still investigating this here, but if anyone knows what is akimbo, I would greatly appreciate your advice. Thank you... and looking forward to being a new BaseX community member. :-) Happy-Healthy Vibes, -: Jim Salmons :- Jim Salmons Twitter: @Jim_Salmons https://www.researchgate.net/profile/Jim_Salmons (my #CitizenScientist profile) www.medium.com/@Jim_Salmons/ (my mostly #DigitalHumanities writing)

3 4

Access variable database without locking all databases
by Leah Chatkeonopadol 29 Mar '19

29 Mar '19

Hi, I'm using BaseX as a database for a web application with RESTXQ API endpoints. Each endpoint has a database name specified as a path param, for example: declare %rest:GET %rest:path('data/{$database}/read') function readData($database as xs:string) { let $doc := fn:doc($database || '/data.xml') return $doc }; All of the queries inside the function are only run against a single database, but as described in the transaction management <http://docs.basex.org/wiki/Transaction_Management#Limitations> documentation, using fn:doc with a variable will lock all the databases. Is there any way around this? Any suggestions would be much appreciated. Thanks!

1 0

Higher order functions in XSLT
by nikos dimitrakas 28 Mar '19

28 Mar '19

Hi! Is there something in BaseX that prohibits using higher order functions in XSLT (called with xslt:transform)? for-each($somenodes, function($q) { string($q) }) and for-each($somenodes, string#1) both work in XQuery in BaseX, but when I use the same call in an XSLT that I call with xslt:transform, I get the following message XPST0003: Inline functions require support for higher-order-functions, which needs Saxon-PE or higher. I am using Saxon EE 9.9.1.2 (also tried PE 9.9.1.2) The XSLT works fine if I run it with Saxon directly without using BaseX and the function xslt:transform. Is there something I can do to get this to work, or is this out of my control? Regards /nikos

3 3

Compare List Membership in XQuery
by Chris Yocum 26 Mar '19

26 Mar '19

Hello, I have a question that is more XQuery based than BaseX specifically but I thought I would pose it here to see if any one knows. The basic problem statement is: given a list of tags that have an id attribute and a list of target attributes which should correspond to those ids, are there any target attrbutes which reference ids which do not exist? Basically, I am trying to link up a tag called biblFull or biblStruct which have an id attribute with a tag named title which has a target attribute which should match up with one of the two tags (biblFull or biblStruct) above. I have formulated the query below which I believe *should* give me all the title tags which do not exist either in the biblFull or biblStruct id lists. I am not getting the results that I am expecting. let $biblFull := distinct-values(collection('edil_target/Prologue Merged 2013.xml')//biblFull/@id) let $biblStruct := distinct-values(collection('edil_target/Prologue Merged 2013.xml')//biblStruct/@id) for $title in collection('edil_target/eDIL-A.xml')//entry//title where $title/@target != $biblStruct or $title/@target != $biblFull return $title I am basically getting all the title tags back which is not what I am expecting at all. Can anyone shed any light on this? Thank you very much in advance! All the best, Chris

6 13

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk