BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5245 discussions

Query profiling and debugging support in BaseX
by Reece Dunn 22 Apr '19

22 Apr '19

Hi, I'm wondering how you would go about profiling a query in BaseX to determine how long various query statements take, so you can look at the places where you need to modify the query to be faster. I have added MarkLogic's profiling support into my XQuery plugin that does this and am wondering how this can be done in BaseX. I'm aware of the prof functions, but these are more useful for manually instrumenting sections of a query, and not an automated way of getting the timing information for all the queries and parts of the query. Specifically for integrating into an IDE. I could display the timings, like in the BaseX GUI. Is there a way to get this information using the org.basex.api.client interfaces? Is there a way to get the query plan, pre-evaluation mapping, and optimized query for the given query? It would be helpful to link these back to the source file, so things like optimisation hints can link back to the file being edited. Finally, I am looking into debugging support and am wondering if this is possible to do for BaseX queries. What approach would be best for this, especially in terms of integrating it into an IDE? Kind regards, Reece

2 8

RESTXQ, multipart/form-data, out of memory saving to file
by James Ball 21 Apr '19

21 Apr '19

Hello everyone, I’m trying to use BaseX RESTXQ to upload some large (around 300MB) Zip files using HTML forms (multipart/form-data), save them to disk and then process them. But I am getting server errors with large files (small files work perfectly). HTTP ERROR 500 Problem accessing /test.htm. Reason: Server Error Caused by: java.lang.OutOfMemoryError: Java heap space Powered by Jetty:// 9.4.9.v20180320 <http://eclipse.org/jetty> It seems to be when reading the file from the map of files. 1) Upload large file but do nothing with it - WORKS 2) Upload large file and just write the whole POST data to file - WORKS 3) Upload large file and write file from map - ERROR This is the file writing function I’m using: file:write-binary( "/Users/me/Desktop/delete2.zip”, $files(map:keys($files)[1]) ) Running BaseX 9.1 Is there something really obvious that I’m doing wrong? (There usually is :) ) Many thanks, James

3 6

map:merge() does not handle wrong $option parameter
by Andreas Mixich 21 Apr '19

21 Apr '19

Given: let $d1 := map {"key1":"value1"} let $d2 := map {"key2":"value2"} return map:merge($d1, $d2) where the two maps to be merged should have been included as sequence, but were, mistakenly, not, the function should return an error, since the second map gets evaluated as $options, but none of the $options are to be found inside. It seems, that only a type-check is done, to assure valid $options, since, in another case, I got a [XPTY0004]. -- Minden jót, all the best, Alles Gute, Andreas Mixich

2 1

Can't locate reason for a [XQST0049] Duplicate declaration of static variable
by Andreas Mixich 20 Apr '19

20 Apr '19

Hi, I get a `[XQST0049] Duplicate declaration of static variable $string:debug` and can't find out why. I checked the sources and the variable is declared only once. This happens in a scenario, where I have a co-dependency on several modules and each load the modules they need, some load the same modules as another module. I thought about a circular dependency, but I do not find it. Could it be made so, that upon such an error, the places, in which the 'other' declaration was found get referenced as well in the error message? That would be very practical (I also had problems like this with function declarations, in the past, some are still unresolved). Thanks, and congrats to the 9.2 update. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 2

java.lang.NullPointerException at org.basex.query.expr.TypeswitchGroup.equals(TypeswitchGroup.java:173)
by Andreas Mixich 19 Apr '19

19 Apr '19

Hello, I don't really understand what just happened, so I attached the testcase and stacktrace to circumvent any malformation by the mail software in use. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 3

my first baseX db
by Robert Kirkpatrick 18 Apr '19

18 Apr '19

Hello, Novice, newbie request: GUI snapshot: Command: CREATE DB science C:/Users/rober/Google Drive/science/ Error: "Configurations2/accelerator/current.xml" (Line 1): Premature end of file. TIA, Robert.

2 2

BaseX/GUI v9.1.2 memory use
by Rick Graham 18 Apr '19

18 Apr '19

Hello, Thanks again, as always, for a great product. I just installed BaseX v9.1.2 (upgrading from a previous v9.1.2 snapshot), launched the GUI and then got interrupted. When I returned, almost all of the JVM's memory was being used. I hit "GC" several times but it didn't seem to help. I had no database loaded/open. Seems like some memory isn't getting freed properly. Here's my "INFO" General Information: > Version: 9.1.2 > Used Memory: 1593 MB > Global options: > AUTHMETHOD: Basic > CACHETIMEOUT: 3600 > DBPATH: /usr/local/src/basex/data > DEBUG: false > FAIRLOCK: false > HOST: localhost > HTTPLOCAL: false > IGNORECERT: false > IGNOREHOSTNAME: false > KEEPALIVE: 600 > LANG: English > LANGKEYS: false > LOG: true > LOGMSGMAXLEN: 1000 > LOGPATH: .logs > NONPROXYHOSTS: > PARALLEL: 8 > PARSERESTXQ: 3 > PASSWORD: > PORT: 1984 > PROXYHOST: > PROXYPORT: 0 > REPOPATH: /usr/local/src/basex/repo > RESTPATH: > RESTXQPATH: > SERVERHOST: > SERVERPORT: 1984 > STOPPORT: 8985 > TIMEOUT: 30 > USER: > WEBPATH: /usr/local/src/basex/webapp > Local options > ADDARCHIVES: true > ADDCACHE: false > ADDRAW: false > ARCHIVENAME: false > ATTRINCLUDE: > ATTRINDEX: true > AUTOFLUSH: true > AUTOOPTIMIZE: false > BINDINGS: > CASESENS: false > CATFILE: > CHECKSTRINGS: true > CHOP: true > COMPPLAN: true > COPYNODE: true > CREATEFILTER: *.xml > CREATEONLY: false > CSVPARSER: > DEFAULTDB: false > DIACRITICS: false > DOTCOMPACT: false > DOTPLAN: false > DTD: false > ENFORCEINDEX: false > EXPORTER: > FORCECREATE: false > FTINCLUDE: > FTINDEX: false > HTMLPARSER: > INLINELIMIT: 100 > INTPARSE: false > JSONPARSER: > LANGUAGE: en > LSERROR: 0 > MAINMEM: false > MAXCATS: 100 > MAXLEN: 96 > MAXSTAT: 30 > MIXUPDATES: false > PARSER: xml > QUERYINFO: true > RUNQUERY: true > RUNS: 1 > SERIALIZE: true > SERIALIZER: > SKIPCORRUPT: false > SPLITSIZE: 0 > STEMMING: false > STOPWORDS: > STRIPNS: false > TAILCALLS: 256 > TEXTINCLUDE: > TEXTINDEX: true > TEXTPARSER: > TOKENINCLUDE: > TOKENINDEX: false > UPDINDEX: false > WRITEBACK: false > XINCLUDE: true > XMLPLAN: true Best regards, Richard

6 15

name condition in predicates
by Alexander Witzigmann 18 Apr '19

18 Apr '19

the following query > for $hit in //*[./name() ="p"] > > return > <out >{$hit}</out> leads to > Improper use? Potential bug? Your feedback is welcome: > Contact: basex-talk(a)mailman.uni-konstanz.de > Version: BaseX 9.2 > Java: Oracle Corporation, 10 > OS: Windows 7, amd64 > Stack Trace: > java.lang.NullPointerException > at org.basex.query.expr.SimpleMap.get(SimpleMap.java:43) > at org.basex.query.expr.path.Path.optimize(Path.java:202) > at org.basex.query.expr.path.Path.compile(Path.java:153) > at org.basex.query.expr.Arr.compile(Arr.java:42) > at org.basex.query.expr.Preds.compile(Preds.java:46) > at org.basex.query.expr.path.Step.compile(Step.java:95) > at org.basex.query.expr.path.Path.compile(Path.java:142) > at org.basex.query.expr.gflwor.ForLet.compile(ForLet.java:43) > at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:88) > at org.basex.query.scope.MainModule.comp(MainModule.java:81) > at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) > at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) > at org.basex.query.QueryContext.compile(QueryContext.java:312) > at org.basex.query.QueryProcessor.compile(QueryProcessor.java:79) > at org.basex.core.cmd.AQuery.query(AQuery.java:93) > at org.basex.core.cmd.XQuery.run(XQuery.java:22) > at org.basex.core.Command.run(Command.java:257) > at org.basex.core.Command.execute(Command.java:93) > at org.basex.gui.GUI.exec(GUI.java:422) > at org.basex.gui.GUI.lambda$execute$4(GUI.java:365) > at java.base/java.lang.Thread.run(Unknown Source) > Compiling: > - pre-evaluate root to document-node() sequence: root() -> > (db:open-pre("publication-toc", 0), ...) > Optimized Query: > for $hit_0 in (db:open-pre("publication-toc", 0), > ...)/descendant-or-self::node()/*[(name() = "p")] return element out { > ($hit_0) } > Query: > for $hit in //*[./name() ="p"] return <out >{$hit}</out> might be some side effect from latest improvements? Alex

2 1

FTP client module
by Fabrice ETANCHAUD 17 Apr '19

17 Apr '19

Hi all ! I am happy to get back to basics, after a lot of SQL ;-) On november 2017, Christian proposed to broadcast a FTP client module to the list, I must have missed the link, I cannot find the module. Is it still possible to get it ? Thank you, Best regards, Fabrice

3 2

BaseX 9.2: The Spring Edition
by Christian Grün 17 Apr '19

17 Apr '19

Dear all, We are more than pleased to announce version 9.2 of BaseX, our XML framework, database system and XQuery 3.1 processor: http://basex.org/ This time, we have put a special focus on performance improvements: XQUERY PERFORMANCE - comparisons will more often be rewritten to hash joins - optimized access to subsequences and single sequence items - consistent propagation of static types to evaluation results - improved static typing of function items (maps, arrays) - more aggressive pre-evaluation at compile time STORAGE PERFORMANCE - large databases will be opened faster - regular storage offset will be computed at runtime GENERAL XQUERY FEATURES - no need to import basex-api modules anymore! - Archive Module: archive:create-from, new options - Database Module: directory-based access via db:dir - Profiling Module: new functions (prof:gc, prof:runtime) - Validation Module: assign XSD validation features - WebSocket Module: query scheduling via ws:eval - Utility Module: various new helper functions - XSLT Module: support for XML Catalogs (thank you Liam) NEW OPTIONS - RESTXQERRORS: Suppress parsing errors at runtime - FULLPLAN: comprehensive query plan information FULLTEXT FEATURES - stemmer for Arabic texts added USER INTERFACES - GUI: better support for latest JDK versions (incl. OpenJDK) - DBA: revised search features in log panel For a more comprehensive list of added and updated features. please check out our documentation: http://docs.basex.org/. We are looking forward to your feedback. Have fun with the new release, Your BaseX Team

5 5

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk