- BaseX-Talk - mailman.uni-konstanz.de

erreur librairies Saxon 11 avac BaseX 10.4
by Maud Ingarao (IHRIM - ENS de Lyon) 20 Mar '23

20 Mar '23

Bonjour à tous et toutes, En passant de BaseX 10.3 à BaseX 10.4, nous avons l'erreur ci-dessous. Quelque chose ne va pas avec les librairies XSLT Saxon.... Si nous mettons les anciennes librairies Saxon 9 à la place des librairies Saxon 11, l'erreur disparaît. Nous aimerions pouvoir utiliser les librairies les plus récentes. Merci de vos conseils :-) Amitiés, Maud HTTP ERROR 500 javax.xml.transform.TransformerFactoryConfigurationError: Provider net.sf.saxon.TransformerFactoryImpl could not be instantiated: java.lang.reflect.InvocationTargetException URI: /accueil STATUS: 500 MESSAGE: javax.xml.transform.TransformerFactoryConfigurationError: Provider net.sf.saxon.TransformerFactoryImpl could not be instantiated: java.lang.reflect.InvocationTargetException SERVLET: RESTXQ CAUSED BY: javax.xml.transform.TransformerFactoryConfigurationError: Provider net.sf.saxon.TransformerFactoryImpl could not be instantiated: java.lang.reflect.InvocationTargetException CAUSED BY: java.lang.reflect.InvocationTargetException CAUSED BY: java.lang.NoClassDefFoundError: org/xmlresolver/Resolver Caused by: javax.xml.transform.TransformerFactoryConfigurationError: Provider net.sf.saxon.TransformerFactoryImpl could not be instantiated: java.lang.reflect.InvocationTargetException at java.xml/javax.xml.transform.FactoryFinder.newInstance(FactoryFinder.java:181) at java.xml/javax.xml.transform.FactoryFinder.find(FactoryFinder.java:212) at java.xml/javax.xml.transform.TransformerFactory.newInstance(TransformerFactory.java:126) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:70) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:36) at org.basex.query.expr.If.item(If.java:165) at org.basex.query.expr.DualMap.value(DualMap.java:82) at org.basex.query.expr.If.value(If.java:160) at org.basex.query.expr.If.value(If.java:160) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.func.StaticFunc.invokeInternal(StaticFunc.java:162) at org.basex.query.func.XQFunction.invoke(XQFunction.java:33) at org.basex.query.func.FuncCall.value(FuncCall.java:54) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.expr.constr.Constr.add(Constr.java:72) at org.basex.query.up.expr.Replace.item(Replace.java:49) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.expr.If.value(If.java:160) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.ParseExpr.item(ParseExpr.java:56) at org.basex.query.expr.If.item(If.java:165) at org.basex.query.expr.ItemMap.item(ItemMap.java:37) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.List.value(List.java:228) at org.basex.query.up.expr.TransformWith.value(TransformWith.java:74) at org.basex.query.expr.IterMap.value(IterMap.java:106) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.func.StaticFunc.invokeInternal(StaticFunc.java:162) at org.basex.query.func.XQFunction.invoke(XQFunction.java:33) at org.basex.query.func.FuncCall.value(FuncCall.java:54) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:146) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.List.value(List.java:228) at org.basex.query.up.expr.TransformWith.value(TransformWith.java:74) at org.basex.query.expr.IterMap.value(IterMap.java:106) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.func.StaticFunc.invokeInternal(StaticFunc.java:162) at org.basex.query.func.XQFunction.invoke(XQFunction.java:33) at org.basex.query.func.FuncCall.value(FuncCall.java:54) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.Try.value(Try.java:93) at org.basex.query.expr.TypeCheck.value(TypeCheck.java:167) at org.basex.query.func.StaticFunc.invokeInternal(StaticFunc.java:162) at org.basex.query.func.XQFunction.invoke(XQFunction.java:33) at org.basex.query.func.FuncCall.value(FuncCall.java:54) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.scope.MainModule.iter(MainModule.java:48) at org.basex.query.QueryContext.lambda$4(QueryContext.java:354) at org.basex.query.QueryContext.run(QueryContext.java:763) at org.basex.query.QueryContext.iter(QueryContext.java:354) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:78) at org.basex.http.web.WebResponse.create(WebResponse.java:58) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:72) at org.basex.http.BaseXServlet.service(BaseXServlet.java:69) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:409) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Thread.java:829) Caused by: java.lang.reflect.InvocationTargetException at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490) at java.xml/javax.xml.transform.FactoryFinder.newInstance(FactoryFinder.java:169) ... 88 more Caused by: java.lang.NoClassDefFoundError: org/xmlresolver/Resolver at net.sf.saxon.lib.CatalogResourceResolver.<init>(CatalogResourceResolver.java:46) at net.sf.saxon.Configuration.init(Configuration.java:366) at net.sf.saxon.Configuration.<init>(Configuration.java:229) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490) at java.base/java.lang.Class.newInstance(Class.java:584) at net.sf.saxon.Configuration.newConfiguration(Configuration.java:245) at net.sf.saxon.s9api.Processor.<init>(Processor.java:69) at net.sf.saxon.jaxp.SaxonTransformerFactory.<init>(SaxonTransformerFactory.java:59) at net.sf.saxon.TransformerFactoryImpl.<init>(TransformerFactoryImpl.java:42)

2 2

Progress bar (again)
by Zimmel, Daniel 16 Mar '23

16 Mar '23

Hey, I have a task that may take longer to execute (several minutes), so I felt I got to have a fancy progress bar on the command line to entertain me. No progress bar though, found this in the archives: https://mailman.uni-konstanz.de/pipermail/basex-talk/2020-November/015845.h… So this is the closest I got (running BaseX from an Ant task): xquery_update_db: [echo] XQuery Update (Database) wird ausgeführt: xquery/basex.reduce.xquery [apply] EXPORTER: omit-xml-declaration=no [apply] Database 'DEBUGX' was opened in 113.62 ms. [apply] "FORTSCHRITT: 0%" [apply] "FORTSCHRITT: *****5%" [apply] "FORTSCHRITT: **********10%" [apply] "FORTSCHRITT: ***************15%" [apply] "FORTSCHRITT: ********************20%" [apply] "FORTSCHRITT: *************************25%" While I am happy enough with this (it is quite accurate and I like the dramatically mounting effect), can anyone say what might be needed to implement this as a module? Daniel

2 4

"class file versions" discrepancy
by Murray, Gregory 15 Mar '23

15 Mar '23

Hello, I’m new to BaseX. I’m on a Mac with an Apple M1 chip, running macOS 12.6.3. I downloaded the ZIP distribution of BaseX. When I open BaseX.jar I get an error message saying to check the console. When I run basexgui at the command line, I get this error: Exception in thread "main" java.lang.UnsupportedClassVersionError: org/basex/BaseXGUI has been compiled by a more recent version of the Java Runtime (class file version 55.0), this version of the Java Runtime only recognizes class file versions up to 52.0 I updated Java to the latest version, according to the download page at java.com and according to the Update tab in the Java control panel in System Preferences. Running java -version returns this: java version "1.8.0_361" Java(TM) SE Runtime Environment (build 1.8.0_361-b09) Java HotSpot(TM) 64-Bit Server VM (build 25.361-b09, mixed mode) However, I am still getting the same error when running basexgui. Is there a trick or workaround for this? Thanks, Greg

3 5

Formatting attributes as an indented list?
by Patrick Durusau 07 Mar '23

07 Mar '23

Greetings! I've been tasked with using BaseX to produce: ***** <wg class="cl" rule="S-IO" cltype="VerbElided"> <wg rule="NpaNp" role="s"> <wg type="group" appositioncontainer="true" rule="Np-Appos"> <w ref="PHM 1:1!1" after=" " class="noun" gbiType="proper" xml:id="n57001001001" lemma="Παῦλος" normalized="Παῦλος" strong="3972" number="singular" gender="masculine" case="nominative" gloss="Paul" domain="093001" ln="93.294a" morph="N-NSM" unicode="Παῦλος">Παῦλος</w> ***** The indenting is easy enough and I can even make it deeper if required but is there a command for serialization that will properly format the attributes? My personal suspicion is that inserting \n when each attribute is serialized (and not on the last one) is the easier route but I promised to investigate the command line. Have I overlooked something in the very fine manual? Hope everyone is having a great week! Patrick -- Patrick Durusau patrick(a)durusau.net Technical Advisory Board, OASIS (TAB) Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300 Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps) Another Word For It (blog): http://tm.durusau.net Homepage: http://www.durusau.net Twitter: patrickDurusau

4 10

Unable to set admin password
by Marco Lettere 20 Feb '23

20 Feb '23

Dear all, I'm trying to setup a new instance of BaseX 10 in order to start migrating some applications of ours. Anyway I'm unable to set the admin password. Followin https://docs.basex.org/wiki/BaseX_10#Migrating_Applications, I'm currently trying with [1] and [2] which both ask me to enter a new password. But afterwards I keep getting [3].... and I'm unable to access dba too. I cannot understand what I'm doing wrongly ... Any help? Thanks! [1] java -cp BaseX.jar org.basex.BaseX -c PASSWORD Password: newpassword [2] bin/basex -c PASSWORD Password: newpassword [3] bin/basexclient Username: admin Password: newpassword Access denied: admin

1 2

Examples and instructions
by kjkatinas＠gmail.com 19 Feb '23

19 Feb '23

Labas, Christian, Dar neturiu Lietuviska font tai rasisiu Angliskai. What I am looking for is documentation on how to perform simple UNION's and/or JOIN's. I have two DB's with data. DB1 has a small sample data set. DB2 is a master data repository. I need to find DB1 data that does not exist in the master repository. Sound simple enough, but I need examples with the proper syntax. Thanks in advance for your time and help. Linkejimai, KAS Kestutis J Katinas

2 1

reg: Stack Overflow: Try tail recursion?
by chandra sekhar n 17 Feb '23

17 Feb '23

Dear team, While using the below query on collection getting this try tail recursion issue. db:exists("3860_Master_Voice_JULY-21_Unbilled","SSBS_9038343_01131130904_02JUL21.xml") I am attaching a query plan and database info. Regards, Chandrasekhar

2 4

Help Diagnosing Memory Leak in SAXWrapper or Associated Code
by Eliot Kimber 13 Feb '23

13 Feb '23

I’ve worked out how to add a Xerces grammar cache to the XML parser. For current code from GitHub, I did this in SAXParser: public void parse() throws IOException { final InputSource is = inputSource(); final SAXSource saxs = new SAXSource(is); XMLReader reader = null; try { reader = saxs.getXMLReader(); if(reader == null) { reader = XmlParser.reader(options.get(MainOptions.DTD), options.get(MainOptions.XINCLUDE)); } final EntityResolver er = Resolver.entities(options); if(er != null) reader.setEntityResolver(er); saxh = new SAXHandler(builder, options.get(MainOptions.STRIPWS), options.get(MainOptions.STRIPNS)); reader.setDTDHandler(saxh); reader.setContentHandler(saxh); reader.setProperty(http://xml.org/sax/properties/lexical-handler, saxh); reader.setErrorHandler(saxh); if (true && options.get(MainOptions.DTD)) { XMLGrammarPool pool = getGrammarPool(); try { reader.setProperty(FEATURE_GRAMMAR_POOL, pool); } catch (final NoClassDefFoundError e) { } catch (final SAXNotRecognizedException | SAXNotSupportedException e) { } } reader.parse(is); ... Where getGrammarPool() is simply: static private XMLGrammarPool getGrammarPool() { XMLGrammarPool pool = grammarPool; if (pool == null) { pool = new XMLGrammarPoolImpl(); grammarPool = pool; //.set(pool); } return pool; } When I use the grammar cache to parse DITA docs (setting parse DTDs to true and specifying an XML catalog from DITA Open Toolkit) I see the expected speedup. For example, on a small set of about 2400 maps and topics, no-DTD parsing takes 7 seconds, grammar-cache parsing takes 20 seconds, and no-grammar-cache DTD parsing takes about 2.5 minutes. So roughly an 8x improvement (which is what I’ve measured using the same grammar cache with Saxon, for example). However, using the grammar cache causes some kind of extreme memory leak and I have no idea what it is. Without the grammar cache, parsing these topics requires only a few 100 metabytes of memory DTD or no, but with the grammar cache, memory usage starts at about 1GB and goes up from there. Parsing my full set of 40K maps and topics, memory grows by 1GB every 30 seconds or so until it eventually exceeds even the 14GB I allocated in my last test. The 1GB could be explained by the cache itself, which holds the parsed grammars. Using the debugger, I can see that the grammar cache itself is static once it’s populated with grammars (for my set it ends up loading 10 parsed grammars), so the grammar cache itself doesn’t seem to be the problem. I’m trying to use VisualVM to profile the memory but this is not something I have done before and I’m not sure what classes I should be focusing on. So my questions: 1. Any idea why the simple addition of the grammar cache would cause this kind of memory leak? 2. Any guidance on what classes I should focus on to find the culprit? My reason for using the grammar cache is to have all the default attributes populated in the database without requiring two hours to load my content (which is what I’ve measured in the past for DTD-aware parsing of my 40K content set). Another solution, specific to DITA, would be to use a custom SAX parser that injects the default attributes based on static configuration (for a given set of DITA grammars we know what the defaults will be for every element type and can easily generate the configuration a SAX parser would use). But the current code doesn’t seem to provide an easy way to swap in a custom SAX handler and I’m not really in a position to try to add that level of sophistication to the code. Modulo this memory issue, the grammar cache is a nice simple solution to the DTD parsing requirement that is general to any content set that has consistent DTD or XSDs across the set of documents to be parsed. Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 2

XQuery Prolog with serialization settings - basex "Unknown option 'basex'?
by Patrick Durusau 13 Feb '23

13 Feb '23

Greetings! I have the following in the prolog of an XQuery: declare namespace output = 'http://www.w3.org/2010/xslt-xquery-serialization'; declare option output:method 'basex'; declare option output:basex 'indent=yes, newline=\n'; I'm following the example at: https://docs.basex.org/wiki/Serialization for CSV, reasoning the same form should work for basex. Sadly, BaseX 10.4 on Debian reports: [XQST0109] Unknown option 'basex Is it because basex isn't in the namespace of 'http://www.w3.org/2010/xslt-xquery-serialization'; ? OK so I change the namespace to http://tm.durusau.net and it runs! Sadly not applying the requested formatting. Some guidance on serialization please? Thanks! Patrick -- Patrick Durusau patrick(a)durusau.net Technical Advisory Board, OASIS (TAB) Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300 Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps) Another Word For It (blog): http://tm.durusau.net Homepage: http://www.durusau.net Twitter: patrickDurusau

2 2

basexhttp: default to index.html
by Christoph Gaukel 13 Feb '23

13 Feb '23

Hello, i successfully installed basex on my raspberry Pi. Now I want my jetty-server to answer with index.html. Currently it shows the subdirectories in directory .../webapp. cmd: curl https://personal-balance.com returns: <!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <link href="jetty-dir.css" rel="stylesheet" /> <title>Directory: /</title> </head> <body> <h1 class="title">Directory: /</h1> <table class="listing"> <thead> <tr><th class="name"><a href="?C=N&O=D">Name  ⇧</a></th><th class="lastmodified"><a href="?C=M&O=A">Last Modified</a></th><th class="size"><a href="?C=S&O=A">Size</a></th></tr> </thead> <tbody> <tr><td class="name"><a href="/.logs/">.logs/ </a></td><td class="lastmodified">11.02.2023, 13:32:12 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/chat/">chat/ </a></td><td class="lastmodified">01.12.2022, 11:06:52 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/dba/">dba/ </a></td><td class="lastmodified">01.12.2022, 11:06:52 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/restxq/">restxq/ </a></td><td class="lastmodified">10.02.2023, 12:35:22 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/restxq.xqm">restxq.xqm </a></td><td class="lastmodified">29.07.2022, 13:41:16 </td><td class="size">2.492 bytes </td></tr> <tr><td class="name"><a href="/static/">static/ </a></td><td class="lastmodified">01.12.2022, 11:06:52 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/WEB-INF/">WEB-INF/ </a></td><td class="lastmodified">10.02.2023, 16:19:26 </td><td class="size">4.096 bytes </td></tr> </tbody> </table> </body></html> web.xml and jetty.xml in .../webapp/WEB-INF/ are nearly in their original state. I only modified the location of restxq: <servlet-mapping> <servlet-name>RESTXQ</servlet-name> <url-pattern>*/restxq/**</url-pattern> </servlet-mapping> Kind regards, Christoph

2 1

Too aggressive optimizations?
by Marco Lettere 07 Feb '23

07 Feb '23

Dear all, my scenario is a RestXQ: - download resources and store them in temporary directory. - do it with fork-join in order to obtain smaller latency - compress to zip archive and return the archive data. I've noticed often the archive arrives empty. So after investigation I've found that query [1] isnon predictable. It is often optimized to "count(0)". I can manage to produce results from time to time but not consistently with [2]. [3] Seems the safer solution. The behavior is the same with 9.x and 10. Since I do not feel very comfortable, is there someone who can tell me if I'm doing it wrong or if there is a secure solution or if I should abandon fork-join tout-court? Thanks a lot. Regards, Marco. [1] let $ops := ( for $i in (1 to 5) let $url := "http://www.google.com" return function(){ (file:write(file:create-temp-file("ttt",string($i)),fetch:content-type($url))) } ) let $download := xquery:fork-join($ops) return count($ops) [2] let $ops := ( for $i in (1 to 5) let $url := "http://www.google.com" return function(){ (file:write(file:create-temp-file("ttt",string($i)),fetch:content-type($url)),1) } ) let $download := xquery:fork-join($ops) return count($ops) [3] let $ops := xquery:fork-join( for $i in (1 to 5) let $url := "http://www.google.com" return function(){ (1, file:write(file:create-temp-file("ttt",string($i)),fetch:content-type($url))) } ) return count($ops)

2 2

Reducing logs
by Marco Lettere 03 Feb '23

03 Feb '23

Dear all, when using the Basex Xquery server (9.7.3) we see that logs such as [1] are produced for every query execution. Since we have a scenario which involves polling and thus we have a lot of query executions the log files increase to hundreds om MBs during a day. This makes them unmanageable and even cause dba UI to crash with OOM exceptions when opening the logs page. Is there a way to disable this logging (without affecting other logs such as HTTP)? Is it really necessary to log server side query executions at this grain by default? Maybe it could be made optional? Thanks for any support. Regards, Marco. [1] 12:22:27.849 10.0.4.15:50424 admin OK 0.02 CLOSE[0] 12:22:27.848 10.0.4.15:50434 admin OK 1.40 FULL[0] 12:22:27.848 10.0.4.15:50424 admin OK 0.83 FULL[0] 12:22:27.847 10.0.4.15:50420 admin OK 0.05 CLOSE[0] 12:22:27.847 10.0.4.15:50412 admin OK 0.04 CLOSE[0] 12:22:27.847 10.0.4.15:50434 admin OK 0.05 BIND[0] db=infrastructures as xs:string 12:22:27.846 10.0.4.15:50410 admin OK 0.22 CLOSE[0] 12:22:27.846 10.0.4.15:50434 admin OK 0.06 BIND[0] id=ontheroad-lxd as xs:string 12:22:27.846 10.0.4.15:50424 admin OK 0.05 BIND[0] db=infrastructures as xs:string 12:22:27.846 10.0.4.15:50420 admin OK 0.62 FULL[0] 12:22:27.846 10.0.4.15:50412 admin OK 0.90 FULL[0] 12:22:27.846 10.0.4.15:50424 admin OK 0.06 BIND[0] id=ontheroad-lxd as xs:string 12:22:27.845 10.0.4.15:50380 admin OK 0.02 CLOSE[0] 12:22:27.845 10.0.4.15:50366 admin OK 0.01 CLOSE[0] 12:22:27.845 10.0.4.15:50402 admin OK 0.02 CLOSE[0] 12:22:27.845 10.0.4.15:50420 admin OK 0.04 BIND[0] db=infrastructures as xs:string 12:22:27.845 10.0.4.15:50386 admin OK 0.02 CLOSE[0] 12:22:27.845 10.0.4.15:50410 admin OK 0.88 FULL[0] 12:22:27.845 10.0.4.15:50420 admin OK 0.06 BIND[0] id=ontheroad-lxd as xs:string 12:22:27.845 10.0.4.15:50412 admin OK 0.04 BIND[0] db=infrastructures as xs:string 12:22:27.845 10.0.4.15:50434 admin OK 0.04 QUERY[0] declare variable $id external; declare variable $db external; db:open($db)[json/id = $id]

3 3

Different results when importing HTML documents
by Timothée 02 Feb '23

02 Feb '23

Hello all, I am trying to store HTML documents in BaseX. I setup a local instance of BaseX on my computer using Docker, and I imported this file in it: https://pastebin.com/HJdJgLv9 On my local BaseX instance, the document is imported and "/html/body/article" does return the <article> node as expected. On my remote/production BaseX instance (using the same Dockerfile and image), the document is imported but the <article> tag is "stripped" (even though its contents / child nodes remain in the imported document). "/html/body/article" is empty. If I copy over the .basex files from my local database to my remote database, then the documents are complete like on my local instance. I also tried to import the documents again on my local instance, and the <article> tag gets stripped too (and the child nodes remain). What am I doing wrong when importing my documents? What did I do to import them properly in my current local instance? I tried a lot of options but I just can't figure out why this happens (I fiddled a lot with it). I used the following options when importing my documents, as per the documentation: SET PARSER html SET HTMLPARSER method=xml,nons=true,nocdata=true,nodefaults=true,nobogons=true,nocolons=true,ignorable=true SET CREATEFILTER *.html I also use SET FTINDEX true but I don't think it would have an impact anyway. Thank you very much! - Tim

2 3

bug in BaseX104 with function arity determination
by Rob Stapper 31 Jan '23

31 Jan '23

Hi Christian, See attachment. When running, function ‘local:test1a’ triggers an error: ‘[XPTY0004] 2 arguments supplied, 3 expected: $f’. It looks like the arity of a function is incorrectly determined when called with a partial parameter set. ‘function ‘local:test1b’ is a workaround. Can you please have a look at this? Thanx in advance, Rob Stapper Sent from Mail for Windows -- This email has been checked for viruses by Avast antivirus software. www.avast.com

2 3

BaseX bug report
by Veysel Karslı 23 Jan '23

23 Jan '23

Hello, We got an error about BaseX. We connect BaseX Java Server from our application developed with C#. Thank you for your support. Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 10.3 Java: Oracle Corporation, 19.0.1 OS: Windows Server 2019, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: Index 4304 out of bounds for length 4096 at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:160) at org.basex.data.Data.kind(Data.java:312) at org.basex.query.up.atomic.AtomicUpdateCache.adjustDistances(AtomicUpdateCache.java:320) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:276) at org.basex.query.up.DataUpdates.apply(DataUpdates.java:167) at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) at org.basex.query.up.Updates.apply(Updates.java:179) at org.basex.query.QueryContext.update(QueryContext.java:660) at org.basex.query.QueryContext.lambda$4(QueryContext.java:354) at org.basex.query.QueryContext.run(QueryContext.java:763) at org.basex.query.QueryContext.iter(QueryContext.java:354) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:95) at org.basex.server.ServerQuery.execute(ServerQuery.java:125) at org.basex.server.ClientListener.query(ClientListener.java:397) at org.basex.server.ClientListener.run(ClientListener.java:104) -- Veysel Karslı Managing Partner & Co-founder M +90 543 238 8328 E veysel.karsli(a)codease.io CodEase Teknoloji Barbaros mh. Begonya sk. No:1/2 Ataşehir / İstanbul www.codease.io

2 2

Symlinks bug in webapp
by Jerome Chauveau 23 Jan '23

23 Jan '23

Hello, Symlinks seem to be not fonctional anymore since BaseX10 (Maybe before) in webapps. Is it due to a new version of Jetty ? I pushed a dummy example on that repository : [ https://git.unicaen.fr/chauveau/test-basex-symlinks | https://git.unicaen.fr/chauveau/test-basex-symlinks ] Thanks for your help ! Jérôme

2 4

Integrating BaseX With Server-Side Python
by Eliot Kimber 23 Jan '23

23 Jan '23

I’ve started implementing some sophisticated DITA data processing in Python, including using the Python xlsxwriter to easily generate Excel spreadsheets, something that would be more work to add to BaseX using Java and the Apache POI libraries. I’m also seeing that the Python streamlit tool, which provides sophisticated web pages for visualizing Python-based data (i.e., graphing from Pandas dataframes) would be a convenient way to generate graphs. I’m wondering: 1. Has anyone integrated streamlit with BaseX, for example, by running a streamlit server and using iframes from BaseX-served web pages to deliver graphs and whatnot. If so, are there any particular concerns or is it as simple running the server and creating the iframe? 2. What would be the best way to run or access Python scripts from BaseX server, for example, to run a script that will generate an Excel sheet from some data on the server (or provided by BaseX in some convenient form) and then serve the generated result back out? I think it should be as easy as using the process module to run Python commands from the command line, but again, wondering if there are any non-obvious considerations? Part of my new focus on Python is that my colleagues are Python-literate but not XQuery or XSLT literate, so it turns out to be best for us to do as much in Python as possible. But also the cost of doing really cool things in Python is just really low, streamlit being a good example. Thanks, E. _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 1

Socket specifications?
by Ben Engbers 21 Jan '23

21 Jan '23

Hi, When I developed the Basex client for R, I ran into problems with the socket for a long time. In the end it turned out that in R I had to configure the socket as a non-blocking socket. This solved all performance issues! I am now trying to develop a client for SWI-prolog. Because that low-level compiler doesn't support using sockets enough, I need to develop a library in C++ first. And in doing so, I again run into problems with the socket. The basex documentation just says to use a socket. But there is no information on how to configure the socket itself. My question is how do I configure the client side of the socket for optimal use? Ben Engbers

3 2

Minor issue: format-date?
by Alexander Witzigmann 20 Jan '23

20 Jan '23

Hi, The format-date has one minor issue using format-date(xs:date("2022-01-01"),"[D]. [Mn] [Y]","de",(),()) should return 1. Januar 2022 but currently (BaseX 10.4) returns 1. januar 2022 alex

2 2

RESTXQ advice?
by Hans-Jürgen Rennau 19 Jan '23

19 Jan '23

Hello, I encounter a problem with a RESTXQ application, perhaps someone can help me? *Goal:* Download a file with an encoding dependent on a user entry. The request contains *form parameters*. *Attempt:* I can control the encoding using the %output annotation. However, this annotation must be a literal string, I think. Therefore I tried *web:forward*, as well as *web:redirect*, thus triggering the execution of a function with the desired %output declaration. *Issue:* the form parameters get lost. How to achieve the goal? Thank you for your advice. With kind regards, Hans-Jürgen declare %output:method("text") %output:encoding("utf-8") %rest:path("*/util/download/text*") %rest:form-param("text", "{$text}", "") %rest:form-param("file-name", "{$fileName}", "text.txt") %rest:form-param("encoding", "{$encoding}", "utf-8") function *f:downloadText*( $text as xs:string, $fileName as xs:string, $encoding as xs:string) { if ($encoding eq 'cp1252') then *web:forward*(' */util/download/text-cp1252*') else ... declare %output:method("text") %output:encoding("cp1252") %rest:path("*/util/download/text-cp1252*") %rest:form-param("text", "{$text}", "") %rest:form-param("file-name", "{$fileName}", "text.txt") function *f:downloadTextCp1252*( $text as xs:string, $fileName as xs:string) { let $text := replace($text, '
', '
') return ( <rest:response> <http:response status="200"> <http:header name="Content-Disposition" value='attachment; filename="{$fileName}"'/> <http:header name="Content-Language" value="en"/> <http:header name="Content-Type" value="text/csv; charset=cp1252"/> </http:response> </rest:response>, $text ) }; PS: The <http:header> seems to be without effect - experiments seemd to show that I have to use the %output declaration.

4 4

Suggestion: db:delete-value(), db:delete-binary()
by Hans-Jürgen Rennau 12 Jan '23

12 Jan '23

Hello, I wonder if it wouldn't be worthwhile to complement the functions *db:put-value()* and *db:get-value()* by a third function *db:delete-value()?* And, similarly, to add a function *delete-binary()*. Kind regards, Hans-Jürgen

3 2

put-value() bug (?)
by Hans-Jürgen Rennau 12 Jan '23

12 Jan '23

Hello, after the following call basex "db:put-value('foofoo', doc('yogi.html')//@href/string(), 'hrefs')" I expect the resource "hrefs" to contain strings - but db:get-value('foofoo', 'hrefs') returns a sequence of attributes. Kind regards, Hans-Jürgen

2 1

REST documentation - bug?
by Hans-Jürgen Rennau 11 Jan '23

11 Jan '23

Hello, the documentation ( https://docs.basex.org/wiki/REST ) contains an example applying a query via REST to a complete database: http://localhost:8080/rest/database?query=count(.) (My understanding is that "database" should be replaced with the name of a database.) However, the URL yields an error ("Document is empty"). At any rate, the documentation should be explicit about the evaluation context of REST calls with parameter "query" or "run". If the resource identified by the URL is a single document, the context item is fairly obvious. However, in case of a database or a database collection, the evaluation context is not obvious. With kind regards Hans-Jürgen

2 2

Re: [basex-talk] Select proper database for Plot Widget
by Christian Grün 11 Jan '23

11 Jan '23

Hi Ben, Your query seems to be based on a different input ("GRCMAPLE-1" is not included in the example XML document), and… > CREATE DB bullion-2 /home/bpracht/java/basex-10.4/ …by running this command, you are creating a database with all XML documents found in the given filesystem path (that’s why your database is not empty). The attached query might give you a clue on how data can be prepared to get price/timestamp data displayed in the Plot visualization. After having run the query, you need to open the generated "test" database and enable the Plot visualization. Best, Christian On Tue, Jan 10, 2023 at 5:16 PM Ben Pracht <ben.pracht.news(a)gmail.com> wrote: > > I think any non-stock database would work to show this, but below is the > code I was using. This is the part of the dialog I'd like to get working: > > https://i.imgur.com/ocGXjlP.png > > I apologize for the bad markering, but it shows the drop downs that > refer only to items in some other un-selected database. > > To recreate: > > 1. Please create a database. I kept most of the defaults: > > CREATE DB bullion-2 /home/bpracht/java/basex-10.4/ > > 2. Add a document: > > let $item := <item> > <vendor>sdbullion</vendor> > <img-url>https://sdbullion.com/media/catalog/product/cache/092a78d23e77560f092c3f80d…</img-url> > <detail-url>https://sdbullion.com/2022-1-oz-canadian-gold-maple-leaf-coin</detail-url> > <detail-title>2022 1 oz Gold Maple Leaf Coin BU</detail-title> > <schedule skus="GRC22MAPLE-1" timestamp="1672932572402"> > <tier quantity="1 - 9" cash-price="1930.26" cc-price="2010.69" > paypal-price="2010.69"/> > <tier quantity="10 - 19" cash-price="1925.26" cc-price="2005.48" > paypal-price="2005.48"/> > <tier quantity="20 - 99" cash-price="1920.26" cc-price="2000.27" > paypal-price="2000.27"/> > <tier quantity="100+" cash-price="1915.26" cc-price="1995.06" > paypal-price="1995.06"/> > </schedule> > </item> > let $add := db:add('bullion-2',$item,"test-item") > return $item > > 3. Test code: > > declare function > local:get-price-for-quantity($schedule,$price-type,$quantity as > xs:integer) { > let $matching-tier := for $tier in $schedule/tier > let $range := $tier/@quantity/data() > let $minimum := number(if > (contains($range,'-')) then > substring-before($range,'-') > else > substring-before($range,'+')) > let $maximum:= number(if > (contains($range,'-')) then > substring-after($range,'-') > else > xs:double("INF")) > return if ($quantity >= $minimum and > $quantity <= $maximum) then > $tier > else > () > > return $matching-tier/(a)*[local-name(.) = $price-type]/data() > }; > > for $schedule in collection("bullion")/item/schedule > let $timestamp := $schedule/@timestamp/data() > let $price-type := "cash-price" > let $price := local:get-price-for-quantity($schedule,"cash-price",1) > order by $timestamp ascending > return if ($schedule/@skus/data() = 'GRCMAPLE-1') then > ($timestamp,$price) > else > () > > The test code above should show the timestamp and price of the item. I > was going to put the timestamp as the X and the price as the Y, but I > can't figure out how. > > > Bonus concern: For some reason, it didn't create an empty database, but > rather had these other documents too: > > repo/http-www.functx.com-1.0/cxan.xml > repo/http-www.functx.com-1.0/expath-pkg.xml > webapp/WEB-INF/jetty.xml > webapp/WEB-INF/web.xml > etc/factbook.xml > etc/w3-catalog.xml > > > Thanks for your help, > > Ben

2 2

REST documentation - bug?
by Hans-Juergen Rennau 11 Jan '23

11 Jan '23

Hello, the documentation ( https://docs.basex.org/wiki/REST ) contains an example applying a query via REST to a complete database: http://localhost:8080/rest/database?query=count(.) (My understanding is that "database" should be replaced with the name of a database.) However, the URL yields an error ("Document is empty"). At any rate, the documentation should be explicit about the evaluation context of REST calls with parameter "query" or "run". If the resource identified by the URL is a single document, the context item is fairly obvious. However, in case of a database or a database collection, the evaluation context is not obvious. With kind regards Hans-Jürgen

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk