BaseX-Talk February 2023

basex-talk@mailman.uni-konstanz.de

12 participants
14 discussions

basexhttp: default to index.html
by Christoph Gaukel 13 Feb '23

13 Feb '23

Hello, i successfully installed basex on my raspberry Pi. Now I want my jetty-server to answer with index.html. Currently it shows the subdirectories in directory .../webapp. cmd: curl https://personal-balance.com returns: <!DOCTYPE html> <html lang="en"> <head> <meta charset="utf-8"> <link href="jetty-dir.css" rel="stylesheet" /> <title>Directory: /</title> </head> <body> <h1 class="title">Directory: /</h1> <table class="listing"> <thead> <tr><th class="name"><a href="?C=N&O=D">Name  ⇧</a></th><th class="lastmodified"><a href="?C=M&O=A">Last Modified</a></th><th class="size"><a href="?C=S&O=A">Size</a></th></tr> </thead> <tbody> <tr><td class="name"><a href="/.logs/">.logs/ </a></td><td class="lastmodified">11.02.2023, 13:32:12 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/chat/">chat/ </a></td><td class="lastmodified">01.12.2022, 11:06:52 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/dba/">dba/ </a></td><td class="lastmodified">01.12.2022, 11:06:52 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/restxq/">restxq/ </a></td><td class="lastmodified">10.02.2023, 12:35:22 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/restxq.xqm">restxq.xqm </a></td><td class="lastmodified">29.07.2022, 13:41:16 </td><td class="size">2.492 bytes </td></tr> <tr><td class="name"><a href="/static/">static/ </a></td><td class="lastmodified">01.12.2022, 11:06:52 </td><td class="size">4.096 bytes </td></tr> <tr><td class="name"><a href="/WEB-INF/">WEB-INF/ </a></td><td class="lastmodified">10.02.2023, 16:19:26 </td><td class="size">4.096 bytes </td></tr> </tbody> </table> </body></html> web.xml and jetty.xml in .../webapp/WEB-INF/ are nearly in their original state. I only modified the location of restxq: <servlet-mapping> <servlet-name>RESTXQ</servlet-name> <url-pattern>*/restxq/**</url-pattern> </servlet-mapping> Kind regards, Christoph

2 1

Too aggressive optimizations?
by Marco Lettere 07 Feb '23

07 Feb '23

Dear all, my scenario is a RestXQ: - download resources and store them in temporary directory. - do it with fork-join in order to obtain smaller latency - compress to zip archive and return the archive data. I've noticed often the archive arrives empty. So after investigation I've found that query [1] isnon predictable. It is often optimized to "count(0)". I can manage to produce results from time to time but not consistently with [2]. [3] Seems the safer solution. The behavior is the same with 9.x and 10. Since I do not feel very comfortable, is there someone who can tell me if I'm doing it wrong or if there is a secure solution or if I should abandon fork-join tout-court? Thanks a lot. Regards, Marco. [1] let $ops := ( for $i in (1 to 5) let $url := "http://www.google.com" return function(){ (file:write(file:create-temp-file("ttt",string($i)),fetch:content-type($url))) } ) let $download := xquery:fork-join($ops) return count($ops) [2] let $ops := ( for $i in (1 to 5) let $url := "http://www.google.com" return function(){ (file:write(file:create-temp-file("ttt",string($i)),fetch:content-type($url)),1) } ) let $download := xquery:fork-join($ops) return count($ops) [3] let $ops := xquery:fork-join( for $i in (1 to 5) let $url := "http://www.google.com" return function(){ (1, file:write(file:create-temp-file("ttt",string($i)),fetch:content-type($url))) } ) return count($ops)

2 2

Reducing logs
by Marco Lettere 03 Feb '23

03 Feb '23

Dear all, when using the Basex Xquery server (9.7.3) we see that logs such as [1] are produced for every query execution. Since we have a scenario which involves polling and thus we have a lot of query executions the log files increase to hundreds om MBs during a day. This makes them unmanageable and even cause dba UI to crash with OOM exceptions when opening the logs page. Is there a way to disable this logging (without affecting other logs such as HTTP)? Is it really necessary to log server side query executions at this grain by default? Maybe it could be made optional? Thanks for any support. Regards, Marco. [1] 12:22:27.849 10.0.4.15:50424 admin OK 0.02 CLOSE[0] 12:22:27.848 10.0.4.15:50434 admin OK 1.40 FULL[0] 12:22:27.848 10.0.4.15:50424 admin OK 0.83 FULL[0] 12:22:27.847 10.0.4.15:50420 admin OK 0.05 CLOSE[0] 12:22:27.847 10.0.4.15:50412 admin OK 0.04 CLOSE[0] 12:22:27.847 10.0.4.15:50434 admin OK 0.05 BIND[0] db=infrastructures as xs:string 12:22:27.846 10.0.4.15:50410 admin OK 0.22 CLOSE[0] 12:22:27.846 10.0.4.15:50434 admin OK 0.06 BIND[0] id=ontheroad-lxd as xs:string 12:22:27.846 10.0.4.15:50424 admin OK 0.05 BIND[0] db=infrastructures as xs:string 12:22:27.846 10.0.4.15:50420 admin OK 0.62 FULL[0] 12:22:27.846 10.0.4.15:50412 admin OK 0.90 FULL[0] 12:22:27.846 10.0.4.15:50424 admin OK 0.06 BIND[0] id=ontheroad-lxd as xs:string 12:22:27.845 10.0.4.15:50380 admin OK 0.02 CLOSE[0] 12:22:27.845 10.0.4.15:50366 admin OK 0.01 CLOSE[0] 12:22:27.845 10.0.4.15:50402 admin OK 0.02 CLOSE[0] 12:22:27.845 10.0.4.15:50420 admin OK 0.04 BIND[0] db=infrastructures as xs:string 12:22:27.845 10.0.4.15:50386 admin OK 0.02 CLOSE[0] 12:22:27.845 10.0.4.15:50410 admin OK 0.88 FULL[0] 12:22:27.845 10.0.4.15:50420 admin OK 0.06 BIND[0] id=ontheroad-lxd as xs:string 12:22:27.845 10.0.4.15:50412 admin OK 0.04 BIND[0] db=infrastructures as xs:string 12:22:27.845 10.0.4.15:50434 admin OK 0.04 QUERY[0] declare variable $id external; declare variable $db external; db:open($db)[json/id = $id]

3 3

Different results when importing HTML documents
by Timothée 02 Feb '23

02 Feb '23

Hello all, I am trying to store HTML documents in BaseX. I setup a local instance of BaseX on my computer using Docker, and I imported this file in it: https://pastebin.com/HJdJgLv9 On my local BaseX instance, the document is imported and "/html/body/article" does return the <article> node as expected. On my remote/production BaseX instance (using the same Dockerfile and image), the document is imported but the <article> tag is "stripped" (even though its contents / child nodes remain in the imported document). "/html/body/article" is empty. If I copy over the .basex files from my local database to my remote database, then the documents are complete like on my local instance. I also tried to import the documents again on my local instance, and the <article> tag gets stripped too (and the child nodes remain). What am I doing wrong when importing my documents? What did I do to import them properly in my current local instance? I tried a lot of options but I just can't figure out why this happens (I fiddled a lot with it). I used the following options when importing my documents, as per the documentation: SET PARSER html SET HTMLPARSER method=xml,nons=true,nocdata=true,nodefaults=true,nobogons=true,nocolons=true,ignorable=true SET CREATEFILTER *.html I also use SET FTINDEX true but I don't think it would have an impact anyway. Thank you very much! - Tim

2 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk February 2023