BaseX-Talk

basex-talk@mailman.uni-konstanz.de

4 participants
5268 discussions

Securing All Endpoints
by Adam Law 18 Jan '21

18 Jan '21

Golang has great middleware functionality for endpoints that allows a person to readily secure all of them. I was wondering there would be anyway doing similar in BaseX for restxq & websockets. For example by requiring all requests to have a particular query parameter (very basic example). ... to protect say against browser / javascript port scanning. Eg https://stackoverflow.com/questions/26204485/gorilla-mux-custom-middleware and check that request contains a particular parameter (very basic security) It seems that I have to secure each endpoint individually. Adam

2 6

error "lock file does not exist" after "add" command
by Thomas Spitaler 13 Jan '21

13 Jan '21

Hi, in one of our projects we are using BaseX. So far we are very happy with our choice, but recently we got an error that we could not fix. The only solution that worked was to create a new, empty database. When trying to add a document to the database, we get an exception and a message „lock file does not exist“: $ open cap10_cap_store_prod Database 'cap10_cap_store_prod' was opened in 219.99 ms. $ add /home/thomas/tmp/test.xml Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.0.1 Java: Debian, 11.0.9 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: cap10_cap_store_prod: lock file does not exist. at org.basex.util.Util.notExpected(Util.java:61) at org.basex.data.DiskData.finishUpdate(DiskData.java:246) at org.basex.core.cmd.ACreate.update(ACreate.java:97) at org.basex.core.cmd.Add.run(Add.java:56) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.api.client.LocalSession.execute(LocalSession.java:132) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:92) at org.basex.core.CLI.execute(CLI.java:76) at org.basex.BaseX.console(BaseX.java:196) at org.basex.BaseX.<init>(BaseX.java:171) at org.basex.BaseX.main(BaseX.java:42) Which lock file is the error referring to? Can we create it manually to make it work again? The error only happens in the database that we have been using so far (cap10_cap_store_prod). After creating and using a new one (cap10_cap_store_prod2) the problem does not occur. Here is the output of running list on the database: $ list Name Resources Size Input Path cap10_cap_store_prod 233387 1583797639 cap10_cap_store_prod2 241 1912414 testdb 1 4611 3 database(s). Did we hit a size limit of BaseX? I checked the server and it has enough free disk space and free inodes available. Some more background info: The system runs on a cluster of servers. BaseX runs on one of them, bound to port 1984. The other nodes in the cluster connect to the BaseX-Server via the network. In my understanding, this type of concurrency is supported by BaseX. The software on the nodes is implemented in Elixir. We wrote our own Elixir client library that is a thin wrapper around https://github.com/zadean/basexerl, an existing open source Erlang client library for BaseX. Our Elixir client library keeps open a pool of connections to the BaseX server. So far and until we encountered the above error everything worked perfectly. Also, after creating a new database everything works fine again. This error also occurs after shutting down all the nodes that connect to our BaseX instance. We checked using the lsof command and there are no connections open to the database other then the client we use to reproduce the error. Any help would be greatly appreciated! Kind regards, Thomas Kind regards, Thomas

2 4

file:read-text
by Giuseppe G. A. Celano 12 Jan '21

12 Jan '21

Hi, I am trying to open a bunch of files with file:read-text, but I get the error [file:io-error] invalid XML character: #0, even I am not dealing with XML. Any idea why this happens? Thanks! Best, Giuseppe

2 3

Brew upgrade for 9.4.6 fails with SHA256 mismatch
by Johan Mörén 08 Jan '21

08 Jan '21

Just wanted to let you know that the latest BaseX version can't be installed or upgraded via homebrew. I get the following error message: brew upgrade basex ==> Upgrading 1 outdated package: basex 9.4.5 -> 9.4.6 ==> Upgrading basex 9.4.5 -> 9.4.6 ==> Downloading https://files.basex.org/releases/9.4.6/BaseX946.zip ######################################################################## 100.0% Error: SHA256 mismatch Expected: c6dd9ac56e72de19c88152c76a6e4052deccd4f0db7a4b072aaaa560b92318a5 Actual: 96012025d749062540f9b16f830d7b99876696b66534da2fe27c833d1b1fc43b File: /Users/johmor/Library/Caches/Homebrew/downloads/befef7ec63e74dbf695bd24e06e16773055a9fb0c7f69d9d7e9fd1787766a377--BaseX946.zip To retry an incomplete download, remove the file above. Regards, Johan

2 4

Improper use/potential bug error
by Eliúd Santiago Meza y Rivera 08 Jan '21

08 Jan '21

Hi, I just update to the latest version of BaseX 9.4.6, and the web server now do not refer correctly the link, checking every individually broken link, the server response this message: I attach the code. In advance I appreciate your help. HTTP ERROR 500 java.lang.NoSuchMethodError: org.basex.query.value.type.SeqType.cast(Lorg/basex/query/value/Value;Lorg/basex/query/QueryContext;Lorg/basex/query/StaticContext;Lorg/basex/util/InputInfo;)Lorg/basex/query/value/Value; URI: /app/static/pngkit_realistic-spider-web-png_1049388.png STATUS: 500 MESSAGE: java.lang.NoSuchMethodError: org.basex.query.value.type.SeqType.cast(Lorg/basex/query/value/Value;Lorg/basex/query/QueryContext;Lorg/basex/query/StaticContext;Lorg/basex/util/InputInfo;)Lorg/basex/query/value/Value; SERVLET: RESTXQ CAUSED BY: java.lang.NoSuchMethodError: org.basex.query.value.type.SeqType.cast(Lorg/basex/query/value/Value;Lorg/basex/query/QueryContext;Lorg/basex/query/StaticContext;Lorg/basex/util/InputInfo;)Lorg/basex/query/value/Value;Caused by: java.lang.NoSuchMethodError: org.basex.query.value.type.SeqType.cast(Lorg/basex/query/value/Value;Lorg/basex/query/QueryContext;Lorg/basex/query/StaticContext;Lorg/basex/util/InputInfo;)Lorg/basex/query/value/Value; at org.basex.http.web.WebFunction.bind(WebFunction.java:137) at org.basex.http.restxq.RestXqFunction.bind(RestXqFunction.java:210) at org.basex.http.restxq.RestXqResponse.bind(RestXqResponse.java:60) at org.basex.http.web.WebResponse.create(WebResponse.java:61) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:73) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1443) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:791) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:550) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:602) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:738) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:273) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:336) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:313) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:171) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:129) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:375) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) at java.lang.Thread.run(Unknown Source) ------------------------------ Powered by Jetty:// 9.4.34.v20201102 <https://eclipse.org/jetty> -- LSC Eliud Santiago Meza y Rivera

2 1

BaseX 9.4.6
by Christian Grün 07 Jan '21

07 Jan '21

Dear all, Our new year patch release features various new performance tweaks and minor bug fixes. Thanks all for your support! Have a pleasant 2021, Christian BaseX Team

2 1

FOP module
by Jerome Chauveau 07 Jan '21

07 Jan '21

Hi, I am trying to use the (too old ?) FOP module, but unsuccessfully. I copied that example : import module namespace fop = 'org.basex.modules.fop.FOP'; let $xsl := xslt:transform('fop.xml', 'fop.xsl') let $pdf := fop:transform($xsl) return file:write-binary('fop.pdf', $pdf) from this thead : [ https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-February/006326.h… | https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-February/006326.h… ] which generates that error (in a BaseX 9.3) : [XPTY0004] class org.basex.modules.fop.FOP tried to access private method 'void org.basex.query.value.item.B64.<init>(byte[])' (org.basex.modules.fop.FOP and org.basex.query.value.item.B64 are in unnamed module of loader 'app'). Caused by: FOP:transform(document-node()). Any suggestions on how to fix this ? Thanks Regards Jérôme

3 9

error "lock file does not exist" after "add" command
by Zachary N. Dean 04 Jan '21

04 Jan '21

Hi Thomas, Author of the Erlang client here. :-) I haven't seen this before, but I haven't used pooled connections either. Is there a minimal example for the commands that you run that I could use to reproduce this and ensure it's not a problem in the client? Thanks, Zack

2 1

LDAP Module
by Maciej Nestorowicz 28 Dec '20

28 Dec '20

Hi, I wanted to know, is there any module in BaseX which is responsible for LDAP authentication and authorization? Kind Regards, Maciej Nestorowicz

1 0

Database access in a function
by Giuseppe G. A. Celano 18 Dec '20

18 Dec '20

Hi, I have a script where I join two databases. It works. However, when I try to put the content of this script in a function, and then call it (with the databases being the arguments), the execution is slowed down (I guess the indexes are not properly accessed). Is there a way to overcome this? Thanks.

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk