- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Java Modules - Constructor
by Andy Bunce 08 May '17

08 May '17

Hi Ilko, >The repo folder was completely empty. So you want to install it in the repository, using repo install? My test was installing via copying the jar to basex/lib/ where it works (for me). If I use repo install I get the same problem as you. This may be a bug/feature. It is possible that using the full EXPath Packaging [1] xar would work although I have not tried it. This would involve adding an XQuery file with expath-pkg.xml and basex.xml files to create a xar wrapping the jar, structured as here [2] The issue [3] may be relevant. Regards /Andy hello-test.jar <https://drive.google.com/file/d/0B_HWsgek7hAeTjFnSFg3cGVpMXc/view?usp=drive…> [1] http://docs.basex.org/wiki/Repository#Java_2 [2] https://github.com/expkg-zone58/metadata-extract/tree/master/src/main [3] https://github.com/BaseXdb/basex/issues/1413 On 8 May 2017 at 11:44, kovacic <kovacic(a)dke.uni-linz.ac.at> wrote: > Hi Andy, > > I have removed all other existing modules before installing this module. > The repo folder was completely empty. > > Regards > Ilko > > Am 05.05.2017 um 19:29 schrieb Andy Bunce: > > Hi IIko > > Your code and: > > declare namespace t='org.basex.modules.Hello'; > let $obj := t:new('works for me') > return t:hello($obj) > > Returns: > > Hello works for me > > Could be be that you have multiple versions of the jar on the path? > > Regards > /Andy > > On 5 May 2017 at 11:20, kovacic <kovacic(a)dke.uni-linz.ac.at> wrote: > >> Hi all, >> >> I am running BaseX 8.6.3 currently and struggling with the inclusion of >> modules written in Java. I have extended the Hello World example: >> >> package org.basex.modules; >> >> public class Hello { >> >> private String str = "BaseX"; >> >> public Hello() {} >> >> public Hello(String str) { >> this.str = str; >> } >> >> public String hello(final String world) { >> return "Hello " + world; >> } >> >> public String hello() { >> return "Hello " + str; >> } >> } >> >> I can pack it into a jar-file and install it successfully. My jar-file is >> structured as following: >> >> hello.jar >> - META-INF >> - MANIFEST.MF >> - org >> - basex >> - modules >> - Hello.class >> >> Here is the content of my manifest.mf: >> >> Manifest-Version: 1.0 >> Main-Class: org.basex.modules.Hello >> >> The methods of the Hello-class can be called without any problems when >> the module is imported: >> >> import module namespace t='org.basex.modules.Hello'; >> >> t:hello('text') >> >> However, when I try to explicitly create the object by calling the >> constructor (new) with arguments it fails: >> >> declare namespace t='org.basex.modules.Hello'; >> >> let $obj := t:new('test') >> >> return '' >> >> When I try to call the constructor I receive the error [XPST0017] Unknown >> function: Q{org.basex.modules.Hello}new. >> >> Since I am able to execute the FileWriter example ( >> http://docs.basex.org/wiki/Java_Bindings#Namespace_Declarations) which >> calls a constructor with an argument I would like to know if this behavior >> is a bug or if I am missing an important point. >> >> Regards, >> Ilko >> >> >> > > -- > *Ilko Kovacic* > Wissenschaftlicher Mitarbeiter > Institut für Wirtschaftsinformatik - Data & Knowledge Engineering > > > *JOHANNES KEPLER UNIVERSITÄT LINZ* > Altenberger Straße 69 > Science Park III, S3 111 > 4040 Linz, Österreich > T +43 732 2468 4286 <+43%20732%2024684286> > ilko.kovacic(a)jku.at > www.dke.jku.at >

1 0

Java Modules - Constructor
by kovacic 05 May '17

05 May '17

Hi all, I am running BaseX 8.6.3 currently and struggling with the inclusion of modules written in Java. I have extended the Hello World example: package org.basex.modules; public class Hello { private String str = "BaseX"; public Hello() {} public Hello(String str) { this.str = str; } public String hello(final String world) { return "Hello " + world; } public String hello() { return "Hello " + str; } } I can pack it into a jar-file and install it successfully. My jar-file is structured as following: hello.jar - META-INF - MANIFEST.MF - org - basex - modules - Hello.class Here is the content of my manifest.mf: Manifest-Version: 1.0 Main-Class: org.basex.modules.Hello The methods of the Hello-class can be called without any problems when the module is imported: import module namespace t='org.basex.modules.Hello'; t:hello('text') However, when I try to explicitly create the object by calling the constructor (new) with arguments it fails: declare namespace t='org.basex.modules.Hello'; let $obj := t:new('test') return '' When I try to call the constructor I receive the error [XPST0017] Unknown function: Q{org.basex.modules.Hello}new. Since I am able to execute the FileWriter example (http://docs.basex.org/wiki/Java_Bindings#Namespace_Declarations) which calls a constructor with an argument I would like to know if this behavior is a bug or if I am missing an important point. Regards, Ilko

2 1

BaseX scaling and real-time analytics
by Simon Wong 25 Apr '17

25 Apr '17

I'm doing a BaseX evaluation to characterize its performance with my use case. In my use case, I am receiving XML files over the network at a rate of about 100 / sec. I want to insert them into BaseX and perform real-time analytics. These XML files ranges from 20 to 50 nodes and in general has a similar strucuture. I will be periodically running XQuerys on this dataset. I am using the network API in Python to add documents in a tight loop to determine throughput. I notice that when the database is empty, adding 1000 documents takes about 1 second. When the database is loaded up with 30,000 documents, adding these 1000 documents takes about 5 seconds. I was able to get much better scaling with AUTOFLUSH off, and periodically executing a flush command. So far with a million documents in the database, adding documents seem to take close to constant time which is great. I haven't gotten to optimizing queries yet. Doing some simple aggregate queries like count(//), it looks like the query time scales linearly with the number of documents in the database. Are there any general strategies to optimizing real-time analytics use cases? Any options that can be tuned to increase document insertion and query speeds and scaling? Or perhaps indexing options that might work better for a dataset that is always changing and increasing? Thanks, - Simon

2 1

db:backups, db:ouptut order of operations.
by France Baril 21 Apr '17

21 Apr '17

Hi, What am I doing wrong? It was my impression that db:ouput was not executed until the database updates were completed. However, when I execute: let $db-name := 'Inve' return ( db:create-backup($db-name), db:output(db:backups($db-name)) ) The list of backups returned doesn't include the backup just added by db:create-backup(). I just tried with 8.6.3 to make sure it wasn't an older issue. Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 4

Re: [basex-talk] Get session config info
by Bram Vanroy 20 Apr '17

20 Apr '17

Hi Christian Do you mean a basex admin, a sys admin, or something else? Thanks Op 20 apr. 2017 13:41 schreef Christian Grün <christian.gruen(a)gmail.com>: Hi Bram, Users with admin permissions can request the database path via "db:system()//dbpath". Hope this helps, Christian On Wed, Apr 19, 2017 at 2:13 PM, Bram Vanroy <bram.vanroy1(a)student.kuleuven.be> wrote: > Hi List > > > > In a .basex file we can set the destination of our database. If we then > create a server, and create a database using a client, the BaseX-files will > be created in that directory. Is it possible to get the path to this > directory from within the client? In Perl I tried running the following > command after looking through the basex client, but I got an ‘undef’: > > > > my $session = Session->new($host, $port, $user, $pw); > > my $t = $session->info; > > $session->close; > > > > print $t; > > > > Any ideas how to get the configuration values for a basex server from a > (Perl) client? > > > > Thank you > > > > > > Bram > >

2 1

Get session config info
by Bram Vanroy 20 Apr '17

20 Apr '17

Hi List In a .basex file we can set the destination of our database. If we then create a server, and create a database using a client, the BaseX-files will be created in that directory. Is it possible to get the path to this directory from within the client? In Perl I tried running the following command after looking through the basex client, but I got an 'undef': my $session = Session->new($host, $port, $user, $pw); my $t = $session->info; $session->close; print $t; Any ideas how to get the configuration values for a basex server from a (Perl) client? Thank you Bram

2 1

Re: [basex-talk] xquery:eval error propagation
by Iwan Briquemont 18 Apr '17

18 Apr '17

Dear Christian, Perfect! I had not seen that option yet. Thank you, Iwan Le 18 avr. 2017 12:16, "Christian Grün" <christian.gruen(a)gmail.com> a écrit : Dear Iwan, Thanks for the feature proposal. As you may have seen, the xquery:parse function provides a 'pass' option, which can be used to pass on the original error info [1]. I have now added this option to xquery:eval [2], and to all other functions that support the same options. Feedback on the latest stable snapshot is welcome [3]. Cheers, Christian [1] http://docs.basex.org/wiki/XQuery_Module#xquery:parse [2] http://docs.basex.org/wiki/XQuery_Module#xquery:eval [3] http://files.basex.org/releases/latest/ On Tue, Apr 18, 2017 at 11:28 AM, Iwan Briquemont <tracnar(a)gmail.com> wrote: > Hello, > > I use xquery:eval to evaluate some user provided queries. > > It works well but when there is an error the true origin of the error > is hidden, as it will give the file and line of the xquery:eval call. > > Is there any way to pass the origin of the error through the > xquery:eval? > I guess the best would be to keep both origins. > > My workaround is to do a try/catch inside the evaluated query and wrap > the result with the error variables. It's a bit cumbersome and does not > work for static errors. > > Thank you, > Iwan

1 0

xquery:eval error propagation
by Iwan Briquemont 18 Apr '17

18 Apr '17

Hello, I use xquery:eval to evaluate some user provided queries. It works well but when there is an error the true origin of the error is hidden, as it will give the file and line of the xquery:eval call. Is there any way to pass the origin of the error through the xquery:eval? I guess the best would be to keep both origins. My workaround is to do a try/catch inside the evaluated query and wrap the result with the error variables. It's a bit cumbersome and does not work for static errors. Thank you, Iwan

2 1

basexgui.bat doesn't start
by Ulrike Schaper - SideStep Business Solutions GmbH 18 Apr '17

18 Apr '17

Dear Christian, I just installed BaseX 8.6.3 on Windows Server 2012, but the BaseX GUI doesn't start up when I use basexgui.bat. Using the exe is fine, but I need some additional lib files, which of course won't be loaded via the exe. Is there something I overlooked? Best regards, Ulrike.

2 4

Questions about server protocol
by Sebastián Filippini 14 Apr '17

14 Apr '17

------------------------------------------------------------------------ Hello. This is my first post on this mailing list. I'm currently trying to create an Apache Camel component for using BaseX database. I have two questions about BaseX server protocol. 1) Does exist a command to test connection (eg. ping or echo)? 2) Can I trust in error message text for detecting error conditions? Best regards, Sebastián Filippini

2 1

Characters allowed in database names
by Bram Vanroy 12 Apr '17

12 Apr '17

Hello, list Upon creating specific database names I came across the following issue: when creating a database named ''wrpee|advp|hd%bw" (without quotes) from the CREATE command I got the basic 'how to use CREATE' screen in my terminal. This would seem to indicate that my syntax is wrong, even though "CREATE DATABASE wrpee|advp|hd%bw C:\\sonar\\grinded\\WRPEE\\advp\\ advp|hd%bw.xml" is syntactically valid (two arguments for CREATE DATABASE). The issue seems to be in the database name. The pipe | is not allowed, it seems. When replaced by a dash "-" it works as expected. However, I cannot find this documented anywhere. Is it possible to make the error message more clear, e.g. 'invalid database name', or at least update the documentation on this? Which characters are allowed, and which aren't? Thanks in advance, Kind regards Bram Vanroy

2 2

Is it possible to limit a BaseX server maximum memory consumption?
by Jacob Borisov 12 Apr '17

12 Apr '17

Hello. Is it possible to hardly limit a maximum memory consumption of a BaseX server instance process (something like a cache_size option in MongoDB) avoiding getting Java heap space errors simultaneously? Or, in the current implementation, it's required for the process to be able to allocate memory enough for storing a whole data set of the currently accessed database? Thanks.

2 3

RESTXQ and URI-Parameters
by Peter Hinkelmanns 12 Apr '17

12 Apr '17

Dear all, I noticed, that the implementation of RestXQ in BaseX behaves differently compared to the implemation in eXist. If you have a simple API like declare %rest:path("/test/{$params1}/{$params2}") %rest:GET function test($params1 as xs:string*, $params2 as xs:string*) { <response> <p1>{$params1}</p1> <p2>{$params2}</p2> </response> }; And you call this Uri "/test/a/b;c=2" BaseX returns <response> <p1>a</p1> <p2>b</p2> </response> versus the response of eXist <response> <p1>a</p1> <p2>b;c=2</p2> </response> --> It seems to be not possible to pass Matrix URIs in BaseX over RestXQ right now. eXist would accept as well a call like "test/a;e;f=5/b;c=2". BaseX passes out at this point, because nothing after the first ; is evaluated and thus no matching RestXQ API can be found. My questions: -Is this a bug? -Is there a feature missing in the current implementation of RestXQ in BaseX? -Or is there an easy configuration for BaseX available, which will allow working with Matrix-Uri-Parameters and RestXQ? Thanks and bye Peter

2 4

systemd basex.service ubuntu 16.04
by Stephen White 10 Apr '17

10 Apr '17

Does anyone have a working combination for launch basexhttp as a service using systemd? If not, what is the suggested method to auto launch on reboot. Cheers, Steve

2 1

Re: [basex-talk] Basex with JSmooth
by Maximilian Gärber 10 Apr '17

10 Apr '17

Hi, you might need to check that all needed libs are on your classpath, the .bat does this with this line: set CP=%MAIN%/target/classes;%MAIN%/lib/*;%MAIN%/../basex-core/lib/* Replace %MAIN% with wathever JSmooth gives you as the project directory variable in such a way that e.g. %PROJECT%/target/classes will match your new setup. NOTE: * Please always post to the list as well, others might add valuable feedback anytime * If you include more infos, e.g. error messages, more people might be able to help Br, Max 2017-04-10 9:34 GMT+02:00 Tushar Deshmukh <tdlwala(a)gmail.com>: > Namaste Max, > > PFA a screen shot for making .exe file. I m not able to create it. > > I am not able to instantiate BaseXHTTP class in java also (after importing > org.basex.*;). Please what is going wrong. > > For normal user .exe file is more appropriate than yajsw. > > Mangal Bhavna Sahit, > Tushar > > On Mon, Apr 10, 2017 at 12:41 PM, Maximilian Gärber <mgaerber(a)arcor.de> > wrote: >> >> Hi, >> >> it is org.basex.BaseXHTTP >> >> just have a look at the start script: >> >> https://github.com/BaseXdb/basex/blob/0f970efc419bc067bd03a66438177eb7f884d… >> >> Br, >> Max >> >> 2017-04-10 4:49 GMT+02:00 Tushar Deshmukh <tdlwala(a)gmail.com>: >> > Namaste, >> > >> > I want to start Basex HTTP server using Jsmooth >> > (I want to make .exe file from BasexHTTP.jar.) >> > I am not able to do so because which class is to be instantiate. Any >> > link/Help is appreciated. >> > >> > Mangal Bhavna Sahit, >> > Tushar > >

1 0

Basex with JSmooth
by Tushar Deshmukh 10 Apr '17

10 Apr '17

Namaste, I want to start Basex HTTP server using Jsmooth (I want to make .exe file from BasexHTTP.jar.) I am not able to do so because which class is to be instantiate. Any link/Help is appreciated. Mangal Bhavna Sahit, Tushar

2 1

server and/or web application up times
by Fabrice ETANCHAUD 07 Apr '17

07 Apr '17

Dear all, Is there a mean to obtain server and/or web application up times ? Best regards, Fabrice

2 2

BaseX 8.6.3
by Christian Grün 06 Apr '17

06 Apr '17

Hi all, We have released a new patch version of BaseX. some minor bugs have been fixed [1], performance of iterative query evaluation has been improved, and a new fetch:xml-binary function is now available, which allows you to convert binary data (which may have an XML encoding declaration embedded) to XML [2]. Have fun, Christian [1] https://github.com/BaseXdb/basex/commits/master [2] http://docs.basex.org/wiki/Fetch_Module#fetch:xml-binary

1 0

Re: [basex-talk] Basex Docker Container: How to Control Options
by Christian Grün 05 Apr '17

05 Apr '17

Hi Eliot, Did you try to specify the option in the local section of the .basex file (at the bottom, after all other options)? Best, Christian Am 02.04.2017 10:52 schrieb "Eliot Kimber" <ekimber(a)contrext.com>: I’ve worked around the configuration file problem by setting the options on the Java command line by setting BASEX_JVM in my Dockerfile: ENV BASEX_JVM="-Dorg.basex.CHOP=false -Dorg.basex.CATFILE=/opt/dita-ot/DITA-OT/catalog-dita.xml -Dorg.basex.DTD=true -Dorg.basex.SKIPCORRUPT=true" That seems to work. I guess I could also set this environment variable in my docker-compose.yml file, although except for CATFILE, these are invariant for this application. Cheers, E. -- Eliot Kimber http://contrext.com On 4/1/17, 10:44 PM, "Eliot Kimber" <basex-talk-bounces@mailman. uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: Perhaps a more useful question is: is there a workaround for this? That is, I need to have the DTD, CATFILE, CHOP, and SKIPCORRUPT options set when I load files into a database, which I’m doing through the remote API. Is there either a separate options file that I should be using or a way to specify these options at document load time? Cheers, E. -- Eliot Kimber http://contrext.com On 4/1/17, 10:23 PM, "Eliot Kimber" <basex-talk-bounces@mailman. uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: I dug into the code and I think this is a code bug but I don’t understand the overall flow well enough to know where the bug is, but I suspect it’s a simple change. If I debug the BasexGUI class and have a ~/.basex file that includes CATFILE=foo it will fail with an unknown option error because the option class being used is StaticOptions and StaticOptions does not define CATFILE as an option. The CATFILE option, along with a few others, is defined on MainOptions: private static final Option<?>[] INHERIT = { CHOP, INTPARSE, STRIPNS, DTD, XINCLUDE, CATFILE }; Looking at BaseXHTTP it uses HTTPContext which only uses StaticOptions, not MainOptions, which means it can never allow the INHERIT options. So something must have changed from 8.1 ish to now to change how options are handled since these options worked before I moved to the latest BaseX container and versions. But there definitely seems to be an oversight in the initial handling of the options file in the BaseXHTTP server (and in the BaseXGUI as well since I get the same behavior there as well). I would make a pull request but I don’t presume to know what policies or general practices underlie the current options mechanism deisgn. Cheers, Eliot -- Eliot Kimber http://contrext.com On 3/26/17, 10:20 PM, "Eliot Kimber" <basex-talk-bounces@mailman. uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: I found my original mail thread from January 2016: https://mailman.uni-konstanz.de/pipermail/basex-talk/2016- January/010171.html Basically I had to append my options to the existing .basex file rather than simply provide a file. However, that isn’t an option here because there is no existing /srv/.basex file (the place where the file needs to be). As an experiment I tried doing this: RUN touch /srv/.basex && \ echo "DTD=true" >> .basex && \ echo "CATFILE=/opt/dita-ot/DITA-OT/catalog-dita.xml" >> .basex && \ echo "SKIPCORRUPT=true" >> .basex && \ echo "CHOP=false" >> .basex && \ echo "DBPATH=/srv/BaseXData" >> .basex && \ echo "REPOPATH=/srv/BaseXRepo" >> .basex && \ echo "WEBPATH=/srv/BaseXWeb" >> .basex && \ chown basex /srv/.basex RUN echo "/srv/.basex:\n===========" && cat /srv/.basex && echo "=======" And I get this from the build command: /srv/.basex: =========== DTD=true CATFILE=/opt/dita-ot/DITA-OT/catalog-dita.xml SKIPCORRUPT=true CHOP=false DBPATH=/srv/BaseXData REPOPATH=/srv/BaseXRepo WEBPATH=/srv/BaseXWeb ======= When I start up this container I get this: /srv/.basex: Unknown option 'DTD'. /srv/.basex: Unknown option 'CATFILE'. /srv/.basex: Unknown option 'SKIPCORRUPT'. /srv/.basex: Unknown option 'CHOP'. /srv/.basex: writing new configuration file. Note that it’s only complaining about DTD, CATFILE, SKIPCORRUPT, and CHOP, but not DBPATH, REPOPATH, and WEBPATH. I tried reordering things, no difference in result (but the messages reflect the order change). So it must be something about how these particular options are processed rather than an issue with the .basex file, at least as far as I can see. Cheers, Eliot -- Eliot Kimber http://contrext.com On 3/26/17, 3:29 PM, "Eliot Kimber" <basex-talk-bounces@mailman. uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: Discovered that if I use USER root in the Dockerfile I have to then do USER basex before the end so that the container will be running as basex, otherwise it does not start up correctly. I also have to chown the /srv/.basex file to basex otherwise it can’t overwrite it on startup. Made some progress but something is still not working. I now have a Dockerfile based on basex/dba that results in a running system with the both the dba and my custom app runnable. However, if I then add this: COPY basex/dot_basex /srv/.basex As before, on startup I get this: docker run --name linkmgr-test -p 8984:8984 link-manager-test /srv/.basex: Unknown option 'CATFILE'. /srv/.basex: Unknown option 'DTD'. /srv/.basex: Unknown option 'SKIPCORRUPT'. /srv/.basex: Unknown option 'CHOP'. /srv/.basex: writing new configuration file. Creating /srv/BaseXWeb/WEB-INF/web.xml Creating /srv/BaseXWeb/WEB-INF/jetty.xml I think this Unknown option this is actually an issue with the file itself but I don’t recall what the exact cause and/or solution was. Cheers, E. -- Eliot Kimber http://contrext.com On 3/26/17, 1:40 PM, "Eliot Kimber" < basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: I’m trying to set up a Docker container with my own Web app using the latest official containers as a base and following the instructions in the latest BaseX docs. As part of this setup I need to add several additional options. I also want to include the dba app. Following the instructions in the docs I’m putting my additional options in /srv/.basex and these take effect. However, if I use the basex/dba image as a base, the other options, such as the custom REPOPATH and WEBPATH settings do not get used. It’s not clear to me from looking at the various Dockerfiles how the dba container sets the options and how I can then add to them without overwriting them. Of course I can duplicate the options in my Dockerfile but it seems like I should be able to add my options additively but I’m not seeing how to do it, so I feel I’m missing something. In my Dockerfile I have: COPY basex/dot_basex /srv/.basex If I don’t include this line then the container otherwise works in that my Web app is there but it requires these additional options in order to function properly. If I include it then the effective options reflect only my changes and not those required for the custom Web apps to work. Thanks, Eliot -- Eliot Kimber http://contrext.com

3 5

Re: [basex-talk] Basex Docker Container: How to Control Options
by Eliot Kimber 02 Apr '17

02 Apr '17

Discovered that if I use USER root in the Dockerfile I have to then do USER basex before the end so that the container will be running as basex, otherwise it does not start up correctly. I also have to chown the /srv/.basex file to basex otherwise it can’t overwrite it on startup. Made some progress but something is still not working. I now have a Dockerfile based on basex/dba that results in a running system with the both the dba and my custom app runnable. However, if I then add this: COPY basex/dot_basex /srv/.basex As before, on startup I get this: docker run --name linkmgr-test -p 8984:8984 link-manager-test /srv/.basex: Unknown option 'CATFILE'. /srv/.basex: Unknown option 'DTD'. /srv/.basex: Unknown option 'SKIPCORRUPT'. /srv/.basex: Unknown option 'CHOP'. /srv/.basex: writing new configuration file. Creating /srv/BaseXWeb/WEB-INF/web.xml Creating /srv/BaseXWeb/WEB-INF/jetty.xml I think this Unknown option this is actually an issue with the file itself but I don’t recall what the exact cause and/or solution was. Cheers, E. -- Eliot Kimber http://contrext.com On 3/26/17, 1:40 PM, "Eliot Kimber" <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: I’m trying to set up a Docker container with my own Web app using the latest official containers as a base and following the instructions in the latest BaseX docs. As part of this setup I need to add several additional options. I also want to include the dba app. Following the instructions in the docs I’m putting my additional options in /srv/.basex and these take effect. However, if I use the basex/dba image as a base, the other options, such as the custom REPOPATH and WEBPATH settings do not get used. It’s not clear to me from looking at the various Dockerfiles how the dba container sets the options and how I can then add to them without overwriting them. Of course I can duplicate the options in my Dockerfile but it seems like I should be able to add my options additively but I’m not seeing how to do it, so I feel I’m missing something. In my Dockerfile I have: COPY basex/dot_basex /srv/.basex If I don’t include this line then the container otherwise works in that my Web app is there but it requires these additional options in order to function properly. If I include it then the effective options reflect only my changes and not those required for the custom Web apps to work. Thanks, Eliot -- Eliot Kimber http://contrext.com

1 4

Deadlock with concurrent write and reads in BaseX
by Simon Chatelain 31 Mar '17

31 Mar '17

Hello all, I am facing an issue with my application using BaseX 8.6.2. Basically what I have is one thread (Add thread) receiving data from a socket as XML fragment and storing it in BaseX. On the other hand, my application provides a REST interface to retrieve data from the DB. When retrieving data what happen is, I first execute a simple Xquery in a thread (Primary Read), and for each hit returned by this first query, I execute another query in another thread (Secondary read) to retrieve additional data. The problem is that I end up in a situation where all three threads are stopped waiting for something. The Add thread is park as it cannot acquire a write lock, while the Primary read is running, as it should be. But the Secondary read is also parked, thus blocking the Primary read, and so we end up in a kind of deadlock. The PARALLEL option in .basex is set to 4, and the FAIRLOCK option is set to true. Some technical details: In the primary read I am using session.setOutputStream(pos); session.execute(new XQuery(flwor)); where session is a LocalSession and pos is a PipedOutputStream In Secondary read, I am reading the other side of the piped stream, and for each line read from the stream, I execute another query (well not exactly in the real case scenario, but this simplification seems good enough to exhibit the problem, and is shown in the attached BaseXDeadlock.java example). You can also see the stacks of all three threads in BaseXDeadlockStacks.txt In this example, if I don’t start the Add thread, then Primary and Secondary read are running as expected. On the other hand, if I change my implementation of Primary and Secondary read, and use a blocking queue to transfer data from Primary to Secondary read like shown below: Query query = session.query(flwor) while (query.more()) { queue.put(query.next()); } And then taking from the queue in Secondary read, then it works. This implementation is shown in BaseXNoDeadlock.java. Using the latter is good enough for me, as it does the job, even if there is a small performance penalty compared to the first implementation, in my real case scenario. So my question is: is my first implementation fundamentally broken or is there something wrong on BaseX side? Best regards and many thanks to all the BaseX team for this efficient and nice to use tool. Simon Chatelain

2 1

BaseX hanging on REST/XQ pipelining
by Erik Peterson 31 Mar '17

31 Mar '17

It seems like on some RESTXQ/REST pipelining (restxq calling another restxq api) causes basex to hang. In this scenario a mock client was created to test the system. A test was written to automate mock client requests. A restxq path was created run tests. More specifically... 1) Browse to http://localhost:8984/unit-test/test where last parameter "test" maps the directiory where unit tests are located. 2) #1 is handled by a RESTXQ function where a REST URL is fetched: fetch(http://localhost:8984/rest?command=test+../webapp/mock-client/test) 3) #2 is handled by a unit-test that fetches a mock-client URL fetch(http://localhost:8984/mock-client/do-something) 4) #3 is handled by a the mock-client hitting the system fetch(http://localhost:8984/system/do-something) - #3 and #4 (mock-client) work great - #2 (the unit-test) work great when running tests from command line OR when the test is a simple unit:assert(<canary/>). But basex hangs otherwise Thanks for any insight on why the system calling back to itself may cause a system hang.

2 2

suddenly...java function x is unknown
by Erik Peterson 30 Mar '17

30 Mar '17

I've been integrating basex with 3rd party java jar files by dropping them in the basex/lib directory. This has worked fine until today when I now git "java function x is unknown". I've... - re-pulled everything from our repo to make sure all binaries are as they were when working - restarted osx - updated java - using BaseX VERSION 8.6.1 (February 24, 2017) It's working on other dev machines but not mine. Why would BaseX stop loading the classes from the lib jar files? Is there a better way I should be deploying jars? Thanks.

2 2

Performance: associating one with many, or many with one?
by Jay Straw 29 Mar '17

29 Mar '17

Hi List! I'm building an application in base-x that's sort of like a local music wiki: bands, members, venues, promoters, and albums and songs are some of what I'm representing in XML. And what I'm wondering is that, in a situation where there's one of something (a musician), and a bunch of something else they're associated with (song writting or performance credits), which node should get the reference? The numerous node gets the reference back to the one: <album name="We Might Rock You" by="The Quesadillas"> <track number="1" name="Hot Cross Buns" written-by="Joe Schmoe" /> <track number="2" name="Bicycle" written-by="Joe Schmoe" /> </album> [ etc ] Or the one refers to the many: <person name="Joe Schmoe"> <songs-written> <song name="Hot Cross Buns" /> <song name="Bicycle" /> </songs-written> </person> Example 1, I could use something like: track[@written-by="Joe Schmoe"] Example 2: person[@name="Joe Schmoe"]/songs-written/song My other thought was putting the references in both, but I'll have to do this with many types of objects I'm representing and I don't want things to get out of control (then again, if I go to export an <album/> or <band/> and I'm using the second method, I'll have to do a join) I have a feeling in a large set, the second way wins out. Even where I live, with only around 750,000 people in our entire state (Alaska), we have easily 100 - 200 acts, including bands, solo performers, traditional acts, etc, with thousands of individuals that compose them. But I want bands that are extinct, bands that are on hiatus, etc, and I hope my software is useful to others in larger cities as well. So, maybe a pointless question because my db will be so tiny compared to some folks who post on here, but just curious :-) Also, if this problem has a name I can research myself, that'd be great! Be well, Jay Straw

3 2

Basex Docker Container: How to Control Options
by Eliot Kimber 26 Mar '17

26 Mar '17

I’m trying to set up a Docker container with my own Web app using the latest official containers as a base and following the instructions in the latest BaseX docs. As part of this setup I need to add several additional options. I also want to include the dba app. Following the instructions in the docs I’m putting my additional options in /srv/.basex and these take effect. However, if I use the basex/dba image as a base, the other options, such as the custom REPOPATH and WEBPATH settings do not get used. It’s not clear to me from looking at the various Dockerfiles how the dba container sets the options and how I can then add to them without overwriting them. Of course I can duplicate the options in my Dockerfile but it seems like I should be able to add my options additively but I’m not seeing how to do it, so I feel I’m missing something. In my Dockerfile I have: COPY basex/dot_basex /srv/.basex If I don’t include this line then the container otherwise works in that my Web app is there but it requires these additional options in order to function properly. If I include it then the effective options reflect only my changes and not those required for the custom Web apps to work. Thanks, Eliot -- Eliot Kimber http://contrext.com

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk