- BaseX-Talk - mailman.uni-konstanz.de

Fwd: Re: Status of BaseX Docker Container?
by Christian Grün 29 Jan '16

29 Jan '16

---------- Weitergeleitete Nachricht ---------- Von: "Eliot Kimber" <ekimber(a)contrext.com> Datum: 28.01.2016 11:57 nachm. Betreff: Re: [basex-talk] Status of BaseX Docker Container? An: "Christian Grün" <christian.gruen(a)gmail.com> Cc: > Refined the dfst/basex container definition and figured out what I was > doing wrong on OS X. > > I updated the container to expose as volumes the repo, data, and webapp > directories. This allows two things: > > 1. You can mound a host directory as any of these directories in place of > the default one. This lets you have local persistent storage or swap in a > different set of modules or webapp modules for the same container. > > 2. Other containers can access these volumes from within the same Docker > network using the --volumes-from parameter of the docker run command (not > sure why you'd want to do this but there might be some reason. > > On OS X I realized that when you start a Docker-specific shell window > (e.g., using the Kitematic tools "docker cli" button) it sets environment > variables that will not, by default, be set in any other shell window. So > you have to remember to do all your Docker stuff in the cli shell or > figure out how to set the environment in your .bashrc or whatever. > > In any case, assuming you have Docker otherwise running you can run the > container like this: > > docker run -d -p 8984:8984 -p 1984:1984 --name basex dfst/basex > > > This will run the server as a background task (-d) and expose the default > server ports on the docker machine. > > If you want to swap in your own data directory you use the -v parameter > like so: > > docker run -d -p 8984:8984 -p 1984:1984 -v > /Users/someuser/data:/opt/basex/data --name basex dfst/basex > > However, I don't yet know what the right permissions settings are to allow > basex to write to a mounted data volume. In my experiments BaseX could > create a database directory but then failed with a permissions error when > it tried to create its files with in it. Something silly on my part I'm > sure. > > > My understanding is that Docker on OS X only shares your home directory > through the VirtualBox VM, so you can't mount directories outside your > home directory, at least by default. You also have to make sure the > directory permissions allow the basex user to write to it. > > > You then use the IP address of the Docker machine as the base IP address, > which you can determine using the command "docker-machine ip default: > > bash-3.2$ docker-machine ip default > 192.168.99.100 > > > With that you can connect to the running Web server using > http://192.168.99.100:8984 and away you go. > > The image is "dfst/basex" on the Docker hub server. I also created an > image with the tag "8.3" (dfst/basex:8.3). > > Cheers, > > Eliot > > ---- > Eliot Kimber, Owner > Contrext, LLC > http://contrext.com > > > > > On 1/27/16, 4:06 AM, "Christian Grün" <christian.gruen(a)gmail.com> wrote: > > >…thanks for the hints on the Windows solution! I’ll try it in a while. > > > > > >On Tue, Jan 26, 2016 at 11:13 PM, Eliot Kimber <ekimber(a)contrext.com> > >wrote: > >> Forgot to add the Windows part: > >> > >> Under windows have to explicitly publish the ports when running the > >> container: > >> > >> docker run --name=basex -p 8984:8984 -p 1984:1984 dfst/basex > >> > >> then you can use the IP address of the docker-engine VM to connect to > >>the > >> server: > >> > >> http://192.168.99.100:8984/ > >> > >> you can get the ip address using the "docker-machine ip" command: > >> c:\Program Files\Docker Toolbox>docker-machine ls > >> NAME ACTIVE URL STATE URL > >> SWARM DOCKER ERRORS > >> default - virtualbox Running tcp://192.168.99.100:2376 > >> v1.9.1 > >> c:\Program Files\Docker Toolbox>docker-machine ip default > >> 192.168.99.100 > >> > >> the docker-machine command replaces the older boot2docker command > >> > >> So now I have BaseX server running and accessible as Docker containers > >> under Windows and CentOS. > >> > >> OSX is still a problem: there's some issue with the docker daemon and > >> getting the docker client to connect to it. Haven't been able to find a > >> good solution in my searching. Very annoying. > >> > >> Cheers, > >> > >> E. > >> > >> > >> ---- > >> Eliot Kimber, Owner > >> Contrext, LLC > >> http://contrext.com > >> > >> > >> > >> > >> On 1/26/16, 3:50 PM, "Eliot Kimber" > >> <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of > >> ekimber(a)contrext.com> wrote: > >> > >>>For what it's worth, I've pushed a generic BaseX HTTP container to > >>>Docker > >>>Hub as "dfst/basex". It exposes the default ports for the base and HTTP > >>>servers (1984 and 8984). > >>> > >> >From a Linux system you connect by using the IP address of the Docker > >>>network, e.g.: > >>> > >>>http://172.17.0.2:8984/ > >>> > >>>Under Windows: > >>> > >>>The DockerFile is in GitHub here: > >>> > >>>https://github.com/dita-for-small-teams/dfst-docker > >>> > >>>My next task will be to create a container based on this one that > >>>includes > >>>specific configuration and the DFST Web application modules. Should be > >>>easy once I get to it. > >>> > >>>Cheers, > >>> > >>>E. > >>> > >>>---- > >>>Eliot Kimber, Owner > >>>Contrext, LLC > >>>http://contrext.com > >>> > >>> > >>> > >>> > >>>On 1/26/16, 9:48 AM, "Eliot Kimber" > >>><basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of > >>>ekimber(a)contrext.com> wrote: > >>> > >>>>OK, I'm going to proceed with making a generic basex Docker container > >>>>in > >>>>the DFST Docker project on GitHub. I'm using Andreas' as a starting > >>>>point > >>>>but it's pretty trivial. > >>>> > >>>>I'm working/testing on OS X, Windows, and CentOS so I should be able to > >>>>get something going. > >>>> > >>>>Cheers, > >>>> > >>>>E. > >>>>---- > >>>>Eliot Kimber, Owner > >>>>Contrext, LLC > >>>>http://contrext.com > >>>> > >>>> > >>>> > >>>> > >>>>On 1/26/16, 2:02 AM, "Christian Grün" <christian.gruen(a)gmail.com> > >>>>wrote: > >>>> > >>>>>Hi Eliot, > >>>>> > >>>>>Personally, I had a hard time making Docker work on Windows machines, > >>>>>but we have various Docker aficionados in our team and around, so I > >>>>>hope they¹ll give you some feedback soon. > >>>>> > >>>>>Cheers, > >>>>>Christian > >>>>> > >>>>> > >>>>>On Sun, Jan 24, 2016 at 8:22 PM, Eliot Kimber <ekimber(a)contrext.com> > >>>>>wrote: > >>>>>> I'm working toward using BaseX in a Docker container as part of the > >>>>>>DITA > >>>>>> for Small Teams project (we're trying to set up a system of Docker > >>>>>> containers with all the DFST parts integrated out of the box). > >>>>>> > >>>>>> I notice that Andreas Jung has create a simple container here: > >>>>>> > >>>>>> https://github.com/zopyx/docker-basex > >>>>>> > >>>>>> And pushed it to the Docker Hub in the basex namespace. > >>>>>> > >>>>>> I'm wondering what the relationship of this is, if any, to any > >>>>>>official > >>>>>> BaseX Docker support? > >>>>>> > >>>>>> Thanks, > >>>>>> > >>>>>> Eliot > >>>>>> ---- > >>>>>> Eliot Kimber, Owner > >>>>>> Contrext, LLC > >>>>>> http://contrext.com > >>>>>> > >>>>>> > >>>>>> > >>>>>> > >>>>> > >>>> > >>>> > >>>> > >>> > >>> > >>> > >> > >> > > > >

1 0

Fwd: Re: Status of BaseX Docker Container?
by Christian Grün 29 Jan '16

29 Jan '16

---------- Weitergeleitete Nachricht ---------- Von: "Eliot Kimber" <ekimber(a)contrext.com> Datum: 27.01.2016 6:25 nachm. Betreff: Re: [basex-talk] Status of BaseX Docker Container? An: "Christian Grün" <christian.gruen(a)gmail.com> Cc: > I have successfully created a new image based on the base image that > provides my custom DFST Link Manager web app. Just a matter of copying the > files into the BaseX directory structure (in my case, fetched from github). > > Because I'm doing DITA processing I have to enable DTD entity reference > resolution. I'm doing that by using the entity resolution catalog provided > by the DITA Open Toolkit. In this container context I am setting up a > separate DITA OT container (rather than bundling the OT into the BaseX > container, which would be easier but would make system configuration and > maintenance harder). So I need to work out how to expose file systems from > containers so they can share volumes. I know this is possible just haven't > done it yet. > > Cheers, > > E. > ---- > Eliot Kimber, Owner > Contrext, LLC > http://contrext.com > > > > > On 1/27/16, 4:06 AM, "Christian Grün" <christian.gruen(a)gmail.com> wrote: > > >…thanks for the hints on the Windows solution! I’ll try it in a while. > > > > > >On Tue, Jan 26, 2016 at 11:13 PM, Eliot Kimber <ekimber(a)contrext.com> > >wrote: > >> Forgot to add the Windows part: > >> > >> Under windows have to explicitly publish the ports when running the > >> container: > >> > >> docker run --name=basex -p 8984:8984 -p 1984:1984 dfst/basex > >> > >> then you can use the IP address of the docker-engine VM to connect to > >>the > >> server: > >> > >> http://192.168.99.100:8984/ > >> > >> you can get the ip address using the "docker-machine ip" command: > >> c:\Program Files\Docker Toolbox>docker-machine ls > >> NAME ACTIVE URL STATE URL > >> SWARM DOCKER ERRORS > >> default - virtualbox Running tcp://192.168.99.100:2376 > >> v1.9.1 > >> c:\Program Files\Docker Toolbox>docker-machine ip default > >> 192.168.99.100 > >> > >> the docker-machine command replaces the older boot2docker command > >> > >> So now I have BaseX server running and accessible as Docker containers > >> under Windows and CentOS. > >> > >> OSX is still a problem: there's some issue with the docker daemon and > >> getting the docker client to connect to it. Haven't been able to find a > >> good solution in my searching. Very annoying. > >> > >> Cheers, > >> > >> E. > >> > >> > >> ---- > >> Eliot Kimber, Owner > >> Contrext, LLC > >> http://contrext.com > >> > >> > >> > >> > >> On 1/26/16, 3:50 PM, "Eliot Kimber" > >> <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of > >> ekimber(a)contrext.com> wrote: > >> > >>>For what it's worth, I've pushed a generic BaseX HTTP container to > >>>Docker > >>>Hub as "dfst/basex". It exposes the default ports for the base and HTTP > >>>servers (1984 and 8984). > >>> > >> >From a Linux system you connect by using the IP address of the Docker > >>>network, e.g.: > >>> > >>>http://172.17.0.2:8984/ > >>> > >>>Under Windows: > >>> > >>>The DockerFile is in GitHub here: > >>> > >>>https://github.com/dita-for-small-teams/dfst-docker > >>> > >>>My next task will be to create a container based on this one that > >>>includes > >>>specific configuration and the DFST Web application modules. Should be > >>>easy once I get to it. > >>> > >>>Cheers, > >>> > >>>E. > >>> > >>>---- > >>>Eliot Kimber, Owner > >>>Contrext, LLC > >>>http://contrext.com > >>> > >>> > >>> > >>> > >>>On 1/26/16, 9:48 AM, "Eliot Kimber" > >>><basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of > >>>ekimber(a)contrext.com> wrote: > >>> > >>>>OK, I'm going to proceed with making a generic basex Docker container > >>>>in > >>>>the DFST Docker project on GitHub. I'm using Andreas' as a starting > >>>>point > >>>>but it's pretty trivial. > >>>> > >>>>I'm working/testing on OS X, Windows, and CentOS so I should be able to > >>>>get something going. > >>>> > >>>>Cheers, > >>>> > >>>>E. > >>>>---- > >>>>Eliot Kimber, Owner > >>>>Contrext, LLC > >>>>http://contrext.com > >>>> > >>>> > >>>> > >>>> > >>>>On 1/26/16, 2:02 AM, "Christian Grün" <christian.gruen(a)gmail.com> > >>>>wrote: > >>>> > >>>>>Hi Eliot, > >>>>> > >>>>>Personally, I had a hard time making Docker work on Windows machines, > >>>>>but we have various Docker aficionados in our team and around, so I > >>>>>hope they¹ll give you some feedback soon. > >>>>> > >>>>>Cheers, > >>>>>Christian > >>>>> > >>>>> > >>>>>On Sun, Jan 24, 2016 at 8:22 PM, Eliot Kimber <ekimber(a)contrext.com> > >>>>>wrote: > >>>>>> I'm working toward using BaseX in a Docker container as part of the > >>>>>>DITA > >>>>>> for Small Teams project (we're trying to set up a system of Docker > >>>>>> containers with all the DFST parts integrated out of the box). > >>>>>> > >>>>>> I notice that Andreas Jung has create a simple container here: > >>>>>> > >>>>>> https://github.com/zopyx/docker-basex > >>>>>> > >>>>>> And pushed it to the Docker Hub in the basex namespace. > >>>>>> > >>>>>> I'm wondering what the relationship of this is, if any, to any > >>>>>>official > >>>>>> BaseX Docker support? > >>>>>> > >>>>>> Thanks, > >>>>>> > >>>>>> Eliot > >>>>>> ---- > >>>>>> Eliot Kimber, Owner > >>>>>> Contrext, LLC > >>>>>> http://contrext.com > >>>>>> > >>>>>> > >>>>>> > >>>>>> > >>>>> > >>>> > >>>> > >>>> > >>> > >>> > >>> > >> > >> > > > >

1 0

Re: [basex-talk] Unrecognized Options Running Basex in Docker Container
by Eliot Kimber 28 Jan '16

28 Jan '16

Another bit of info. If I interact with the server from within the container, e.g., connect to the basex server using the basexclient, I can set and get options but they are not reflected in the DBA app: > open test-02 Database 'test-02' was not found. [I then create test-02 using the DBA Web app to prove I'm talking to the same server] > open test-02 Database 'test-02' was opened in 0.68 ms. > set chop false CHOP: false > get chop CHOP: false But if I refresh the page for test-02 in the DBA app, it still shows a check for chop. So something seems to be up with local options. I verified that I can add data to the database itself. Thanks, E. ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com On 1/28/16, 6:10 PM, "Eliot Kimber" <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: >I'm seeing a difference in how the .basex file is processed between >running a server under OS X directly and running it in a Docker container. >In particular, my local settings are being rejected as unrecognized. > >Here's the startup messages from within the basex container: > >basex@611404b26b04:~$ basexhttp >/home/basex/.basex: Unknown option 'CATFILE'. >/home/basex/.basex: Unknown option 'DTD'. >/home/basex/.basex: Unknown option 'SKIPCORRUPT'. >/home/basex/.basex: Unknown option 'CHOP'. >/home/basex/.basex: writing new configuration file. >[main] INFO org.eclipse.jetty.server.Server - jetty-8.1.17.v20150415 >[main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP >Support for /, did not find org.apache.jasper.servlet.JspServlet >BaseX 8.3 [Server] >Server was started (port: 1984). >[main] INFO org.eclipse.jetty.server.AbstractConnector - Started >SelectChannelConnector@0.0.0.0:8984 >HTTP Server was started (port: 8984). > >I verified that with the same .basex file running 8.3 under OS X the >options are recognized and set as expected. > > >What would cause this difference in behavior? > >Here is the .basex file in the /home/basex directory when the server >starts: > >USER = admin >PASSWORD = admin >DEBUG = false >DBPATH = /home/basex/basex/data >REPOPATH = /home/basex/basex/repo >LANG = English >LANGKEYS = false >GLOBALLOCK = false > > ># Client/Server Architecture >HOST = localhost >PORT = 1984 >SERVERPORT = 1984 >SERVERHOST = >PROXYHOST = >PROXYPORT = 0 >NONPROXYHOSTS = >IGNORECERT = false >TIMEOUT = 30 >KEEPALIVE = 600 >PARALLEL = 8 >LOG = true >LOGMSGMAXLEN = 1000 > > ># HTTP Services >WEBPATH = /home/basex/basex/webapp >RESTPATH = >RESTXQPATH = >CACHERESTXQ = false >HTTPLOCAL = false >STOPPORT = 8985 >AUTHMETHOD = Basic > > ># Local options >CATFILE = /opt/dita-ot/DITA-OT/catalog-dita.xml >DTD = true >SKIPCORRUPT = true >CHOP = false >-- (this is the end of the file) -- > > >After the server starts the offending options are omitted from the >rewritten .basex file. > >The only difference I can think of is the Java version. The container uses >the OpenJDK while I have Oracle Java running in OS X: > >basex@611404b26b04:~$ java -version >openjdk version "1.8.0_66-internal" >OpenJDK Runtime Environment (build 1.8.0_66-internal-b17) >OpenJDK 64-Bit Server VM (build 25.66-b17, mixed mode) >basex@611404b26b04:~$ > >But otherwise it's exactly the same code running in both environments and >the same config file. > >Thanks, > >Eliot > >---- >Eliot Kimber, Owner >Contrext, LLC >http://contrext.com > > > >

1 0

bitmaps/binaries of variables
by Rob Stapper 27 Jan '16

27 Jan '16

Hi, Is it somehow possible to get the bitmap/binary of a $variable or a bitmap/binary-overlay of a $variable in BaseX? Since there is no bitmap-datatype I guess it is probably not possible or straight forward but BaseX continues to surprise me (in a positive manner). So maybe? TIA for any reply, Rob Stapper

2 3

get and extract .gz files from web
by Marc van Grootel 27 Jan '16

27 Jan '16

Hi, I hoped that I could use archive module to also extract gzipped files. I need to fetch/sync large XML from a web service that has the option of getting files with gzip encoding (to be nice to the web server). First attempt was to explicitly get the gz file via the URL and then treat it like an archive binary (extracting it with the recipe from the archive module page). The entries XML I get is empty so I suppose that I cannot read .gz Second attempt was to specify Accept-Encoding = gzip which indeed delivers the XML as a binary. But I probably run into the same issue when trying to extract. Is there a way to do the extraction of .gz encoded files without having to shell out to some kind of unzipper? Cheers, --Marc

4 5

Status of BaseX Docker Container?
by Eliot Kimber 26 Jan '16

26 Jan '16

I'm working toward using BaseX in a Docker container as part of the DITA for Small Teams project (we're trying to set up a system of Docker containers with all the DFST parts integrated out of the box). I notice that Andreas Jung has create a simple container here: https://github.com/zopyx/docker-basex And pushed it to the Docker Hub in the basex namespace. I'm wondering what the relationship of this is, if any, to any official BaseX Docker support? Thanks, Eliot ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com

2 4

Re: [basex-talk] Connecting database in C#
by Bhander, Gurbakhash S. 26 Jan '16

26 Jan '16

Hi, I'm Raj working for the U.S. EPA. I'm building an interface on the basex database. I would like to connect the database with one of my grid and charts. How can I connect this database with Grid Components using C#. Do you have any example? Thank you - Raj ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Dr. Gurbakhash S. Bhander, Env. Eng. Air Pollution Technology Branch, E305-01, National Risk Management Research Laboratory, U.S. Environmental Protection Agency, 109 T.W. Alexander Drive, Research Triangle Park, NC 27711 Phone: 919-541-7542 Cell: 919-710-1947 Fax: 919-541-0554 bhander.gurbakhash(a)epa.gov<mailto:bhander.gurbakhash@epa.gov> :) "Start every day off with a smile and get it over with" :) W. C. Fields

2 1

500 Error when using org.basex.modules.fop.FOP
by Chris Speare 26 Jan '16

26 Jan '16

I've been working with Apache FOP for converting XML (held on a BaseX instance) to PDF. Currently this involves saving nodes from the BaseX database to pass into a local FopFactory - not ideal. Have tried to pull one of the documents out and get a 500 error, then tried referencing direct files - which also errors: import module namespace fop = 'org.basex.modules.fop.FOP'; let $xml := db:open('billing_run_435')/CommercialDocument[@id="203545"] - if returned does show xml let $xsl := xslt:transform('/home/chris/Downloads/xml/billing_invoice_241040.xml', '/etc/xmlmapper/pdf_invoice.fo') - hard coded for debugging return $xml >From the log: Version: BaseX 8.3.1 Java: Oracle Corporation, 1.7.0_25 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:110) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:59) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:37) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:64) at org.basex.query.QueryContext.value(QueryContext.java:423) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:187) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:95) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.query.func.StandardFunc.cache(StandardFunc.java:404) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:129) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:59) at org.basex.query.func.xquery.XQueryEval.iter(XQueryEval.java:44) at org.basex.query.func.fn.FnSerialize.item(FnSerialize.java:22) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:43) at org.basex.query.QueryContext.iter(QueryContext.java:412) at org.basex.query.expr.IterMap$1.next(IterMap.java:42) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.query.func.StandardFunc.cache(StandardFunc.java:404) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:129) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:59) at org.basex.query.func.xquery.XQueryEval.iter(XQueryEval.java:44) at org.basex.query.expr.TypeCheck.iter(TypeCheck.java:87) at org.basex.query.QueryContext.iter(QueryContext.java:412) at org.basex.query.expr.If.iter(If.java:128) at org.basex.query.MainModule.iter(MainModule.java:110) at org.basex.query.QueryContext.iter(QueryContext.java:351) at org.basex.http.restxq.RestXqResponse.create(RestXqResponse.java:55) at org.basex.http.restxq.RestXqModule.process(RestXqModule.java:101) at org.basex.http.restxq.RestXqFunction.process(RestXqFunction.java:109) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:44) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) Both '/home/chris/Downloads/xml/billing_invoice_241040.xml' and '/etc/xmlmapper/pdf_invoice.fo' exist as I use them in a local java fopfactory which processes them fine. The information contained in the email and any files transmitted with it is confidential and intended for the addressee only. If you have received this email in error please accept our apologies and notify the originator. Any disclosure, copying, distribution or any other use of this communication is strictly prohibited and may be unlawful. We reserve the right to monitor and intercept communications for lawful business purposes. Wireless Innovation Ltd , Unit D2, Churcham Business Park, Churcham, Gloucestershire, GL2 8AX, Great Britain. Company Registration Number 5240202, Place of Registration Companies House Cardiff.

2 2

Command script to create a coollection and perform multiple queries on it
by michele.greco2＠email.it 26 Jan '16

26 Jan '16

Hi, let me now if i can create a collection of basex, add more XML files in it and then make the collection more queries already created earlier. I thank you in advance for your answer. Michele -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Registra i domini che desideri ed inizia a creare il tuo sito web Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13323&d=25-1

2 1

[FOUT1170] Static Base URI is undefined.
by Andy Bunce 26 Jan '16

26 Jan '16

Hi, Using the latest 8.4 beta: the following code runs ok in the GUI *unparsed-text("http://www.xqueryfunctions.com/xq/functx-1.0-doc-2007-01.xq <http://www.xqueryfunctions.com/xq/functx-1.0-doc-2007-01.xq>")* But when run from the web /dba/queries gives the FOUT1170 error*.* $href looks like an absolute URI to me [1] /Andy [1] https://www.w3.org/TR/xpath-functions-31/#func-unparsed-text

2 3

Slow XQueries on a quite small database but great number of docs
by ansel.jm＠free.fr 25 Jan '16

25 Jan '16

Hello, I have a speed problem with a quite simple query (2 flwor nested) on the database below. (almost 20.000 ms !!!) The great number of docs (1200) seems to slow down the database. But the resulting database is quite small (689kB) so I'm really disappointed... If someone has an idea, it would be nice... P.S. : I tried OPTIMIZE, CREATE INDEX... Nothing will work... Thank you in advance. JMA > info db Database Properties Name: ect Size: 894 KB Nodes: 20656 Documents: 1210 Binaries: 0 Timestamp: 2016-01-25T13:34:28.000Z Resource Properties Timestamp: 2016-01-21T16:45:12.938Z Encoding: UTF-8 CHOP: true Indexes Up-to-date: true TEXTINDEX: true ATTRINDEX: true TOKENINDEX: true FTINDEX: true TEXTINCLUDE: ATTRINCLUDE: TOKENINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: false AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96 INDEXSPLITSIZE: 0 FTINDEXSPLITSIZE: 0 > exit for $intervenant in ("AB","JMA","MM","SP") return element {"planning"} { attribute inter {$intervenant}, for $s in db:open("ect")/calendrier/s let $lundiS12015 :=db:open("ect")/calendrier/mois[@annee = $s/@annee and @numero='01']/debut let $nbjours :="P" || string(( $s - 1 ) * 7) || "D" let $lundi := xs:date($lundiS12015) + xs:dayTimeDuration($nbjours) let $dimanche := xs:date($lundi) + xs:dayTimeDuration("P6D") return element {'semaine'} { attribute no {$s}, attribute lundi {$lundi}, attribute dimanche {$dimanche}, for $tache in db:open("ect")/planning/tache[intervenant=$intervenant and (debut/text()) and (fin/text()) and (xs:date($lundi) lt xs:date(fin) ) and (xs:date(debut) lt xs:date($dimanche))] let $res := tokenize(base-uri($tache),'/') let $nodossier := substring($res[2],1,3) let $typedossier := substring($res[2],4,2) return element {'inter'} {$res[2] , db:open("ect")/dossier[numero=$nodossier and type=$typedossier] , $tache/libelle, $tache/debut, $tache/fin} } }

2 1

BaseX, DITA and DOCTYPE
by Stefan Popovic 22 Jan '16

22 Jan '16

Hi all, I can’t seem to find any information about how to keep the DOCTYPE when uploading files to a BaseX server. Here’s the situation: 1. We use oXygen and we edit DITA files. 2. We want to use an XML native database, therefore we’re considering BaseX. 3. When importing files in a BaseX server, the DOCTYPE is dropped. 4. However, oXygen needs the DOCTYPE for editing DITA files. Specifically, I am wondering if there is a BaseX server-side setting that would keep the DOCTYPE when uploading a file. Many thanks for your help, Stefan

2 1

XML Prague » User Meeting » Feb 11, 2016 » Join us!
by Christian Grün 22 Jan '16

22 Jan '16

Hi everyone, Once again, I would like to remind you of our BaseX User Meeting in Prague. It will take place on February 11 (Thursday), 10:00 to 13:00. This time, we are more than happy to have eight talks for you: _ SESSION I, 10:00 ___ 1. BaseX 8.4: The Latest Updates. Christian Grün, BaseX GmbH, Konstanz 2. The Power of Promises and Parallel XQuery Execution. James Wright, Denver, Colorado 3. BaseX for linguistic research: transforming the Latin Dependency Treebank into Universal Dependencies. Giuseppe G. A. Celano, Humboldt Chair for Digital Humanities, Leipzig, Germany 4. Isilex, an Easy-To-Deploy Basex CMS for Collaborative XML Databases Projects. Xavier-Laurent Salvador, Paris 13 University, France _ SESSION II, 12:00 ___ 1. BaseX – A Swiss Army Knife for Broadcast Subtitles. Andreas Tai, IRT, Munich 2. Maximilian Gärber, axxepta solutions GmbH, Lindau 3. Extending XQuery with User-Defined Datatypes. Rob Stapper; Borne, Netherlands 4. DITA For Small Teams: Implementing A Sophisticated Hyperdocument Management Application using XQuery and BaseX. Eliot Kimber, Contrext, LLC. Austin, Texas, USA ______________________________ You can find more information on Lanyrd and the XMLPrague conference site: http://lanyrd.com/2016/basex/ http://xmlprague.cz/ Hope to see many of you soon, Christian BaseX Team, 2016

4 4

XQPool
by Chris Speare 20 Jan '16

20 Jan '16

Have been trying to look at connection pooling due to requests of documents taking 1 second to pull - when I have 36000 documents to pull down for processing this is too slow. Some examples mention BaseXConnectionPoolXQDataSource with XQJ Connection Pool, however that seems to been in beta, last updated 02/2014 and the jar file is corrupt. Whilst this isn't under the control of BaseX is there any advice of a newer version, or recommendations for handling connection pools. I have a java service which is running 10 threads which pull from a queue of "request jobs" which involve pulling a document from a BaseX database, then loading into an in memory instance for further querying. This way I am able to pass around sections of the document as I drill down into it (iterating over nodes for processing) which is too slow to carry out through a server instance. Initially I attempted to create one connection to BaseX per thread, however this seemed even slower. Any advice welcome The information contained in the email and any files transmitted with it is confidential and intended for the addressee only. If you have received this email in error please accept our apologies and notify the originator. Any disclosure, copying, distribution or any other use of this communication is strictly prohibited and may be unlawful. We reserve the right to monitor and intercept communications for lawful business purposes. Wireless Innovation Ltd , Unit D2, Churcham Business Park, Churcham, Gloucestershire, GL2 8AX, Great Britain. Company Registration Number 5240202, Place of Registration Companies House Cardiff.

2 1

xquery:eval bug?
by Marc van Grootel 19 Jan '16

19 Jan '16

Hi, I'm trying to return a map or an array from xquery:eval. Seems this is not possible, yet the signature says it returns item()* xquery:eval('1 + 1') => 2 xquery:eval('[1,2]') => ERROR: [FOTY0014] Items of type array(*) have no string representation. xquery:eval('map { "x": 10 }') => ERROR: [FOTY0014] Items of type map(*) have no string representation. BTW: I saw that xquery:eval#3 is documented as returning item() while the other arities return item()* Tested on 8.3, haven't tested yet on 8.4beta but it's trivial to repro I figure. -- --Marc

4 7

Embedding BaseX in Clojure web app, pointers needed
by Marc van Grootel 19 Jan '16

19 Jan '16

Hi, I'm considering to write a web layer for BaseX based in Clojure. It may be a somewhat longer term project but I would like to bring XML and BaseX closer to Clojure programming. Clojure web apps usually are able to run under various servers/containers (Jetty/Netty etc.) and I would like to be able to use Clojure libraries to handle things like request routing, security and authentication outside of BaseX/XQuery. Some questions that I have while I'm orienting myself. Some of it touches on integration areas that are quite new to me so I am happy to get some general pointers that I can use to dig further. For Clojure I found only one BaseX client library [1] which wraps the standard Java TCP client and it seems to work fine. But I have some broader questions such as - Choosing between using the client or much more intimately embedding BaseX as a library. The latter is probably much more complex but I'm figuring this is the only way to get a good integration as the TCP client is rather limited in functionality. But where to start? What layers of the existing servlet integration to peel off, which ones to keep. Is BaseXServer.java a good starting point? - Is the TCP client generally slower than via the Java API? A couple of queries via clj-basex didn't impress me much qua speed (compared to same query via the GUI). Any starting points or general considerations that could help me prune the (re)search tree are very much appreciated. --Marc [1] https://github.com/kouphax/clj-basex

2 2

Streaming file loads
by Christophe Marchand 19 Jan '16

19 Jan '16

Hello ! We have to load many files (>20.000), large size (>30Gb) into BaseX. Today, that's done vis a BXS script which accesses files thru a network share. I would like to optimize network transfert ; tar / compression at source, uncompress / untar at destination. But I would like to avoid to create temporary files (at source, on NAS server, and on destination server, BaseX host). So, is there an API which I could use to load a "file" thru a stream ? I think I can write an inputstream that redirects data to outpustreams, cutting input data in many output streams, one per file. But may I chain this outputstream to an inputstream usable by BaseX loader ? Best regards, Christophe

2 1

Wiki Edits
by Christian Grün 18 Jan '16

18 Jan '16

In-between: Thanks to James, Jens, Arve, Constantine, Marco, Amanda, Patrick, Alex, ... for your edits in our Wiki! You alle are helping to make it a more and more comprehensive source for everyone working with BaseX.

2 1

Any (hopefully representative) reference korpora of XML-ish documents?
by Albretch Mueller 16 Jan '16

16 Jan '16

OASIS keeps an a interoperability corpus of ODF test documents https://www.oasis-open.org/committees/oic/charter.php Do you use of know of any large XML/-ish reference korpora which could be used for testing purposes? In case, you don't could you suggest where or how could one find such a thing? lbrtchx basex-talk@mailman.uni-konstanz.de:Any (hopefully representative) reference korpora of XML-ish documents?

2 1

ft:search and using thesaurus
by Günter Dunz-Wolff 16 Jan '16

16 Jan '16

Hi all, hi Christian, for a flexible search I want to use this programatic approach: let $ft := map { 'wildcards': true() } let $terms := 'Pa.*' for $city in ft:search('factbook', $terms, $ft)/parent::name[ancestor::city] let $hits := ft:mark($city[ft:contains(text(), $terms, $ft)]) return let $name := $city/ancestor::country/name return ($hits, $name) How could I integrate 'using thesaurus at "thesaurus.xml"', unfortunately thesaurus is not part of the $options argument of ft:search. Cheers, Günter

2 1

Security
by Finney, Tim 15 Jan '16

15 Jan '16

Hi Everyone, Sorry if this is a dumb question. What is a good way to do security in BaseX? I found a stub here: http://docs.basex.org/wiki/Security:_Use_Cases What I would like is to be able to restrict who can do what with a database. Here are a few things I'd like to be able to do: 1. Grant create, read, update, and delete permissions on each document in a database, and have a default mask for a database document. 2. Say whether a user can or cannot execute a function or visit a URL (and get something besides a 404). 3. Allow the creation of roles which can be assigned to users. (Having a particular role allows all users with that role to do particular things, like update docs, or visit particular URLs.) 4. No doubt there are more desiderata. E.g. one might conceivably want to be able to grant permissions at the node level within a document. Any pointers? Best, Tim Finney

2 1

XQERY Help
by Mansi Sheth 14 Jan '16

14 Jan '16

Hello, I need help with hopefully a simple XQUERY. I want to extend below XQUERY to run not on all documents in all databases, but only on those documents which contains "input string X" in its db:path (i.e. its original file name). Any help appreciated. declare variable $n as xs:string external; (: command line query, to be entered as "n" variable :) declare option output:item-separator "
"; (: Each element would be in new line :) (: Run input query, on every XML document in every Database:) let $queryData := for $db in db:list() (: Assign dynamic variables to generate query, to be used in eval :) let $query := "declare variable $db external; " || "db:open($db)" || $n return xquery:eval($query,map { 'db': $db, 'query': $n }) return distinct-values($queryData) - Mansi

2 1

How to get the complete list of full-text-index
by kleist 13 Jan '16

13 Jan '16

Hi all, hi Christian is there any way to get the complete list of the full-text-index? With the GUI I only get the first part: - Names: - Size: 5 MB - Entries: 23401 und 22662x der 20595x .... Thanks in advance. Best regards, Günter

3 6

BaseX 8.4 beta contains with collation
by Andy Bunce 13 Jan '16

13 Jan '16

Hi, Query: contains("aaa","ab", ' http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive ') Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.4 beta 1814d39 Java: Oracle Corporation, 1.8.0_45 OS: Windows 8.1, amd64 Stack Trace: java.lang.StringIndexOutOfBoundsException: String index out of range: 3 at java.lang.String.charAt(Unknown Source) at org.basex.query.util.collation.NoCaseCollation.indexOf(NoCaseCollation.java:35) at org.basex.query.util.collation.Collation.contains(Collation.java:123) at org.basex.query.func.fn.FnContains.item(FnContains.java:20) at org.basex.query.func.StandardFunc.optimize(StandardFunc.java:83) at org.basex.query.func.StandardFunc.compile(StandardFunc.java:76) at org.basex.query.MainModule.compile(MainModule.java:74) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:113) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:104) at org.basex.query.QueryContext.analyze(QueryContext.java:332) at org.basex.query.QueryContext.compile(QueryContext.java:318) at org.basex.query.QueryProcessor.compile(QueryProcessor.java:70) at org.basex.core.cmd.AQuery.query(AQuery.java:76) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.gui.GUI.exec(GUI.java:469) at org.basex.gui.GUI.access$4(GUI.java:422) at org.basex.gui.GUI$7.run(GUI.java:411)

2 1

Fulltext-Search: wildcards and thesaurus
by kleist 13 Jan '16

13 Jan '16

Hi all, hi Christian, is it possible to combine wildcards and thesaurus in a fulltext-search, for example: contains text "nachricht.*" using wildcards using thesaurus at "thesaurus.xml" Best regards, Günter

3 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk