- BaseX-Talk - mailman.uni-konstanz.de

Options for creating database...
by France Baril 20 Oct '17

20 Oct '17

Hi, I usually create dbs using the gui. I'm now trying to create asb without it to be able to set the updindex and autooptimize options, which I can't find in the GUI. I couldn't figure how to set them out using db:create either, so I switch to command line. Now I'm feeling dumb, I can't find how to set up parsing/indexing options for the command line. I'm looking at: http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and -wchop only. What am I missing? Here are all the options that I'd want to set: *let **$options* := *map:merge*(( *map:entry*("CHOP", *false*()), *map:entry*('INDENT', *false*()), *map:entry*('STRIPNS', *false*()), *map:entry*('INTPARSE', *true*()), *map:entry*('DTD', *false*()), *map:entry*('XINCLUDE', *false*()), *map:entry*('UPDINDEX', *true*()), *map:entry*('AUTOOPTIMIZE', *true*()) )) I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only want them to be true() on one of my DBs. Other DBs should remain as is. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Jobs, locking and doing large updates
by Omar Siam 18 Oct '17

18 Oct '17

Hi list! I was experimenting with the jobs module for the last weeks to speed up updates and to make them fit into less than 6 GB of memory. It does not work the way I expected. * Updating jobs don't seem to run in parallel even if they don't work with and lock the same database. Or do they start much later than I expected? * It seems to me there is an upper limit of jobs that can be queued (about 100?). I automatically started all of the update jobs but some updates did not run. The upside is: I can run my updates with just about 1 GB of memory which is much better for me. I work with dictionary like XML documents. They look like <root> <entry>Contents with further tags</entry> <entry>Contents with further tags</entry> <entry>Contents with further tags</entry> ... a few thousand more ... <entry>Contents with further tags</entry> <entry>Contents with further tags</entry> </root> I add or change larger parts of them and I also need to keep track of changes. So in a separate database there are old versions of entries with time stamps (@dt) like <hist> <entry dt="">Contents with further tags</entry> <entrydt="">Contents with further tags</entry> <entrydt="">Contents with further tags</entry> ... a few thousand more ... <entrydt="">Contents with further tags</entry> <entrydt="">Contents with further tags</entry> </hist> I tried to do everything at once and when I need to update most of my entries (about 30000) I exhaust my memory. So I use the jobs module to do this 100 at a time so the updates list does not grow beyond any reasonable size. Having those 100 as one transaction is good enough for my needs. Then I thought maybe I should use jobs to seprate the two tasks. One async job saves a memory (update) copy of the old entry, the other writes the new one. After some transformations to my XQuery BaseX told me they don't lock the same database or global. I expected the jobs running on different databases to work in parallel. They don't. I don't quite understand why. Also I have a much larger dataset split into a number of databases where it would be quite useful to execute updates in parallel. Am I missing something? Is this perhaps the wrong way to tackle this scaling problem? Best regards Omar Siam

2 2

AUTHMETHOD = Custom
by Dave Day 18 Oct '17

18 Oct '17

Greetings list, In the Basex configuration file, I added AUTHMETHOD = Custom After starting the server, the 1st response I get from the server when I connect to it is the realm:nonce values. In the Basex manual, it states for AUTHMETHOD _Specifies the default authentication method, which will be used by the HTTP server for negotiating__ __credentials. Allowed values are Basic, Digest, and Custom:_ _ With custom authentication, the server will not do any authentication._ Is it possible to connect to Basex server without going thru any authentication? Regards, -- Dave Day

3 7

Every query executed in dba Queries causes a global read lock
by Omar Siam 17 Oct '17

17 Oct '17

Hi list! Just discovered sth. unexpected: Every query executed in dba Queries causes a global read lock. Also other (very simple) queries using RESTXQ which use a DB explicit in the query are executed with a global read lock. Is this intentional? Is this just a side effect? I noticed that internally the code I run is wrapped in an xquery:eval. Maybe this causes this lock? Or does every RESTXQ cause a global read lock? I ran into this because I wanted to execute async code using this interface using the jobs module and then wait for the result. This of course locks up as soon as any access to data in dbs is attempted. Best regards Omar Siam

2 1

Verlosung+Umfrage: Essstörungen-eine Belastung für Freundschaften?
by Freunda＠students.uni-marburg.de 17 Oct '17

17 Oct '17

Liebe Kommilitonin, lieber Kommilitone, Du hast eine Freundin oder einen Freund, die/der (vermutlich) an einer Essstörung erkrankt ist? Im Rahmen unserer Abschlussarbeiten im Master-Studiengang Psychologie in der AG Kinder- und Jugendpsychologie (Betreuung: Prof. Dr. Hanna Christiansen) beschäftigen wir uns mit einem möglichen Unterstützungsangebot speziell für Freunde essgestörter Menschen. Um herauszufinden, an welchen Stellen welche Art von Unterstützung hilfreich wäre, führen wir eine anonyme Online-Befragung durch. Es dauert nur ca. 10 Minuten! Als Dankeschön für die Teilnahme verlosen wir fünf Amazon-Gutscheine im Gesamtwert von 100 Euro. Hier der Link zur Umfrage: www.soscisurvey.de/Hilfsangebot_Freunde/?r=UkoTK Mit Deiner Teilnahme würdest du einen wichtigen Beitrag zu diesem Projekt leisten und uns sehr helfen! Anika Knorn und Annika Freund

1 0

Incorrect result with negative 7-digit number from fn:format-number()
by Andrew Savikas 17 Oct '17

17 Oct '17

Hello, I'm struggling with some odd behavior while trying to format currency amounts. When the number is negative and 7-digits long, the picture string is not working properly. You should (I hope!) be able to replicate the issue in the GUI: format-number(-999999, "$#,##0") *Result:* -$999,999 <-- Expected Result format-number(-9999999, "$#,##0") *Result:* -$9999,999 <-- *Comma is in the wrong place* format-number(-99999999, "$#,##0") *Result:* -$99,999,999 <-- Expected Result Am I missing something here? Thank you!

2 2

404
by Xavier-Laurent SALVADOR 14 Oct '17

14 Oct '17

Hi List, a question I have in mind since a long time: I have a Basex serving multiple project sites behind Nginx Redirections. I wrote a servlet for 404 errors in web.xml: <error-page> <error-code>404</error-code> <location>/error404</location> </error-page> and a function: declare %rest:path("/error{$code}") %output:method("html") But if i try to get "http://www.bla.fr/xzxzxzxzxz", basex answers: "No function found that matches the request." How could I inhibit this behavior ? thanks ! -- Ce message peut contenir des informations réservées exclusivement à son destinataire. Toute diffusion sans autorisation est interdite. Si vous n'en êtes pas le destinataire, merci de prendre contact avec l'expéditeur et de détruire ce message. *This email may contain material for the sole use of the intended recipient. Any forwarding without express permission is prohibited. If you are not the intended recipient, please contact the sender and delete all copies*.

2 2

How to identify the error when create database is unsuccessful
by Dave Day 13 Oct '17

13 Oct '17

Greetings list, I'm getting the following error when I try to create a new database using the Basex gui on windows. "No text allowed before root element." This is the error I get if I set the parsing option to 'use internal XML parser'. If I uncheck that, I get "Content is not allowed in prolog." The file I am using as input does not have a prolog statement. If I look at the .log folder, there is nothing in there. I suspect that the FTP process I used (microsoft ftp command from a dos window) to move the data from an IBM mainframe to my desktop has done something to the file. Isn't there some way to turn on a diagnostic feature to see exactly what the parsing issue is? I don't see anything in the file before the root element using Notepad. Thanks for any help, -- Dave Day

1 1

proc:system ?
by jean-marc Mercier 13 Oct '17

13 Oct '17

Hello BaseX team, I am an extensive user of the proc:system BaseX command (and looking forward for proc:fork !). I am using this command with in-memory arguments, it means that my way of using it is : proc:system("my_exe", $my_arguments_for_exe) $my_arguments_for_exe is an xml node serialized to string by BaseX. As my test are getting more complex, the size of $my_arguments_for_exe are increasing. It seems that we are reaching a limit now, since the compiler refuses to pass arguments : "Stopped at CoDeFi_Interface.xqm, 44/22: [BXPR9999] Cannot run program "C:\Jiheme\scientifique\recherche\CoDeFi\CoDeFi\CoDeFi.exe": CreateProcess error=206, Nom de fichier ou extension trop long " Is there a way to bypass this ? Thank you for your answer, Cheers, Jean-Marc

2 2

changed by mailman admin
by changed by mailman admin 12 Oct '17

12 Oct '17

deleted by mailman admin on 2021-08-24

2 1

nagios probes for baseX
by Adil Hasan 10 Oct '17

10 Oct '17

Hello, does anyone know where I can find Nagios probes to for monitoring the status of the baseX server? Are there any that exist? Many thanks, adil

1 0

Storing SQL text as an XML element
by Dave Day 10 Oct '17

10 Oct '17

Greeting list, Is there anything 'special' that needs to be done to an SQL statement to save it as an XML element in BaseX? Create the element, move the text? What happens if the SQL has the "<" or ">" embedded within the text? Regards, -- Dave Day

2 2

HTTP module
by Giuseppe Celano 10 Oct '17

10 Oct '17

Hi, I am accessing a RESTful API via the following command: curl -F data=(a)example.txt -F tokenizer= -F tagger= -F parser= http://lindat.mff.cuni.cz/services/udpipe/api/process > example2.txt I am wondering what the best way is to do that in BaseX. The service also has a URL syntax, as shown in the following example: http://lindat.mff.cuni.cz/services/udpipe/api/process?tokenizer&tagger&pars…. <http://lindat.mff.cuni.cz/services/udpipe/api/process?tokenizer&tagger&pars….> I have tried: http:send-request(<http:request method='get' href='http://lindat.mff.cuni.cz/services/udpipe/api/process?tokenizer&tagger&…'/>) and works perfectly; but I was trying to put the body of the request in http:body, but it does not work: http:send-request(<http:request method='get' href='http://lindat.mff.cuni.cz/services/udpipe/api/process'> <http:body media-type ="string"> tokenizer&tagger&parser&data=Děti pojedou k babičce. Už se těší. </http:body> </http:request>) I could invoke the curl command in BaseX, but maybe there is a more elegant way to send the content of the file (than adding it to the URL). Thanks. Ciao, Giuseppe Universität Leipzig Institute of Computer Science, Digital Humanities Augustusplatz 10 04109 Leipzig Deutschland E-mail: celano(a)informatik.uni-leipzig.de E-mail: giuseppegacelano(a)gmail.com Web site 1: http://www.dh.uni-leipzig.de/wo/team/ Web site 2: https://sites.google.com/site/giuseppegacelano/

4 10

Strange compilator behavior ?
by jean-marc Mercier 09 Oct '17

09 Oct '17

Hello BaseX team ! I lost some time to detect an error in my code, and wonder if there is a minor bug into the BaseX compiler. Here is the test let $elt as element(*)*:= <universe id="yolo"></universe> for $d in (1 to 1) return let $idd := $elt[d]/@id return ($elt[$d]/@id,$idd) output : id="yolo". (Hence missing the second "yolo", because the correct query is : let $idd := $elt[$d]/@id) However I can't figure out why the BaseX compiler ran this query ? Shouldn't it refused the compilation and point out this error ? Cheers, Jean-Marc

2 4

Directory from which xml files are loaded
by helmut 08 Oct '17

08 Oct '17

Hi everyone. I am using basex in embedded mode. I set the basex base directory with System.setProperty("org.basex.path", path). In this path I have a .basexhome file which defines REPRO, DBPATH ... and so on. For loading an xml file to the database I use e.g. new Add(path, file).execute(context). "file" is given as an absolute path. However, when I query the database I get the error [FODC0002] Resource 'path/xyz.xml' does not exist, with a path which points now to my the system property user.home or user.dir. How can I change this behaviour? What I am missing? I don't want to change user.home or user.dir, because other things might depend on the properties. I read through the configuration guide and many other pages, but didn't find something. http://docs.basex.org/wiki/Configuration Thanks very much, Helmut

3 3

Session Time Out
by Navin Rawat 06 Oct '17

06 Oct '17

Hi Everyone, I just want to know, what is the session time out of BaseX? Is there any API by which I can find out expire time of the session and how can I increase the session time out. Regards, Navin

2 1

put with relative uri
by Andy Bunce 06 Oct '17

06 Oct '17

Hi, I notice fn:put() appears to be resolving uris relative to the working directory, as the file module does, rather than static-base-uri() as fn:doc() does. I dont think it was always like this and it seems to against the intent of the spec[1]? /Andy [1] The external effects of upd:put are implementation-defined, since they occur outside the domain of XQuery. The intent is that, if upd:put is invoked on a document node and no error is raised, a subsequent query can access the stored document by invoking fn:doc with the same URI. https://www.w3.org/TR/xquery-update-10/#id-upd-put fn:put(<a/>"test.xml") --------------------------- fn:doc("test.xml") (: [FODC0002] Resource 'C:/.../test.xml' does not exist. :)

2 1

Re: [basex-talk] Why am I getting this error with the prolog statement
by Christian Grün 04 Oct '17

04 Oct '17

Hi Dave (cc to the list), > I am creating xml on an IBM mainframe. The code page used on mainframes > is defined as EBCDIC 0037. https://en.wikipedia.org/wiki/EBCDIC_037 As EBCDIC 0037 is limited to 256 characters, a simple mapping should suffice to convert your text to ISO-8859-1 (see the mapping table in the Wikipedia entry you referenced). It should be lightning fast, no matter if you do it in assembler or in XQuery. Hope this helps, Christian

3 2

Why am I getting this error with the prolog statement
by Dave Day 02 Oct '17

02 Oct '17

Hello list. Another newbie question. I am creating a file in UTF-16, Big-endian. I am putting a 2 byte BOM sequence of x'FEFF' as the 1st two bytes, followed by a prolog statement identifying this as UTF-16 code. I then ftp this file to my desktop in binary to maintain the encoding. Below is a cut-n-paste of the 1st few bytes as it looks on the mainframe box. --------------------------- Ú.<?xml encoding="UTF-16" ?> FF46A9948989889877EEC6FF7466 EFCF743055364957EF436016F0FE The way the display is within ISPF, each byte has one character on two lines, so the 1st byte, FE should be read as col 1 of both lines, and so forth. When I try to create a new database I get the following from Basex. Command: CREATE DB d100217 :zxpf.ftp.download/apf1.v2r3.xmldata Error: "d100217.xml" (Line 1): Content is not allowed in prolog. Help greatly appreciated. Regards, Dave Day

3 3

Moving on to Java 8!
by Christian Grün 28 Sep '17

28 Sep '17

Thanks everyone for your feedback! I got replies from users who are still stuck to older versions of the JRE (even Java 6 and, thus, BaseX 7.9 is still used), but it seems that the majority of you is looking forward to the upgrade. I am glad to report that the first Java 8 snapshot is available for testing now [1]. Please don’t hesitate to give it a try. Have fun, Christian [1] http://files.basex.org/releases/latest/

1 0

Moving on to Java 8?
by Christian Grün 27 Sep '17

27 Sep '17

Dear all, Java 9 has just been released. As you may know, the BaseX code base is still compatible with Java 7, because version 7 is still used in the wild (we even got various user complaints when we upgraded from Java 6 just a few years ago). There are several reasons why we will move along to Java 8 in the near future: * It is more and more unsafe to use Java 7, because Oracle has stopped support two years ago. * From the developer point of view, there are only advantages when working with more recent versions of a software: newer language features and standard libraries can be used, the code base can be reduced, etc. * We would like to switch to the newest version of Jetty, which requires Java 8. Before we approach further, we are interested in hearing your reactions: Do you still work with Java 7? Would some of you require longtime support for Java 7? Thanks in advance and all the best, Christian

5 4

BaseX continuous integration
by Tim Thompson 27 Sep '17

27 Sep '17

Hello, Does anyone have an example they could share of an app using the BaseX Unit Module deployed on a continuous integration server (preferably Travis CI)? Thanks in advance. Tim -- Tim A. Thompson Discovery Metadata Librarian Yale University Library

1 0

Re: [basex-talk] pyBaseX url
by Bridger Dyson-Smith 26 Sep '17

26 Sep '17

Hi Andreas, On Sep 26, 2017 10:48, "Andreas Doering" <ado(a)zurich.ibm.com> wrote: Hello all, I want to use BaseX in a python environment and found PyBaseX by Luca Lilianas. Unfortunately, the email address associated with github does not seem to exist. What is not clear to me how the url has to be formatted. I tried 'http://localhost:1984:/rest/' but got timeouts. Have you tried 'http://localhost:1984/rest/'; e.g. removing the trailing ':'? I started a basexserver (with default port/user/password) and I can create and work with my example database with the the textual client from BaseX. But I could not find out how I have to format the url parameter so that the python interface works. I created a client by c = BaseXClient('http://localhost:1984:/rest/',default_database= None,user='admin',password='admin') c.connect c.create_database('TestName') The last line hangs in socket read. The log file does not show anything of that. Furthermore, it seems, that the current code in github is python2 specific, or maybe some package it depends on. I remember that during installation on python3 something broke, so I am using python2 in the moment. Any plans to port to python3? Regards, Andreas I can't speak to the python3 question, apologies. Best, Bridger

2 1

pyBaseX url
by Andreas Doering 26 Sep '17

26 Sep '17

Hello all, I want to use BaseX in a python environment and found PyBaseX by Luca Lilianas. Unfortunately, the email address associated with github does not seem to exist. What is not clear to me how the url has to be formatted. I tried 'http://localhost:1984:/rest/' but got timeouts. I started a basexserver (with default port/user/password) and I can create and work with my example database with the the textual client from BaseX. But I could not find out how I have to format the url parameter so that the python interface works. I created a client by c = BaseXClient('http://localhost:1984:/rest/ ',default_database=None,user='admin',password='admin') c.connect c.create_database('TestName') The last line hangs in socket read. The log file does not show anything of that. Furthermore, it seems, that the current code in github is python2 specific, or maybe some package it depends on. I remember that during installation on python3 something broke, so I am using python2 in the moment. Any plans to port to python3? Regards, Andreas

1 0

map behavior ?
by jean-marc Mercier 26 Sep '17

26 Sep '17

Hello BaseX team, It has been a while since I last wrote to this mailing list ! Happy to report again :) I have a strange behavior concerning map, it doesn't seem to sort as I expected. Is there any explanation ? let $map as map(xs:double,xs:string) := map:merge(( map:entry(xs:double(0.1), "Sunday"), map:entry(xs:double(5.0), "Thursday"), map:entry(xs:double(2.0), "Monday"), map:entry(xs:double(3.0), "Wednesday"), map:entry(xs:double(0.5), "Tuesday"), map:entry(xs:double(6.0), "Friday"), map:entry(xs:double(7.0), "Saturday") )) return $map output : map { 2: "Monday", 3: "Wednesday", 5: "Thursday", 6: "Friday", 7: "Saturday", 0.1: "Sunday", 0.5: "Tuesday" } Cheers

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk