- BaseX-Talk - mailman.uni-konstanz.de

BaseX 8.4: The XML Prague 2016 Edition
by Christian Grün 08 Feb '16

08 Feb '16

Dear all, Aligned with the XML Prague 2016 Conference, we are more than happy to provide you with a great new version of BaseX, your XML database system and XQuery processor! These are the new features: GUI - Project View: all modules of the project are now parsed in the background - Create Database, Properties: easy access to advanced database options - Sort Dialog: order by column positions and locale collation INDEXING - New Token Index: speedy token lookups in DITA and HTML documents - Including full support for incremental and main-memory databases - XQuery optimizations for fn:contains-token, fn:tokenize, fn:idref WEB APPLICATIONS - Cancel server-side queries via %rest:single annotation - DBA query editor: faster querying, better responsivity XQUERY - Database Module: ADDCACHE support (caching of large results) - Direct output of binary data with new 'basex' serialization method - Better XQuery 3.1 compliance: string constructors, new functions - Java bindings: address specific Java function signatures - User Module: create users and grant permissions in one step DOCUMENTATION - Many Wiki articles have been revised and updated A big thank you to our sponsors, which made some new features possible and available to everyone, and a special shout-out to Jens Erat, who realized the new token index! Visit http://basex.org to find the latest release. We are looking forward to your feedback, Christian BaseX Team

1 0

XProc 2 ...
by Marco Lettere 07 Feb '16

07 Feb '16

Hi all, sorry for the small OT but this sounds really interesting: http://lists.xml.org/archives/xml-dev/201602/msg00001.html Another reason why I should have been there ... :-(. Anyone from the BaseX community planning to look into it? Ciao, M.

3 2

Output from BaseX 8.4 GUI contains invalid characters
by Matti Lassila 07 Feb '16

07 Feb '16

Hello, I noticed that the current snapshot of BaseX GUI (8.4 beta 1e13ab6) generates erroneus values to the end of the result when the result is saved via Save-button. Using the same data with BaseX 8.3.1 GUI gives a clear output without errors. Strangely, When the result is cut-and-pasted, erroneous values are not included. I included erroneus and correct output files. I'm running OSX 10.11.2 but this happens also in Ubuntu 14.04. Best regards, Matti Lassila

2 1

Re: [basex-talk] XProc 2
by Christophe Marchand 05 Feb '16

05 Feb '16

Hello ! We have used XProc on a project, where we pipeline many XSL. XProc 1 is difficult to learn, and so very expensive to maintain. We have quit XProc and write our own xsl-pipeline tool, which is much simpler to use, and quite more quick. But it only covers XSL pipelining, and no other rich features that are present in XProc. So, I am very interested in this new version, but won't be there, for date constraints. Best regards, Christophe Le 05/02/2016 12:00, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Hi all, > sorry for the small OT but this sounds really interesting: > > http://lists.xml.org/archives/xml-dev/201602/msg00001.html > > Another reason why I should have been there ... :-(. > Anyone from the BaseX community planning to look into it? > > Ciao, > M. > > > ------------------------------ > > Message: 3 > Date: Fri, 5 Feb 2016 10:19:36 +0100 > From: Marc van Grootel <marc.van.grootel(a)gmail.com> > To: Marco Lettere <marco.lettere(a)dedalus.eu> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] XProc 2 ... > Message-ID: > <CA+bQNCss6ELfR8ohpPNMYCzSc2ToOEEJAAiyFUNWBrY1Cfj0yg(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Well, I looked at it for a bit when Norm demonstrated his XProc > "dialect" as he called it on his laptop at XML Amsterdam. Looked > really good. > > I think this is a good thing. I always found XProc a fantastic idea > but never got into it. Tried some simple things but found it too much > work and didn't wrap my head around it enough. It just didn't gel. The > XML is not helping in the case of XProc. I already went through > something like this going from Ant to Gradle where you can write your > builds in Groovy. Maybe XProc is on the same route and it becames a > library of functions that we can put together using XQuery. > > Definitely going to look into it again. > > Cheers, > --Marc > >

1 0

Fwd: Re: BaseX, Zorba, e-mail module
by Christian Grün 05 Feb '16

05 Feb '16

Hi Vincent, Sorry, I overlooked that my mail with the sources did not reach the list. Here it is. Christian ---------- Weitergeleitete Nachricht ---------- Von: "Christian Grün" <christian.gruen(a)gmail.com> Datum: 23.09.2015 3:51 nachm. Betreff: Re: [basex-talk] BaseX, Zorba, e-mail module An: "Tim Thompson" <timathom(a)gmail.com> Cc: > Is there an XSD for the e-mail document format being used? (And this module > is compatible with the BaseX open source license, correct?) No, sorry, there is no XSD available. However, you are invited to create one; I have attached the Java sources to this mail, which should contain all information you need. The Java code is based on the standard Java JavaMail API [1,2]. Hope this helps, Christian [1] http://www.oracle.com/technetwork/java/javamail/index.html [2] https://java.net/projects/javamail/pages/License > Tim A. Thompson > Metadata Librarian (Spanish/Portuguese Specialty) > Princeton University Library > > > On Wed, Sep 23, 2015 at 3:24 AM, Christian Grün <christian.gruen(a)gmail.com > > wrote: >> >> Hi Tim, >> >> We have implemented an XQuery/Java e-mail module quite some time ago, >> which we are using in various commercial projects. The main reason why >> we didn't make it public yet is that we didn't have time to document >> it properly. I have just uploaded this module, and you can install it >> via: >> >> repo install >> http://files.basex.org/modules/org/basex/modules/email/EMail.jar >> >> The jar file contains two simple example for sending mails (in the >> xquery sub-directory). >> >> Looking forward to your feedback. >> Christian >> ___________________________________ >> >> On Wed, Sep 23, 2015 at 7:04 AM, Tim Thompson <timathom(a)gmail.com> wrote: >> > Hello, >> > >> > I would like to be able to send e-mail from a Web app I am developing in >> > BaseX and was wondering whether anyone else had implemented this >> > functionality (or whether a BaseX e-mail module might be in the works?). >> > >> > I see that Zorba has an e-mail module with support for SMTP and IMAP >> > (not to >> > mention many other useful modules), which leads me to wonder whether >> > anyone >> > has worked on a BaseX connector for Zorba. >> > >> > In the meantime, I decided to try using the BaseX process module to call >> > Zorba, like so: >> > >> > proc:system( >> > 'zorba', ( >> > '-q', convert:binary-to-string( >> > db:retrieve( >> > 'out', 'email.xq' >> > ) >> > ) >> > ) >> > ) >> > >> > I stored the XQuery code for Zorba as a raw file in the BaseX database, >> > since storing it in the webapp directory caused an error, due to the >> > unrecognized Zorba module declarations. This approach seems to work >> > adequately, but does anyone have any suggestions for improvement, or a >> > different approach? >> > >> > Thanks in advance, >> > Tim >> > >> > >> > -- >> > Tim A. Thompson >> > Metadata Librarian (Spanish/Portuguese Specialty) >> > Princeton University Library >> > > >

1 0

BaseX, Zorba, e-mail module
by Tim Thompson 05 Feb '16

05 Feb '16

Hello, I would like to be able to send e-mail from a Web app I am developing in BaseX and was wondering whether anyone else had implemented this functionality (or whether a BaseX e-mail module might be in the works?). I see that Zorba has an e-mail module with support for SMTP and IMAP (not to mention many other useful modules), which leads me to wonder whether anyone has worked on a BaseX connector for Zorba. In the meantime, I decided to try using the BaseX process module to call Zorba, like so: proc:system( 'zorba', ( '-q', convert:binary-to-string( db:retrieve( 'out', 'email.xq' ) ) ) ) I stored the XQuery code for Zorba as a raw file in the BaseX database, since storing it in the webapp directory caused an error, due to the unrecognized Zorba module declarations. This approach seems to work adequately, but does anyone have any suggestions for improvement, or a different approach? Thanks in advance, Tim -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library

3 4

Multithread lock
by Bondeson, Carl 04 Feb '16

04 Feb '16

I have a highly multithreaded application that uses BaseX as a translation/transformation engine. It has been functioning in production for almost a year. From time to time I see the following in the nightly report the application generates which is sent from the server hosting the application. It requires a restart of JBoss, used as the application server. Any ideas? Name: Embedded EIP BaseX Server Thread : blocked Blocked on: java.net.SocksSocketImpl@5915a689 Blocked by: 1428 (Thread-1368) Blocked Count: 1 Lock Info: java.net.SocksSocketImpl@5915a689 Stack Trace: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:194) java.net.ServerSocket.implAccept(ServerSocket.java:545) java.net.ServerSocket.accept(ServerSocket.java:513) org.basex.BaseXServer.run(BaseXServer.java:142) com.pilotfish.eip.basex.BaseXServerRunner$1.run(BaseXServerRunner.java:93) java.lang.Thread.run(Thread.java:745) Name: C3P0PooledConnectionPoolManager[identityToken->2szqjh9e17wbsc31kua7k9|58166f21]-HelperThread-#2 : timed_waiting Thank you Carl R Bondeson Systems Developer Department of Public Health Data Processing 410 Capitol Ave Hartford, CT 06134 Phone: 860-509-7434 carl.bondeson(a)ct.gov<mailto:carl.bondeson@ct.gov> [logosmall]

3 11

Rép: Re: Rép: Re: Slow XQueries on a quite small database but great number of docs
by ansel.jm 02 Feb '16

02 Feb '16

Hi I don't know why but the problem is present even with the basex simple client (not client/server ). It seems java (tried many versions) doesn't execute normally : display or computation is halting, jolting.... The result of the query is quite fast but the display of the result very very halting. I'm on a readynas server running on an ARM processor. I think the io library of java (buffered io or something like that) has a problem. I'm very disappointed because that database seems very well adapted for my project... Jm Christian Grün <christian.gruen(a)gmail.com> a écrit : >> I can't run the GUI, I don't know why, I'm over a VPN and when I try the administrator login on the 1984 port, the GUI answers : access denied... >> >> I have tried basexclient -o output.xml : Same result, the query you know takes 11s... > >So I’m pretty sure it must be your connection, and not the query >processor of BaseX, that slows down the query. > >What about running the GUI locally? It’s not based on the >client/server architecture [1]. > >Christian > >[1] http://docs.basex.org/wiki/GUI > > > >> >> ----- Mail original ----- >> De: "Christian Grün" <christian.gruen(a)gmail.com> >> À: "Jean Marc Ansel" <ansel.jm(a)free.fr>, "BaseX" <basex-talk(a)mailman.uni-konstanz.de> >> Envoyé: Dimanche 31 Janvier 2016 17:49:00 >> Objet: Re: Rép: Re: [basex-talk] Slow XQueries on a quite small database but great number of docs >> >> Hi Jean Marc (cc to the list), >> >> What happens if you run the query in the GUI (how long does it take)? >> How much time is spent if you write the client output to a file >> (basexclient -o output.xml)? Which client do you use? >> >> >> >> >> On Sun, Jan 31, 2016 at 5:41 PM, <ansel.jm(a)free.fr> wrote: >>> Many many thanks for your quickness ! >>> Yes I optimized the database (OPTIMIZE ALL). I don't undestand where the pb is. >>> The query I ran is the one I have transmitted to you in the last mail. So there is a pb with the server I'm afraid. May be with java ? >> >>> When I try to execute the query from basexclient, I'have a immediate answer but a very very very slow display : lines are displayed in blocks of one or two screen terminals... There is a problem with the data exchange between the daemon and the client I think...

2 1

file:write and include-content-type
by James Ball 31 Jan '16

31 Jan '16

Hello, I’m getting an unexpected behaviour with the serialization option include-content-type and file:write with HTML. If I write a document without a <head> element then one doesn’t get added and nothing happens. file:write("test.htm",<html><body/></html>,map {"method":"html", "html-version":"4.0","include-content-type":"yes”}) returns: <html> <body></body> </html> Is this correct? If there is a head then the <meta> gets added with no problems - unless there is already a meta element, in which case it gets replaced. file:write("/Users/jb8748/test.htm",<html><head><meta http-equiv="refresh" content="60" /></head><body/></html>,map {"method":"html", "html-version":"4.0","include-content-type":"yes”}) returns: <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> </head> <body></body> </html> Is this correct? All running Running Beta 8.4 f5341cc Many thanks, James

2 11

basexhttp jetty 413 (Request Entity Too Large: head) / consecutive queries
by Günter Dunz-Wolff 31 Jan '16

31 Jan '16

Hi everyone, searching the basex rest-interface with a VERY long query ends in the following error-message: In Terminal basexhttp: [qtp1513712028-21] WARN org.eclipse.jetty.http.HttpParser - HttpParser Full for SCEP@5be8c98d{l(/0:0:0:0:0:0:0:1:49641)<->r(/0:0:0:0:0:0:0:1:8984),s=1,open=true,ishut=false,oshut=false,rb=false,wb=false,w=true,i=0r}-{AsyncHttpConnection@5d928144,g=HttpGenerator{s=0,h=-1,b=-1,c=-1},p=HttpParser{s=-10,l=0,c=-3},r=0} In the Browser: 413 (Request Entity Too Large: head) Is there any way, to enhance the memory for the HttpParser or is the only way to limit the http-request params? Here is the request, I know, it's a little bit crazy, but it's searching for synonyms and their wordforms for the german word "zahlen": http://localhost/rest?run=xqs/search_new.xq&$suche=zahlen&collect=all_kleist&and_or=off&no_wildcards=off&lower_upper=off&diacrit=off&minus=off&match=wsl_synonym&distance=5&stemma=,abgetragen,abtragen,abzutragen,abtr%C3%A4gt,abtrugen,abtrug,abzutragende,abtr%C3%A4gst,abtrage,abtr%C3%BCge,abtragt,abtr%C3%BCget,abtr%C3%BCgen,abtr%C3%BCgest,abtraget,abtragest,abtrugt,abtrugst,abtragend,abtr%C3%BCgst,abtr%C3%BCgt,abstottern,abgestottert,abzustottern,abstottert,abstotterten,abstotterte,abstottere,abstottertet,abstottertest,abstotterst,abstotternd,begleichen,beglichen,begleicht,beglich,begleiche,beglichet,beglichest,begliche,begleichet,begleichest,beglicht,beglichst,begleichst,begleichend,eingezahlt,einzahlen,einzuzahlen,einzahlt,einzahlten,einzahle,einzahlte,einzuzahlenden,einzahlet,einzahlest,einzahltet,einzahltest,einzahlst,einzahlend,abgegolten,abzugelten,abgelten,abgolten,abgelte,abgeltend,abgilt,abg%C3%A4ltet,abg%C3%A4lten,abg%C3%A4ltest,abg%C3%A4lte,abgeltest,abgaltet,abgalten,abgaltest,abgalt,abgeltet,abgiltst,abgaltst,abg%C3%B6lte,abg%C3%B6ltest,abg%C3%B6ltet,abg%C3%B6lten,ausgerichtet,ausrichten,auszurichten,ausrichtet,ausrichtete,ausrichteten,ausrichte,auszurichtende,ausrichtend,ausrichtetet,ausrichtetest,ausrichtest,abgef%C3%BChrt,abf%C3%BChren,abzuf%C3%BChren,abf%C3%BChrt,abf%C3%BChrten,abf%C3%BChrte,abf%C3%BChrend,abf%C3%BChre,abf%C3%BChret,abf%C3%BChrtet,abf%C3%BChrtest,abf%C3%BChrst,abf%C3%BChrest,entrichten,entrichtet,entrichtete,entrichteten,entrichte,entrichtene,entrichtetet,entrichtetest,entrichtest,entrichtend,angelegt,anlegen,anzulegen,anlegt,anlegte,anlegten,anlegenden,anlege,anlegende,anzulegendes,anzulegender,anlegst,anlegend,anlegtet,anleget,anlegest,anlegtest,begleichen,beglichen,begleicht,beglich,begleiche,beglichet,beglichest,begliche,begleichet,begleichest,beglicht,beglichst,begleichst,begleichend,aufkommen,aufgekommen,aufkommt,aufkam,aufzukommen,aufkamen,aufkomme,aufk%C3%A4men,aufk%C3%A4me,aufkommenen,aufkommend,aufk%C3%A4met,aufk%C3%A4mest,aufkommet,aufkommest,aufkamt,aufkamst,aufkommst,aufk%C3%A4mst,aufk%C3%A4mt,ausgezahlt,auszahlen,auszuzahlen,auszahlt,auszahlte,auszahle,auszuzahlenden,auszahlten,auszuzahlende,auszahlend,auszahlet,auszahlest,auszahltet,auszahltest,auszahlst,aufkommen,aufgekommen,aufkommt,aufkam,aufzukommen,aufkamen,aufkomme,aufk%C3%A4men,aufk%C3%A4me,aufkommenen,aufkommend,aufk%C3%A4met,aufk%C3%A4mest,aufkommet,aufkommest,aufkamt,aufkamst,aufkommst,aufk%C3%A4mst,aufk%C3%A4mt,bezuschu%C3%9Ft,bezuschussen,bezuschu%C3%9Fte,bezuschu%C3%9Ften,bezuschusst,bezuschusse,bezuschusset,bezuschussest,bezuschu%C3%9Ftet,bezuschussend,bezuschu%C3%9Ftest,bezahlen,bezahlt,bezahlte,bezahlten,bezahle,bezahlst,bezahl,bezahlet,bezahlend,bezahltest,bezahlest,bezahltet,alimentiert,alimentieren,alimentierten,alimentierte,alimentiere,alimentieret,alimentierest,alimentiertet,alimentiertest,alimentierst,alimentierend,bluten,blutet,blutend,blutete,geblutet,bluteten,blute,blut,blutest,blutetet,blutetest,ausbezahlt,ausbezahlen,ausbezahlten,auszubezahlen,ausbezahlte,ausbezahle,ausbezahlet,ausbezahlest,ausbezahltet,ausbezahltest,ausbezahlst,ausbezahlend,b%C3%BC%C3%9Fte,b%C3%BC%C3%9Ften,b%C3%BC%C3%9Fen,b%C3%BC%C3%9Ft,geb%C3%BC%C3%9Ft,b%C3%BC%C3%9Fe,b%C3%BC%C3%9Fend,b%C3%BC%C3%9Fet,b%C3%BC%C3%9Fest,b%C3%BC%C3%9Ftet,b%C3%BC%C3%9Ftest,verg%C3%BCtet,verg%C3%BCten,verg%C3%BCteten,verg%C3%BCtete,verg%C3%BCte,verg%C3%BCtest,verg%C3%BCtend,verg%C3%BCtetest,verg%C3%BCtetet,abbezahlt,abbezahlen,abzubezahlen,abbezahlten,abbezahlte,abbezahle,abbezahlst,abbezahlet,abbezahlest,abbezahltet,abbezahltest,abbezahlend,zahlen,zahlt,gezahlt,zahlte,zahlten,zahle,gezahlten,zahl,zahlst,zahlet,zahlend,zahltest,zahltet,zahlest,investiert,investieren,investierte,investierten,investiere,investierst,investieret,investierend,investiertest,investiertet,investierest,abzahlen,abzuzahlen,abgezahlt,abzahlt,abzahlten,abzahlte,abzahlet,abzahlest,abzahltet,abzahltest,abzahlst,abzahle,abzahlend,ausgesch%C3%BCttet,aussch%C3%BCtten,auszusch%C3%BCtten,aussch%C3%BCttet,aussch%C3%BCttete,aussch%C3%BCtteten,aussch%C3%BCtte,aussch%C3%BCttend,aussch%C3%BCttest,aussch%C3%BCttetet,aussch%C3%BCttetest,ausgegeben,ausgeben,auszugeben,ausgibt,ausgab,ausgaben,ausgebe,ausg%C3%A4ben,ausg%C3%A4be,ausgibst,ausgebt,ausgebend,ausg%C3%A4bet,ausg%C3%A4best,ausgebet,ausgebest,ausgabt,ausgabst,ausg%C3%A4bst,ausg%C3%A4bt,zur%C3%BCckerstattet,zur%C3%BCckerstatten,zur%C3%BCckzuerstatten,zur%C3%BCckerstattete,zur%C3%BCckerstatteten,zur%C3%BCckerstatte,zur%C3%BCckerstattest,zur%C3%BCckerstattetest,zur%C3%BCckerstattetet,zur%C3%BCckerstattend,eingestanden,einstehen,einzustehen,einsteht,einstehe,einstand,einstanden,einst%C3%BCnden,einstehend,einstehn,einst%C3%A4nden,einst%C3%BCndet,einst%C3%BCndest,einst%C3%BCnde,einstehet,einstehest,einstandet,einstandest,einstehst,einst%C3%A4ndest,einzustehn,einstandst,einst%C3%A4nde,einst%C3%A4ndet,aufzahlen,aufgezahlt,aufzuzahlen,aufzahlet,aufzahlest,aufzahltet,aufzahlten,aufzahltest,aufzahlte,aufzahlt,aufzahlst,aufzahle,aufzahlend,nachzahlen,nachgezahlt,nachzuzahlen,nachzuzahlenden,nachzahlt,nachzahlte,nachzahle,nachzahlend,nachzahlst,nachzahltest,nachzahlten,nachzahltet,nachzahlest,nachzahlet,ausgelegt,auszulegen,auslegen,auslegt,auslegte,auslegten,auslege,auslegend,ausleget,auslegest,auslegtet,auslegtest,auslegst&synonym=abf%C3%BChren,abgelten,abstottern,abtragen,alimentieren,anlegen,aufkommen,ausbezahlen,ausgeben,ausrichten,aussch%C3%BCtten,auszahlen,begleichen,bezahlen,bezuschussen,bluten,b%C3%BC%C3%9Fen,einstehen,einzahlen,entrichten,nachzahlen,verg%C3%BCten,auslegen,aufkommen,abbezahlen,abzahlen,aufzahlen,zur%C3%BCckerstatten,begleichen,investieren Alternativ perhaps I could use consecutive queries in xquery, but I can't figure out the right approach. Where and how to store the temporary sub-sequences? Thanks for any help! Best regards, Günter

2 1