- BaseX-Talk - mailman.uni-konstanz.de

Indenting XML query result from a function
by Hondros, Constantine (ELS-AMS) 16 Feb '16

16 Feb '16

This is probably easy, but I can't find an inbuilt method or function to do this easily. I have a function that will return certain nodes from a DB. The DB was built with CHOP off - plenty of white-space present between nodes. declare function dq:errorGivenName($db as xs:string) as element()* { db:open(concat($db, '_author))/*/*[matches(givenname, "[^\p{L}\p{M}-[\s-'''\.]]")] }; I can't predict where the function will be called so I've got no control over serialization parameters. Instead I'd like to pretty print the XML fragment returned by the function. I could write something to do this, but there must be a simple way ... right? C. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 4

Binding external variable in GUI
by buddyonweb-software＠yahoo.com 15 Feb '16

15 Feb '16

At the risk of a) sounding like a real newbie b) being accused of not Googling for an answer (which I did - but apparently overlooked) I am wondering how I can bind an external variable using just XQuery syntax in the BaseX GUI. I have found how to set the variable via command line options, and how to do it in Java, but I merelywanted to run a quick interactive test in the GUI to test an idea of mine (before writing a bunch of Java code).What I have done is in a tab in the GUI, I have included the module, and before running a function, want to set that external variable. Surprisingly I found myself at a loss on how to do what appears to be a simple task. So, thanks in advance for any help....and for the rest of this community for not laughing at me too loudly Buddy

3 2

Spectactularly slow performance with db:open vs. db:text
by Hondros, Constantine (ELS-AMS) 15 Feb '16

15 Feb '16

Hello Basexers, I'm getting such a low performance on a relatively simple join between two databases that I feel there must be something going wrong here. I can provide the sources if necessary, but basically DB1 is 26 MB, about 80,000 small documents; DB2 is 47 MB, about 18,500 small documents. I'm using 8.4, by the way, haven't tested on other releases. Query 1 [returns in 144 minutes] ---------------------------------------- for $a in (db:open('DB1')/item/order-id) return if (db:open('DB2')//order-id[. = $a]) then $a else () Note that the optimized query uses db:open-pre to access DB2. When I re-write the query myself to use the TEXT index then performance is excellent. But why such a difference? Query 2 [returns in 0.3 second] ---------------------------------------- for $a in (db:open('DB1')/item/order-id) return if (db:text('DB2', $a)/parent::order-id) then $a else () ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 3

Serialization to jsonml / Whitespace-Handling
by Günter Dunz-Wolff 15 Feb '16

15 Feb '16

Hi all, hi Christian I want to serialize my xml-documents to jsonml like so: json:serialize(doc('bettelweib.xml')//*:body, map { 'format': 'jsonml' }) Inside the jsonml are lots of strings with unnecessary whitespace like: "Das Bettelweib von\n Locarno." How could I remove that whitespace and also \n during or after the serialization? Thanks for any help. Regards, Günter

2 4

Invalid certs
by Marco Lettere 15 Feb '16

15 Feb '16

Hi all, sorry for this maybe dumb question. Is it possible to declare the IGNORECERT option inside a XQuery script that will be executed from inside a Java? Thanks, Marco.

2 3

JavaDoc link?
by buddyonweb-software＠yahoo.com 15 Feb '16

15 Feb '16

I may have overlooked it (and if so, sorry), but I can't seem to find the link to the JavaDocs on any of the online documentation pages.Can you direct me to the online documentation page that has that link? Again sorry if it was right in front of me and I missed it. Thanks, Buddy

3 2

metadata
by Kendall Shaw 15 Feb '16

15 Feb '16

Unless there is now a standard way to associate metadata with documents and collections, is there a preferred method? I could try to ensure that there is always a unique id that can be derived from combination of an id attribute or element in the document + the document’s document uri, then have separate metadata documents that are associated with the unique id. Is there an obviously better approach? Kendall

2 1

Reference the currently open database?
by Hondros, Constantine (ELS-AMS) 11 Feb '16

11 Feb '16

Hello all, Maybe a dumb question, but I need to reference the currently open database. Is there a more elegant way than this? db:name((*)[1]) ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 1

Re: [basex-talk] Connecting database in C#
by Christian Grün 11 Feb '16

11 Feb '16

Hi Raj (cc to the list), > Yes, I did. I have created a Session class (provided online) but unable to connect it to the existing database. > // create session > Session session = new Session("localhost", 1984, "admin", "admin"); > > It doesn't find the localhost on my machine. I guess, I am missing something. Do I need to install SQL server first? BaseX is the database, so there’s no need for SQL server. Did you start a BaseX server instance? Our documentation might give you more insight, see the "Getting Started" Section.

2 3

Re: [basex-talk] BaseX and Git versioning of XML at the same
by Enea Parimbelli 10 Feb '16

10 Feb '16

Thanks Dirk and Eliot, Dirk's suggestion about the WRITEBACK option looks very promising, I'm gonna try it out but I guess it would fit my needs. Update: just tried it and it seems to work also on docs previously imported in a database and retrieved using db:open("DBname", "filename") so that's even better than providing the full path. I was well aware of the bad performances caused by working outside the optimized basex data model (hard to beat a key-value optimized datastore) but performances are not an issue for my specific application. Eliot's project sounds also very cool but I think it's a bit too much of an effort for the initial proof-of-concept tests that I have in mind. Thanks for the great suggestions and timely support... that was FAST :) Best, Enea 2016-02-10 13:55 GMT+01:00 <basex-talk-request(a)mailman.uni-konstanz.de>: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. BaseX and Git versioning of XML at the same time (Enea Parimbelli) > 2. Re: BaseX and Git versioning of XML at the same time > (Dirk Kirsten) > 3. Re: BaseX and Git versioning of XML at the same time > (Eliot Kimber) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 10 Feb 2016 13:33:58 +0100 > From: Enea Parimbelli <enea.parimbelli(a)gmail.com> > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] BaseX and Git versioning of XML at the same time > Message-ID: > <CABz3M_P4mWEsG20tws+UiCXoTbzXTEQqzX7-Ew=+kJJq= > pZsYg(a)mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Dear all, > I'm Enea from Italy (working at the university of Pavia) and this is my > first email to this list and I hope you'll forgive my dumb question. > For one of my projects I was planning to use BaseX to be able to run > Xqueries to manipulate a bunch of XMLs that I have on my filesystem (i.e. > to take advantage of what XQuery can do vs manual editing of the xml > files). > At the same time I would like to have a version control system (Git in my > case) control my files to be able to diff, branch, revert changes etc. > However the way BaseX internally stores files is preventing me from doing > this easily. > > Here is an example of what I have in mind: > 0. I have a bunch of xmls in a folder (versioned with a git repo) > 1. I create a baseX database from these > 2. Run a bunch of updates/edits on the files using Xquery processor from > basex > 3. move back to git to diff what I've accomplished, commit, etc. > 4. (possibly more advanced, not sure if I really need this) I want to be > able to checkout a previous version of the files and have basex do the same > (i.e. if I run a query now I want it to run on the version of the xmls that > I have currently checked-out in my filesystem) > > Here are the (dumb) questions: > 1. Is there a way for basex (maybe some config settings when I create the > database?) to work keeping on the plain xml files? In a way that every > update query would actually change the original xml files (which I can view > with a plain text editor even "outside" the basex environment)? > 2. Is the only way of immediately seeing the changes I made to the xml > files to export the database after every update? > 3. (assuming 1 is doable) Would it be possible to have baseX recognize the > changes made to the xml files using an external editor (i.e. not through > xqueries run in basex)? > 4. From your experience is BaseX the proper tool for my purposes? It feels > to me that I merely want to use its xquery processor capabilities (and I > don't need the full-fledged database) while keeping the files plainly > stored in my filesystem... any suggestion on alternative options if baseX > doesn't sound like the right one? > > Thanks in advance for the help, > and congratulations on the great work (I used basex in the past in a more > orthodox way and was impressed by the numerous nice features... including > being the nice GUI and the hassle-free integration with tomcat!) > > Best regards, > Enea Parimbelli > > -- > Dr. Enea Parimbelli > Post-doctoral research fellow > Laboratory for Biomedical Informatics "Mario Stefanelli" > Department of Electrical, Computer and Biomedical Engineering > University of Pavia, Italy > e-mail: enea.parimbelli(a)gmail.com > phone: +39-0382-985057 +39-0382-985981 > http://www.labmedinfo.org/people/parimbelli >

1 0

BaseX and Git versioning of XML at the same time
by Enea Parimbelli 10 Feb '16

10 Feb '16

Dear all, I'm Enea from Italy (working at the university of Pavia) and this is my first email to this list and I hope you'll forgive my dumb question. For one of my projects I was planning to use BaseX to be able to run Xqueries to manipulate a bunch of XMLs that I have on my filesystem (i.e. to take advantage of what XQuery can do vs manual editing of the xml files). At the same time I would like to have a version control system (Git in my case) control my files to be able to diff, branch, revert changes etc. However the way BaseX internally stores files is preventing me from doing this easily. Here is an example of what I have in mind: 0. I have a bunch of xmls in a folder (versioned with a git repo) 1. I create a baseX database from these 2. Run a bunch of updates/edits on the files using Xquery processor from basex 3. move back to git to diff what I've accomplished, commit, etc. 4. (possibly more advanced, not sure if I really need this) I want to be able to checkout a previous version of the files and have basex do the same (i.e. if I run a query now I want it to run on the version of the xmls that I have currently checked-out in my filesystem) Here are the (dumb) questions: 1. Is there a way for basex (maybe some config settings when I create the database?) to work keeping on the plain xml files? In a way that every update query would actually change the original xml files (which I can view with a plain text editor even "outside" the basex environment)? 2. Is the only way of immediately seeing the changes I made to the xml files to export the database after every update? 3. (assuming 1 is doable) Would it be possible to have baseX recognize the changes made to the xml files using an external editor (i.e. not through xqueries run in basex)? 4. From your experience is BaseX the proper tool for my purposes? It feels to me that I merely want to use its xquery processor capabilities (and I don't need the full-fledged database) while keeping the files plainly stored in my filesystem... any suggestion on alternative options if baseX doesn't sound like the right one? Thanks in advance for the help, and congratulations on the great work (I used basex in the past in a more orthodox way and was impressed by the numerous nice features... including being the nice GUI and the hassle-free integration with tomcat!) Best regards, Enea Parimbelli -- Dr. Enea Parimbelli Post-doctoral research fellow Laboratory for Biomedical Informatics "Mario Stefanelli" Department of Electrical, Computer and Biomedical Engineering University of Pavia, Italy e-mail: enea.parimbelli(a)gmail.com phone: +39-0382-985057 +39-0382-985981 http://www.labmedinfo.org/people/parimbelli

3 2

BaseX 8.4: The XML Prague 2016 Edition
by Christian Grün 08 Feb '16

08 Feb '16

Dear all, Aligned with the XML Prague 2016 Conference, we are more than happy to provide you with a great new version of BaseX, your XML database system and XQuery processor! These are the new features: GUI - Project View: all modules of the project are now parsed in the background - Create Database, Properties: easy access to advanced database options - Sort Dialog: order by column positions and locale collation INDEXING - New Token Index: speedy token lookups in DITA and HTML documents - Including full support for incremental and main-memory databases - XQuery optimizations for fn:contains-token, fn:tokenize, fn:idref WEB APPLICATIONS - Cancel server-side queries via %rest:single annotation - DBA query editor: faster querying, better responsivity XQUERY - Database Module: ADDCACHE support (caching of large results) - Direct output of binary data with new 'basex' serialization method - Better XQuery 3.1 compliance: string constructors, new functions - Java bindings: address specific Java function signatures - User Module: create users and grant permissions in one step DOCUMENTATION - Many Wiki articles have been revised and updated A big thank you to our sponsors, which made some new features possible and available to everyone, and a special shout-out to Jens Erat, who realized the new token index! Visit http://basex.org to find the latest release. We are looking forward to your feedback, Christian BaseX Team

1 0

XProc 2 ...
by Marco Lettere 07 Feb '16

07 Feb '16

Hi all, sorry for the small OT but this sounds really interesting: http://lists.xml.org/archives/xml-dev/201602/msg00001.html Another reason why I should have been there ... :-(. Anyone from the BaseX community planning to look into it? Ciao, M.

3 2

Output from BaseX 8.4 GUI contains invalid characters
by Matti Lassila 07 Feb '16

07 Feb '16

Hello, I noticed that the current snapshot of BaseX GUI (8.4 beta 1e13ab6) generates erroneus values to the end of the result when the result is saved via Save-button. Using the same data with BaseX 8.3.1 GUI gives a clear output without errors. Strangely, When the result is cut-and-pasted, erroneous values are not included. I included erroneus and correct output files. I'm running OSX 10.11.2 but this happens also in Ubuntu 14.04. Best regards, Matti Lassila

2 1

Re: [basex-talk] XProc 2
by Christophe Marchand 05 Feb '16

05 Feb '16

Hello ! We have used XProc on a project, where we pipeline many XSL. XProc 1 is difficult to learn, and so very expensive to maintain. We have quit XProc and write our own xsl-pipeline tool, which is much simpler to use, and quite more quick. But it only covers XSL pipelining, and no other rich features that are present in XProc. So, I am very interested in this new version, but won't be there, for date constraints. Best regards, Christophe Le 05/02/2016 12:00, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Hi all, > sorry for the small OT but this sounds really interesting: > > http://lists.xml.org/archives/xml-dev/201602/msg00001.html > > Another reason why I should have been there ... :-(. > Anyone from the BaseX community planning to look into it? > > Ciao, > M. > > > ------------------------------ > > Message: 3 > Date: Fri, 5 Feb 2016 10:19:36 +0100 > From: Marc van Grootel <marc.van.grootel(a)gmail.com> > To: Marco Lettere <marco.lettere(a)dedalus.eu> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] XProc 2 ... > Message-ID: > <CA+bQNCss6ELfR8ohpPNMYCzSc2ToOEEJAAiyFUNWBrY1Cfj0yg(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Well, I looked at it for a bit when Norm demonstrated his XProc > "dialect" as he called it on his laptop at XML Amsterdam. Looked > really good. > > I think this is a good thing. I always found XProc a fantastic idea > but never got into it. Tried some simple things but found it too much > work and didn't wrap my head around it enough. It just didn't gel. The > XML is not helping in the case of XProc. I already went through > something like this going from Ant to Gradle where you can write your > builds in Groovy. Maybe XProc is on the same route and it becames a > library of functions that we can put together using XQuery. > > Definitely going to look into it again. > > Cheers, > --Marc > >

1 0

Fwd: Re: BaseX, Zorba, e-mail module
by Christian Grün 04 Feb '16

04 Feb '16

Hi Vincent, Sorry, I overlooked that my mail with the sources did not reach the list. Here it is. Christian ---------- Weitergeleitete Nachricht ---------- Von: "Christian Grün" <christian.gruen(a)gmail.com> Datum: 23.09.2015 3:51 nachm. Betreff: Re: [basex-talk] BaseX, Zorba, e-mail module An: "Tim Thompson" <timathom(a)gmail.com> Cc: > Is there an XSD for the e-mail document format being used? (And this module > is compatible with the BaseX open source license, correct?) No, sorry, there is no XSD available. However, you are invited to create one; I have attached the Java sources to this mail, which should contain all information you need. The Java code is based on the standard Java JavaMail API [1,2]. Hope this helps, Christian [1] http://www.oracle.com/technetwork/java/javamail/index.html [2] https://java.net/projects/javamail/pages/License > Tim A. Thompson > Metadata Librarian (Spanish/Portuguese Specialty) > Princeton University Library > > > On Wed, Sep 23, 2015 at 3:24 AM, Christian Grün <christian.gruen(a)gmail.com > > wrote: >> >> Hi Tim, >> >> We have implemented an XQuery/Java e-mail module quite some time ago, >> which we are using in various commercial projects. The main reason why >> we didn't make it public yet is that we didn't have time to document >> it properly. I have just uploaded this module, and you can install it >> via: >> >> repo install >> http://files.basex.org/modules/org/basex/modules/email/EMail.jar >> >> The jar file contains two simple example for sending mails (in the >> xquery sub-directory). >> >> Looking forward to your feedback. >> Christian >> ___________________________________ >> >> On Wed, Sep 23, 2015 at 7:04 AM, Tim Thompson <timathom(a)gmail.com> wrote: >> > Hello, >> > >> > I would like to be able to send e-mail from a Web app I am developing in >> > BaseX and was wondering whether anyone else had implemented this >> > functionality (or whether a BaseX e-mail module might be in the works?). >> > >> > I see that Zorba has an e-mail module with support for SMTP and IMAP >> > (not to >> > mention many other useful modules), which leads me to wonder whether >> > anyone >> > has worked on a BaseX connector for Zorba. >> > >> > In the meantime, I decided to try using the BaseX process module to call >> > Zorba, like so: >> > >> > proc:system( >> > 'zorba', ( >> > '-q', convert:binary-to-string( >> > db:retrieve( >> > 'out', 'email.xq' >> > ) >> > ) >> > ) >> > ) >> > >> > I stored the XQuery code for Zorba as a raw file in the BaseX database, >> > since storing it in the webapp directory caused an error, due to the >> > unrecognized Zorba module declarations. This approach seems to work >> > adequately, but does anyone have any suggestions for improvement, or a >> > different approach? >> > >> > Thanks in advance, >> > Tim >> > >> > >> > -- >> > Tim A. Thompson >> > Metadata Librarian (Spanish/Portuguese Specialty) >> > Princeton University Library >> > > >

1 0

BaseX, Zorba, e-mail module
by Tim Thompson 04 Feb '16

04 Feb '16

Hello, I would like to be able to send e-mail from a Web app I am developing in BaseX and was wondering whether anyone else had implemented this functionality (or whether a BaseX e-mail module might be in the works?). I see that Zorba has an e-mail module with support for SMTP and IMAP (not to mention many other useful modules), which leads me to wonder whether anyone has worked on a BaseX connector for Zorba. In the meantime, I decided to try using the BaseX process module to call Zorba, like so: proc:system( 'zorba', ( '-q', convert:binary-to-string( db:retrieve( 'out', 'email.xq' ) ) ) ) I stored the XQuery code for Zorba as a raw file in the BaseX database, since storing it in the webapp directory caused an error, due to the unrecognized Zorba module declarations. This approach seems to work adequately, but does anyone have any suggestions for improvement, or a different approach? Thanks in advance, Tim -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library

3 4

Multithread lock
by Bondeson, Carl 04 Feb '16

04 Feb '16

I have a highly multithreaded application that uses BaseX as a translation/transformation engine. It has been functioning in production for almost a year. From time to time I see the following in the nightly report the application generates which is sent from the server hosting the application. It requires a restart of JBoss, used as the application server. Any ideas? Name: Embedded EIP BaseX Server Thread : blocked Blocked on: java.net.SocksSocketImpl@5915a689 Blocked by: 1428 (Thread-1368) Blocked Count: 1 Lock Info: java.net.SocksSocketImpl@5915a689 Stack Trace: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:194) java.net.ServerSocket.implAccept(ServerSocket.java:545) java.net.ServerSocket.accept(ServerSocket.java:513) org.basex.BaseXServer.run(BaseXServer.java:142) com.pilotfish.eip.basex.BaseXServerRunner$1.run(BaseXServerRunner.java:93) java.lang.Thread.run(Thread.java:745) Name: C3P0PooledConnectionPoolManager[identityToken->2szqjh9e17wbsc31kua7k9|58166f21]-HelperThread-#2 : timed_waiting Thank you Carl R Bondeson Systems Developer Department of Public Health Data Processing 410 Capitol Ave Hartford, CT 06134 Phone: 860-509-7434 carl.bondeson(a)ct.gov<mailto:carl.bondeson@ct.gov> [logosmall]

3 11

Rép: Re: Rép: Re: Slow XQueries on a quite small database but great number of docs
by ansel.jm 02 Feb '16

02 Feb '16

Hi I don't know why but the problem is present even with the basex simple client (not client/server ). It seems java (tried many versions) doesn't execute normally : display or computation is halting, jolting.... The result of the query is quite fast but the display of the result very very halting. I'm on a readynas server running on an ARM processor. I think the io library of java (buffered io or something like that) has a problem. I'm very disappointed because that database seems very well adapted for my project... Jm Christian Grün <christian.gruen(a)gmail.com> a écrit : >> I can't run the GUI, I don't know why, I'm over a VPN and when I try the administrator login on the 1984 port, the GUI answers : access denied... >> >> I have tried basexclient -o output.xml : Same result, the query you know takes 11s... > >So I’m pretty sure it must be your connection, and not the query >processor of BaseX, that slows down the query. > >What about running the GUI locally? It’s not based on the >client/server architecture [1]. > >Christian > >[1] http://docs.basex.org/wiki/GUI > > > >> >> ----- Mail original ----- >> De: "Christian Grün" <christian.gruen(a)gmail.com> >> À: "Jean Marc Ansel" <ansel.jm(a)free.fr>, "BaseX" <basex-talk(a)mailman.uni-konstanz.de> >> Envoyé: Dimanche 31 Janvier 2016 17:49:00 >> Objet: Re: Rép: Re: [basex-talk] Slow XQueries on a quite small database but great number of docs >> >> Hi Jean Marc (cc to the list), >> >> What happens if you run the query in the GUI (how long does it take)? >> How much time is spent if you write the client output to a file >> (basexclient -o output.xml)? Which client do you use? >> >> >> >> >> On Sun, Jan 31, 2016 at 5:41 PM, <ansel.jm(a)free.fr> wrote: >>> Many many thanks for your quickness ! >>> Yes I optimized the database (OPTIMIZE ALL). I don't undestand where the pb is. >>> The query I ran is the one I have transmitted to you in the last mail. So there is a pb with the server I'm afraid. May be with java ? >> >>> When I try to execute the query from basexclient, I'have a immediate answer but a very very very slow display : lines are displayed in blocks of one or two screen terminals... There is a problem with the data exchange between the daemon and the client I think...

2 1

file:write and include-content-type
by James Ball 31 Jan '16

31 Jan '16

Hello, I’m getting an unexpected behaviour with the serialization option include-content-type and file:write with HTML. If I write a document without a <head> element then one doesn’t get added and nothing happens. file:write("test.htm",<html><body/></html>,map {"method":"html", "html-version":"4.0","include-content-type":"yes”}) returns: <html> <body></body> </html> Is this correct? If there is a head then the <meta> gets added with no problems - unless there is already a meta element, in which case it gets replaced. file:write("/Users/jb8748/test.htm",<html><head><meta http-equiv="refresh" content="60" /></head><body/></html>,map {"method":"html", "html-version":"4.0","include-content-type":"yes”}) returns: <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> </head> <body></body> </html> Is this correct? All running Running Beta 8.4 f5341cc Many thanks, James

2 11

basexhttp jetty 413 (Request Entity Too Large: head) / consecutive queries
by Günter Dunz-Wolff 31 Jan '16

31 Jan '16

Hi everyone, searching the basex rest-interface with a VERY long query ends in the following error-message: In Terminal basexhttp: [qtp1513712028-21] WARN org.eclipse.jetty.http.HttpParser - HttpParser Full for SCEP@5be8c98d{l(/0:0:0:0:0:0:0:1:49641)<->r(/0:0:0:0:0:0:0:1:8984),s=1,open=true,ishut=false,oshut=false,rb=false,wb=false,w=true,i=0r}-{AsyncHttpConnection@5d928144,g=HttpGenerator{s=0,h=-1,b=-1,c=-1},p=HttpParser{s=-10,l=0,c=-3},r=0} In the Browser: 413 (Request Entity Too Large: head) Is there any way, to enhance the memory for the HttpParser or is the only way to limit the http-request params? Here is the request, I know, it's a little bit crazy, but it's searching for synonyms and their wordforms for the german word "zahlen": http://localhost/rest?run=xqs/search_new.xq&$suche=zahlen&collect=all_kleis… Alternativ perhaps I could use consecutive queries in xquery, but I can't figure out the right approach. Where and how to store the temporary sub-sequences? Thanks for any help! Best regards, Günter

2 1

Re: [basex-talk] Rép: Re: Slow XQueries on a quite small database but great number of docs
by Christian Grün 31 Jan '16

31 Jan '16

Hi Jean Marc (cc to the list), What happens if you run the query in the GUI (how long does it take)? How much time is spent if you write the client output to a file (basexclient -o output.xml)? Which client do you use? On Sun, Jan 31, 2016 at 5:41 PM, <ansel.jm(a)free.fr> wrote: > Many many thanks for your quickness ! > Yes I optimized the database (OPTIMIZE ALL). I don't undestand where the pb is. > The query I ran is the one I have transmitted to you in the last mail. So there is a pb with the server I'm afraid. May be with java ? > When I try to execute the query from basexclient, I'have a immediate answer but a very very very slow display : lines are displayed in blocks of one or two screen terminals... There is a problem with the data exchange between the daemon and the client I think...

1 0

BaseX fn:collection() questions
by Bridger Dyson-Smith 31 Jan '16

31 Jan '16

Hi all, I'm using BaseX 8.3.1 and am trying to access a directory structure like so: declare namespace t = "http://www.tei-c.org/ns/1.0"; for $ready in fn:collection("/usr/home/bridger/Documents/foo/bar/?select=*.xml;recurse=yes")/t:TEI let $title := fn:data($ready/t:teiHeader/t:fileDesc/t:titleStmt/t:title) return $title The structure under bar/ looks something like bar/ 001/ 001.xml 002/ 002.xml 003/ 003.xml ... ... 009/ 009.xml Does BaseX's fn:collection() allow for recursion into a directory structure like this with the /?select syntax options or should I use a combination of functions from the File Module to move through these directories? Note: I'm not pulling these files into a database, rather I'm just using BaseX as a query processor. Thanks for your time. Best, Bridger

2 2

tumbling window and db:add in same expression
by Hondros, Constantine (ELS-AMS) 29 Jan '16

29 Jan '16

Hello all, BaseX doesn't seem to like the query below. Any particular reason - it makes sense to me. I'm trying to add items to a DB incrementally to (attempt to) avoid running into out of memory exceptions when cutting a slice of a large DB into a smaller one. for tumbling window $w in db:open(myDB')//ani:ref-authors/ani:author start at $s when $s mod 50000 = 1 return db:add( 'sliceDB', <index>{$w}</index>, 'somepath.xml' ) Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.3 Java: Oracle Corporation, 1.8.0_40 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.query.expr.ParseExpr.checkAllUp(ParseExpr.java:219) at org.basex.query.expr.ParseExpr.checkNoneUp(ParseExpr.java:203) at org.basex.query.expr.gflwor.Window.checkUp(Window.java:341) at org.basex.query.expr.gflwor.GFLWOR.checkUp(GFLWOR.java:791) at org.basex.query.QueryContext.check(QueryContext.java:265) at org.basex.query.QueryParser.finish(QueryParser.java:279) at org.basex.query.QueryParser.parseMain(QueryParser.java:176) at org.basex.query.QueryContext.parseMain(QueryContext.java:221) at org.basex.query.QueryProcessor.parse(QueryProcessor.java:56) at org.basex.core.cmd.AQuery.parse(AQuery.java:144) at org.basex.core.cmd.AQuery.updating(AQuery.java:158) at org.basex.core.cmd.AQuery.updating(AQuery.java:288) at org.basex.gui.GUI.exec(GUI.java:458) at org.basex.gui.GUI.access$400(GUI.java:43) at org.basex.gui.GUI$7.run(GUI.java:412) ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 1

Unrecognized Options Running Basex in Docker Container
by Eliot Kimber 29 Jan '16

29 Jan '16

I'm seeing a difference in how the .basex file is processed between running a server under OS X directly and running it in a Docker container. In particular, my local settings are being rejected as unrecognized. Here's the startup messages from within the basex container: basex@611404b26b04:~$ basexhttp /home/basex/.basex: Unknown option 'CATFILE'. /home/basex/.basex: Unknown option 'DTD'. /home/basex/.basex: Unknown option 'SKIPCORRUPT'. /home/basex/.basex: Unknown option 'CHOP'. /home/basex/.basex: writing new configuration file. [main] INFO org.eclipse.jetty.server.Server - jetty-8.1.17.v20150415 [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet BaseX 8.3 [Server] Server was started (port: 1984). [main] INFO org.eclipse.jetty.server.AbstractConnector - Started SelectChannelConnector@0.0.0.0:8984 HTTP Server was started (port: 8984). I verified that with the same .basex file running 8.3 under OS X the options are recognized and set as expected. What would cause this difference in behavior? Here is the .basex file in the /home/basex directory when the server starts: USER = admin PASSWORD = admin DEBUG = false DBPATH = /home/basex/basex/data REPOPATH = /home/basex/basex/repo LANG = English LANGKEYS = false GLOBALLOCK = false # Client/Server Architecture HOST = localhost PORT = 1984 SERVERPORT = 1984 SERVERHOST = PROXYHOST = PROXYPORT = 0 NONPROXYHOSTS = IGNORECERT = false TIMEOUT = 30 KEEPALIVE = 600 PARALLEL = 8 LOG = true LOGMSGMAXLEN = 1000 # HTTP Services WEBPATH = /home/basex/basex/webapp RESTPATH = RESTXQPATH = CACHERESTXQ = false HTTPLOCAL = false STOPPORT = 8985 AUTHMETHOD = Basic # Local options CATFILE = /opt/dita-ot/DITA-OT/catalog-dita.xml DTD = true SKIPCORRUPT = true CHOP = false -- (this is the end of the file) -- After the server starts the offending options are omitted from the rewritten .basex file. The only difference I can think of is the Java version. The container uses the OpenJDK while I have Oracle Java running in OS X: basex@611404b26b04:~$ java -version openjdk version "1.8.0_66-internal" OpenJDK Runtime Environment (build 1.8.0_66-internal-b17) OpenJDK 64-Bit Server VM (build 25.66-b17, mixed mode) basex@611404b26b04:~$ But otherwise it's exactly the same code running in both environments and the same config file. Thanks, Eliot ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com

2 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk