- BaseX-Talk - mailman.uni-konstanz.de

XML results file saving
by rdepery＠mscgva.ch 10 Sep '13

10 Sep '13

Hello there, This is my first post to this list, and I’d like first thanks everyone involved in this project. I have a problem of xml saving right now, and it seems it is not related to baseX itself, but might be something else I need to find out. I have queries I run against one or two db, the result is quite big and appear “chopped”. For a long time, using the save button, saved the result (the complete or “chopped” file I was seeing in output window…(text). Since a few time, when I save, only a few nodes are saved or almost nothing… Sometime not even the result in showed in “text”. File is saved, but instead of saving 3 or 5 Mb it saves 55Ko sometime more, sometime less. Could someone tell me if it is rather a memory, java, variable, query or anything else problem? I reinstalled java (jre6, jre7….), went from basex 7.7 to 7.5, rebooted several times. Note: First time you do the query and save, it works fine (ie. on colleague’s computer), the next, it doesn’t. Thanks for your suggestions. Richard This message and any associated files (together the “Contents”) are intended solely for the addressee(s). The Contents are confidential and may contain private information or information that is subject to copyright or is a trade secret or which is privileged. Views or opinions expressed herein do not necessarily represent views or opinions of MSC Mediterranean Shipping Company, its agents or their affiliated companies and may only be the view or opinion of the author. If you are not the intended recipient of this email, you must not use, print, copy, store, forward, or disclose it or act in reliance of the Contents. Please destroy all copies of the message and any associated files and notify the sender immediately that you have received it in error. Thank you for your cooperation. ------MSC LEGAL DISCLAIMER

2 2

Re: [basex-talk] WebDAV document retrieval
by Christian Grün 09 Sep '13

09 Sep '13

Hi Víctor (cc: basex-talk), …thanks for listing all clients you tried. One last question: using Windows XP Web Folders, is it possible to right-click files and choose "edit"? Let’s see if we find a more convenient solution; I’ll keep your e-mail in mind. Best, Christian ___________________________ 2013/9/6 Víctor Villamayor Callejo <vvillamayor(a)niteurope.com>: > Hi Christian, > > Thank you for your fast answer. I don't really mind the file size shown on > the webdav client, but perhaps this explains inconsistencies among the > clients I tested. > > - Windows XP web folders: yes, it works, but not the way I expected. I > cannot double click a xml document. But I can copy and paste (retrieve), > then work in my local hard drive, and finally copy and paste back (update). > Likely this will be my solution. > > - Microsoft Office: it works. > > - NetDrive: unable to retrieve xml. > > - WebDrive: the same. > > - CarotDAV: ok to download, crashes when upload. > > - Windows XP Miniredirector: I was unable to mount a drive (not even using > port 80 and enabling Basic Auth through Registry as several tutorials > state)... I'd like to give it a try. ¿Anyone knows the trick? > > Regards, > > Víctor > > > > El 2013-09-05 17:43, Christian Grün escribió: > > Hi Victor, > > as you already observed, the file size of all XML documents stored in > the database is 0 bytes. The reason is that the files are not stored > in their binary representation, but in an encoded representation, > which is faster for querying. The drawback is that this representation > does not enable us to efficiently calculate the final byte size. > > However, we didn’t encounter problems to retrieve these files with the > WebDAV clients we tested by ourselves (e.g. oXygen, Total Commander, > native Windows client). It seems that we have to do some more testing > with at least the clients you mentioned. While it would be best to > display the resulting file size, it will be too expensive in many > cases, so we could try to display any other number instead. > > Did you already try the native Windows WebDAV client, as described in > our documentation [1]? > > Best, > Christian > > [1] http://docs.basex.org/wiki/Webdav > ___________________________ > > 2013/9/5 Víctor Villamayor Callejo <vvillamayor(a)niteurope.com>: > > Dear all, I would like to access my BaseX database through WebDAV, in order > to be able to open, edit and save xml documents with custom made software > that only works with files in the filesystem. I tried with WinXP Web > Folders, NetDrive and WebDrive clients. I also tried with BaseX 7.7 and 7.6. > My problem is that whenever I save a XML document, after a few seconds it is > added (or replaced) to the database, and then it shows 0 bytes on the WebDAV > client. Then I can access the document with the BaseX GUI for example, but I > cannot double-click it in the client because it opens as an empty file. The > exceptions are raw or incorrect xml documents, which are correctly > retrieved. So WebDAV allows me to add, replace, rename, and delete xml > documents, but not retrieve them. Is this the expected behaviour, a bug, or > a locking matter? Thank you in advance, Víctor Villamayor Callejo > Electronics Department New Infrared Technologies ( +34 91 632 43 63 * > vvillamayor(a)niteurope.com : www.niteurope.com ¸ www.youtube.com/niteurope > DISCLAIMER: This message and any attached files transmitted with it, is > confidential, especially as regards personal data. It is intended solely for > the use of the individual or entity to whom it is addressed. If you are not > the intended recipient and have received this information in error or have > accessed it for any reason, please notify us of this fact by email reply and > then destroy or delete the message, refraining from any reproduction, use, > alteration, filing or communication to third parties of this message and > attached files on penalty of incurring legal responsibities. The sender does > not guarantee the integrity, the accuracy, the swift delivery or the > security of this email transmission, and assumes no responsibillity for any > possible damage incurred through data capture, virus incorporation or any > manipulation carried out by third parties. > _______________________________________________ BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > Víctor Villamayor Callejo > > Electronics Department > > New Infrared Technologies > > ( +34 91 632 43 63 > > * vvillamayor(a)niteurope.com > > : www.niteurope.com > > ¸ www.youtube.com/niteurope

2 1

Building a java library
by Joe Templeman 06 Sep '13

06 Sep '13

Hi, I'm new to basex and I'm trying to build an external java library which will return a list of documents for me to then query, but I'm running into a problem where it can't seem to find the class. This is the script I'm running: declare namespace t = "java:com.inkling.modules.Test"; let $loader := t:new("local") return ( t:fileNames($loader) ) In my root project directory I have a subdirectory for my java files so I start up the baseX gui using java -cp "BaseX76.jar:xmldblib/src/" org.basex.BaseXGUI and my java file (in xmldblib/src/com/inkling/modules/Test.java looks like: public class Test { String env; public Test(String environment) { env = environment; } public List<String> fileNames() { ...... } } When I try and run the xquery script, it just says Unknown Constructor Test.new(xs:string) Does anybody have an idea what I'm doing wrong? Any help is appreciated. Thanks, Joe

2 2

7.7 bug?
by Bill Beck 06 Sep '13

06 Sep '13

HI all, I'm getting this bug, which seems to happen when I have two clients talking to the db at the same time, one via the command line, and one through a socket connection using the PHP API. After this error, the data appears to be corrupt and the only solution is to quit the server and all clients, restart, and drop the database. Wasn't having this problem under the same usage with 7.0.2. THanks, -BB Here's the error message: BaseX 7.7 [Client] Try help to get more information. > list name Resources Size Input Path ------------------------------------------------------------------------- collection_guides 2 242308 /var/www/html/collection-guides/xml 1 Databases. > list collection_guides Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7 Java: Apple Inc., 1.6.0_51 OS: Mac OS X, x86_64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - #used blocks: 0 - #total locks: 0 - access: -1 (0 > -1] at org.basex.util.Util.notexpected(Util.java:53) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:488) at org.basex.io.random.TableDiskAccess.read5(TableDiskAccess.java:211) at org.basex.data.Data.textOff(Data.java:421) at org.basex.data.DiskData.text(DiskData.java:234) at org.basex.core.cmd.List.listDB(List.java:130) at org.basex.core.cmd.List.run(List.java:49) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.server.ClientListener.run(ClientListener.java:145) -- Bill Beck, Web Development Specialist Massachusetts Historical Society 1154 Boylston Street, Boston, MA 02215 Tel: 617-646-0505, Fax: 617-859-0074 www.masshist.org - America's First Historical Society - Founded 1791 "The Object of History: 18th-Century Treasures from the Collections of the Massachusetts Historical Society" and "The Education of Our Children Is Never out of My Mind": John & Abigail Adams's Thoughts on Education open through September 7. More information is available at www.masshist.org/events.

2 1

homebrew distribution
by Johan Mörén 06 Sep '13

06 Sep '13

Hello Will BaseX still be distributed via homebrew? I installed 7.6 that way but the latest release has not popped up yet. https://codeclimate.com/github/mxcl/homebrew/Basex Regards, Johan

3 3

Fwd: Announcing XQS: XQuery for Scala
by Erol Akarsu 06 Sep '13

06 Sep '13

---------- Forwarded message ---------- From: Marklogic User Community Group Members <group-digest(a)linkedin.com> Date: Fri, Sep 6, 2013 at 5:36 AM Subject: Announcing XQS: XQuery for Scala To: "Erol Akarsu, PhD" <eakarsu(a)gmail.com> Marklogic User Community [image: LinkedIn] [image: Marklogic User Community] <http://www.linkedin.com/e/-8wgh2l-hl97lwne-4x/vgq/1772706/eml-anet_dig-h_gn…> September 6, 2013 New Discussions *Announcing XQS: XQuery for Scala *<http://www.linkedin.com/e/-8wgh2l-hl97lwne-4x/vai/1772706/270089160/member/…> Started by Dino Fancellu, Polyglot Developer at Barclays Corporate Banking Like<http://www.linkedin.com/e/csrff6zr/-8wgh2l-hl97lwne-4x/lvi/1772706/27008916…>· Flag<http://www.linkedin.com/e/csrfFCE-/-8wgh2l-hl97lwne-4x/fav/1772706/27008916…> Stop inappropriate content the moment it is posted. Send me an email for each new discussion »<http://www.linkedin.com/e/-8wgh2l-hl97lwne-4x/snp/1772706/true/eml-anet_dig…> Do you know anybody that might like this group? Invite others to join » <http://www.linkedin.com/e/-8wgh2l-hl97lwne-4x/sgi/1772706/im-invite/cs-conn…> You are receiving Group Digest emails. Unsubscribe<https://www.linkedin.com/e/-8wgh2l-hl97lwne-4x/ihSC_2-eH7i_lIDOPydFgividrhu…>. This email was intended for Erol Akarsu, PhD (Software Architect). Learn why we included this<http://www.linkedin.com/e/-8wgh2l-hl97lwne-4x/plh/http%3A%2F%2Flinkedin%2Ec…>. © 2013, LinkedIn Corporation. 2029 Stierlin Ct. Mountain View, CA 94043, USA

1 0

WebDAV document retrieval
by Víctor Villamayor Callejo 05 Sep '13

05 Sep '13

Dear all, I would like to access my BaseX database through WebDAV, in order to be able to open, edit and save xml documents with custom made software that only works with files in the filesystem. I tried with WinXP Web Folders, NetDrive and WebDrive clients. I also tried with BaseX 7.7 and 7.6. My problem is that whenever I save a XML document, after a few seconds it is added (or replaced) to the database, and then it shows 0 bytes on the WebDAV client. Then I can access the document with the BaseX GUI for example, but I cannot double-click it in the client because it opens as an empty file. The exceptions are raw or incorrect xml documents, which are correctly retrieved. So WebDAV allows me to add, replace, rename, and delete xml documents, but not retrieve them. Is this the expected behaviour, a bug, or a locking matter? Thank you in advance, Víctor Villamayor Callejo Electronics Department NEW INFRARED TECHNOLOGIES ( +34 91 632 43 63 * vvillamayor(a)niteurope.com : www.niteurope.com [1] ¸ www.youtube.com/niteurope DISCLAIMER: This message and any attached files transmitted with it, is confidential, especially as regards personal data. It is intended solely for the use of the individual or entity to whom it is addressed. If you are not the intended recipient and have received this information in error or have accessed it for any reason, please notify us of this fact by email reply and then destroy or delete the message, refraining from any reproduction, use, alteration, filing or communication to third parties of this message and attached files on penalty of incurring legal responsibities. The sender does not guarantee the integrity, the accuracy, the swift delivery or the security of this email transmission, and assumes no responsibillity for any possible damage incurred through data capture, virus incorporation or any manipulation carried out by third parties. Links: ------ [1] http://www.niteurope.com/

2 1

external parameters with basexgui?
by Graydon Saunders 05 Sep '13

05 Sep '13

Hi! I've been failing to find this for awhile now. I've got some queries which I need to run from both a command line, using Saxon, for production purposes, and from the BaseX GUI, for development and testing and "that looks weird..." purposes. Saxon requires that I pass in content as parameters. That's easy enough. Is there a way to do this -- pass an external parameter value to a query -- with the BaseX GUI? Thanks! Graydon

2 1

Xquery on 2 DBs taking more execution time !!
by John Best 05 Sep '13

05 Sep '13

As the data is quite huge around 2GB, which creates problems while creating FT Index, I have divided it into 2 parts. For a better picture of what I have done, I am explaining it with a suitable example. Lets say I have articles on Physics in one single DB. So, I divided them into 2 DBs, viz; short description and long description. So, now I have 2 DBs - PhysicsSD PhysicsLD By doing so, I am not getting OOM now while creating FT Index. (Wow!!). But now, I am facing another issue... Say, I want to search for words "emf" and "waves" into the Physics DBs, I would do this - for $dbname in ('physicsSD', 'physicsLD') for $x in doc($dbname)//Doc[SD/Info/ text() contains text {"emf waves"} all words or LD/Info/Para/text() contains text {"emf waves"} all words] order by xs:integer($x/Details/Year) descending return $x/Doc This query retrieves data in approx. 83000 ms (83 Sec) But when executed on INDIVIDUAL DBs, the total time is very very less compared to the above. Its only 4500 ms (4.5 sec) for BOTH !!! -- Have a nice day JBest

3 2

Too many opened files error
by Alexander Shpack 05 Sep '13

05 Sep '13

Hello! for $i in (1 to 1000) let $name := 'user_' || $i return ( db:create( $name ) ) Is it bug, or normal behavior? I would like to create little benchmark with multiple databases, multiple writtings and readings to it. -- s0rr0w

2 1

Re: [basex-talk] Xquery on 2 DBs taking more execution time !!
by John Best 04 Sep '13

04 Sep '13

Dear Dirk, "Sounds to me like the FT index isn't hit in the long-running query. Could you please check for both queries if the index is actually used? You can do so by looking at the query plan in the info view." Both the DBs are Text, Attribute and FT Indexed. Please find the Timing and Query Plan output after running the query - *Timing:* - Parsing: 0.0 ms - Compiling: 11.08 ms - Evaluating: 48729.01 ms - Printing: 16.38 ms - Total Time: 48756.49 ms *Query plan: * <QueryPlan> <FLWR> <Let var="$items"> <List> <IterPath> <DBNode name="physicsSD" pre="0"/> <IterStep axis="child" test="*:Docs"/> <IterStep axis="child" test="*:Doc"/> </IterPath> <IterPath> <DBNode name="physicsLD" pre="0"/> <IterStep axis="child" test="*:Docs"/> <IterStep axis="child" test="*:Doc"/> </IterPath> </List> </Let> <For var="$x"> <IterFilter> <VarRef> <Var name="$items" id="0"/> </VarRef> <FTContains> <AxisPath> <IterStep axis="child" test="Info"/> <IterStep axis="child" test="Para"/> <IterStep axis="child" test="text()"/> </AxisPath> <FTWords> <Str value="emf waves" type="xs:string"/> </FTWords> </FTContains> </IterFilter> </For> <Return> <AxisPath> <VarRef> <Var name="$x" id="1"/> </VarRef> <IterStep axis="child" test="Doc"/> </AxisPath> </Return> </FLWR> </QueryPlan> "Also it would be best to have at least some of your data, so that we can reproduce the problem. You can send the data to us directly, so we don't spam the list and if the data should not be public." I can't provide the data publicly. I do have Christian's personal mail id. But I think he is enjoying vacations... -- Have a nice day JBest

2 1

JSON serialisation for results
by Bell, Darren S 03 Sep '13

03 Sep '13

Hi, I'm new to BaseX. We are running a simple XQuery: declare variable $documentguid as xs:string external; <utterances> { for $targetelements in /*:TEI/*:text/*:body/*:u[/*:TEI/*:teiHeader/*:fileDesc/*:publicationStmt/*:idno[@type='qudexdocument']=$documentguid] return <utterance> <guid>{data($targetelements/@xml:id)}</guid> <speaker>{data($targetelements/@who)}</speaker> <text>{data($targetelements/text())}</text> </utterance> } </utterances> by calling http://dahdsst2:8984/rest/DF?run=interviewutterances.xq&documentguid=q-25d5… All works well but our UI developers are not happy with the JSONML as a serialization format. I changed the output method to 'json' and this returns "[BXJS0002] JSON serialization: <json> expected as root node." So then I changed the <utterances> root element to <json> and then I get: [BXJS0002] JSON serialization: Element <json> must be typed as "object" or "array". I'm a bit lost at this point. I've consulted the documentation but there is not very much detail about the specific steps to go about serialising an XQuery output as JSON. The standard JSON format I'm trying to output is like so: { "utterances": { "utterance": [ { "guid": "q-2f0de4c5-7dfb-e211-b501-000bdb5cc6d5", "speaker": "interviewer", "text": "I'd like to start, if I may, by asking you your birth date." }, { "guid": "q-300de4c5-7dfb-e211-b501-000bdb5cc6d5", "speaker": "subject", "text": "November 9th, 1902." }, { "guid": "q-310de4c5-7dfb-e211-b501-000bdb5cc6d5", "speaker": "interviewer", "text": "Could you tell me how many children there were in your family?" } ] } } Any tips on how to go about this in BaseX would be much appreciated, Regards, ___________________________________ DARREN BELL Data and Services Developer ___________________________________ T +44(0) 1226 272144 E dbell(a)essex.ac.uk W ukdataservice.ac.uk ___________________________________ UK Data Service UK Data Archive University of Essex ___________________________________ Legal Disclaimer: Any views expressed by the sender of this message are not necessarily those of the UK Data Service or the UK Data Archive. This email and any files with it are confidential and intended solely for the use of the individual(s) or entity to whom they are addressed.

2 1

Re: [basex-talk] Mistaken order?
by Wendell Piez 02 Sep '13

02 Sep '13

Dear Arve, Ouch! The behavior is indeed as expected in 7.7. It is unexpected (and non-conformant) in 7.7 beta. The saddest thing is that I have 7.7 installed and could have tried it there before posting. :-( Cheers, Wendell Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^ On Mon, Sep 2, 2013 at 2:05 AM, Arve Gengelbach <ag(a)basex.org> wrote: > Hi Wendell, > > running your query on any database with BaseX version 7.7, everything > works as expected. Using the latter version? > > cheers, > Arve > > > Am 01.09.13 18:21, schrieb Wendell Piez: >> Dear BaseX, >> >> Running in the GUI, I execute: >> >> let $source := (/)[1] >> >> let $wrapped := <wrapper> >> { $source/*/* } >> <new/> >> </wrapper> >> >> return $wrapped/*/name() >> >> I expect to get a sequence of the names of element children of the >> document (root) element of the first entry in the currently open >> database, with a 'new' element named at the end. >> >> Instead, I get 'new' followed by the names of the elements in the >> document, with 'new' first. (And I see 'new' for ($insert/*/name())[1] >> and not for ($insert/*/name())[last()].) >> >> When I look at $insert itself, the document itself looks like what I expect. >> >> Where am I going wrong, or is this a bug? >> >> Cheers, Wendell >> >> >> Wendell Piez | http://www.wendellpiez.com >> XML | XSLT | electronic publishing >> Eat Your Vegetables >> _____oo_________o_o___ooooo____ooooooo_^ >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>

1 0

Mistaken order?
by Wendell Piez 01 Sep '13

01 Sep '13

Dear BaseX, Running in the GUI, I execute: let $source := (/)[1] let $wrapped := <wrapper> { $source/*/* } <new/> </wrapper> return $wrapped/*/name() I expect to get a sequence of the names of element children of the document (root) element of the first entry in the currently open database, with a 'new' element named at the end. Instead, I get 'new' followed by the names of the elements in the document, with 'new' first. (And I see 'new' for ($insert/*/name())[1] and not for ($insert/*/name())[last()].) When I look at $insert itself, the document itself looks like what I expect. Where am I going wrong, or is this a bug? Cheers, Wendell Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^

1 0

Re: [basex-talk] username after login with jetty's HashLoginModule AND parallel update queries
by Florian Eckey 29 Aug '13

29 Aug '13

Hi, that's the way I have realized the login before, but now I combine this with the http basic authentication, because otherwise you can download all files in the webapp directory without being logged in. I have realized it in that way, but now I can't get the username of the user who is logged in. Is there any way to read the "org.eclipse.jetty.security.UserIdentity" attribute in the session? I always get an error: HTTP ERROR 400 Problem accessing /restxq/getSession/org.eclipse.jetty.security.UserIdentity. Reason: Stopped at D:/Projects/******/basex77/basex/webapp/restxq/utilities.xqm, 35/18: [BXSE0002] Stored attribute cannot be retrieved: SessionAuthentication. Stack Trace: - D:/Projects/******/basex77/basex/webapp/restxq/utilities.xqm, 34/13 _____ Powered by Jetty:// The server stops at the line, where it tries to read the session attribute "org.eclipse.jetty.security.UserIdentity". Another question: Is there any way to realize parallel update queries in baseX? Cheers, Florian -----Ursprüngliche Nachricht----- Von: basex-talk-bounces(a)mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] Im Auftrag von Dirk Kirsten Gesendet: Montag, 26. August 2013 11:44 An: basex-talk(a)mailman.uni-konstanz.de Betreff: Re: [basex-talk] username after login with jetty's HashLoginModule Hello Florian, you might want to ask this question on the jetty mailing list as this seems to be not really specific to BaseX. You most likely also will get a more useful response as we are no jetty experts per se. However, I also couldn't find any HashLoginModule in our default jetty.xml (and I did a quick google search and could find anything), so I am not really sure what you actually do. Might be useful to post the relevant part of your jetty.xml. Btw, in our RestXQ-based applications we mainly use application-defined authentication, i.e. we first check the proper login within each output function, so something like: if(not(_:logged-in())) then () else where _:logged-in() is simply declare function _:logged-in() as xs:boolean { boolean(_:id()) }; and we set the session variable during login. Cheers, Dirk On 08/26/2013 11:25 AM, Florian Eckey wrote: > Hey, > > I have a problem with the jetty authentication. I use the > HashLoginModule, which is configured in the jetty.xml. The problem is, > that I find no way to write the username in the session, so after > login I have no username to deal with. Has anyone solved the same or a > similar problem? Or are there any tips how to implement a secure > login, after that I can use the entered username in the session? > > regards > > Florian > > _______________________________________________ > BaseX-Talk mailing list > <mailto:BaseX-Talk@mailman.uni-konstanz.de> BaseX-Talk(a)mailman.uni-konstanz.de > <https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > -- Dirk Kirsten, BaseX GmbH, <http://basex.org> http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 _______________________________________________ BaseX-Talk mailing list <mailto:BaseX-Talk@mailman.uni-konstanz.de> BaseX-Talk(a)mailman.uni-konstanz.de <https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 2

BaseX 7.7: The Happy-Birthday-Leo Edition
by Christian Grün 29 Aug '13

29 Aug '13

Hi everyone, we are excited to give you Version 7.7 of BaseX -- the Happy-Birthday-Leo Edition -- which provides a bunch of new and improved features: XQUERY - Support for XQuery 3.0 has been finalized http://docs.basex.org/wiki/XQuery_3.0 - the Unit Module allows standardized testing of XQuery applications http://docs.basex.org/wiki/Unit_Module - the Streaming Module speeds up operations on large files http://docs.basex.org/wiki/Streaming_Module - the Inspection Module provides reflection and documentation features http://docs.basex.org/wiki/Inspection_Module - we have added support for XQuery collations http://docs.basex.org/wiki/Full-Text#Collations - we have extended the Database, Archive, File and other Modules http://docs.basex.org/wiki/Module_Library WEB/HTTP SERVICES: - WebDAV has been enriched with locking features (sponsored feature!) http://docs.basex.org/wiki/WebDAV#Locking - RESTXQ has been improved and extended: http://docs.basex.org/wiki/RESTXQ CORE - improved database locking, including the use of custom lock strings http://docs.basex.org/wiki/Transaction_Management - database names have got more flexible http://docs.basex.org/wiki/Commands#Valid_Names - we have new options for simplifying the creation of large databases http://docs.basex.org/wiki/Options BaseX is one of the leading open source XML database and XQuery 3.0 processors, including full support for the W3C Update and Full Text extensions. An interactive GUI frontend gives you great insight into your XML documents, and the client-/server-architecture and web services make it a great framework for building powerful web applications. Please find more information at: http://basex.org Have fun with our new release! Looking forward to your feedback, Christian BaseX Team, 2013

3 2

Proposals. Custom query slot management, named instances and read-only databases
by Alexander Shpack 28 Aug '13

28 Aug '13

Hi everyone! Our current project, based on BaseX, was failed on launch, because we have any practice with optimization for NoSQL databases and take the bottleneck with write locks, but we take the unbelievable experience with BaseX. Today I know, how to get the maximum from this DB 1. Custom query slot management. It would be useful, if query command can take the number of taken slot. >From code side I know, that some type of requests is very simple, very fast, and DB can return rapidly the results back. And this type of requests may be sticked to some query slots permanently. From other side, heavy xQuery code may be managed automatically by BaseX 2. Named instances We need to start multiple BaseX servers to utilize more then one CPU core. It would be useful to set up the name for each instance by personal .basex config 3. Access mode Next proposal is simple. Allow to manage the type of access (read or write only, both) to DB for list of named instances. This proposal may help with the next architecture: many servers with one DBPATH. Server1 Server2 Server3 | | | -------------------------------- | | | | DB1 DB2 DB3 DB4 DB1 permissions Read: Server1, Server3 Write: Server2 DB2, DB3, DB4 permissions Read: Server1, Server2 Write: Server2 This may protect from DB corrupts. Is it interesting concept? -- s0rr0w

1 0

security issues
by Ertan Tike 27 Aug '13

27 Aug '13

Hi, We are providing an cloud based application development environment with using the basex database. We want to allow developers can write xquery commands to access database but some security issues has appeared. For example " file:list('c:/') " query returns the list of C:\ directory. Is it possible to exclude some of modules from basex engine or is there any other way to execute query in sandbox environment which allows only FLWOR expressions and basic modules like "Math". Scanning "file:" like prefixes may be a solution but maybe there is a better way to do it. Thank you for help. -- Ertan TİKE <http://www.6kare.com>

2 1

username after login with jetty's HashLoginModule
by Florian Eckey 26 Aug '13

26 Aug '13

Hey, I have a problem with the jetty authentication. I use the HashLoginModule, which is configured in the jetty.xml. The problem is, that I find no way to write the username in the session, so after login I have no username to deal with. Has anyone solved the same or a similar problem? Or are there any tips how to implement a secure login, after that I can use the entered username in the session? regards Florian

2 1

Re: [basex-talk] Documentation
by Thomas Daly 25 Aug '13

25 Aug '13

Thank you very much for your reply. I assume that in your example commands, mydoc.xml already existed as a file on your hard drive. In my case, the system looked for mydoc.xml rather than create it: > CREATE DB db1 Database 'db1' created in 14.41 ms. > ADD mydoc.xml Resource "/home/tcd/mydoc.xml" not found. Your 2nd ADD command worked, which I assume gives us an XML file empty apart from a root node <a/>: > ADD TO doc2.xml <a/> Path "doc2.xml" added in 2.72 ms. > INFO STORAGE PRE DIS SIZ ATS ID NS KIND CONTENT ------------------------------------------ 0 1 2 1 0 0 DOC doc2.xml 1 1 1 1 1 0 ELEM a Now I'd like to add a new node to the new document. I've tried two variants as follows: > XQUERY insert node <newnode/> into <a/> Query executed in 2.09 ms. > XQUERY insert node <newnode/> into doc('doc2.xml')/a Stopped at ., 1/33: [FODC0002] Resource '/home/tcd/doc2.xml' does not exist. Although the first XQUERY command appeared to work, if I export the XML file with the EXPORT command and examine it, unfortunately the new node is not present. The file just contains the <a/> node. Is there any variation of the EXPORT command that will simply echo the contents of the XML file to the terminal, rather than to a file? If not, that would be a useful addition. Best regards, Thomas At 11:00 25/08/2013, you wrote: >Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > >To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > >You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > >When replying, please edit your Subject line so it is more specific >than "Re: Contents of BaseX-Talk digest..." > > >Today's Topics: > > 1. Documentation (Thomas Daly) > 2. Re: Documentation (Dimitar Popov) > > >---------------------------------------------------------------------- > >Message: 1 >Date: Sat, 24 Aug 2013 16:25:17 +0100 >From: Thomas Daly <thomas.daly(a)live.com> >To: basex-talk(a)mailman.uni-konstanz.de >Subject: [basex-talk] Documentation >Message-ID: <BLU0-SMTP12145626E8EAB6750E955A2914F0(a)phx.gbl> >Content-Type: text/plain; charset="us-ascii"; format=flowed > >Hello, > >Thank you for this system, which looks promising. > >I would like to request better documentation to show how to do the >most basic things. I am trying to create a new database and add a >single new record to it. I don't want to start with a pre-written >XML document. So using the command line client tool: > > > CREATE DB users >Database 'users' created in 214.89 ms. > >Then I refer to the ADD command >http://docs.basex.org/wiki/Commands#ADD which suggests an XML string >can be added. So I try: > > > ADD <record>hello</record> >Name '' is invalid. > >All the examples of ADD involve adding existing XML files. A path to >the database is referred to, but having just created the database I >have no idea what the path is. > >Referring to tutorials and slides on page >http://docs.basex.org/wiki/Getting_Started, the link to XMLPrague >2013 is broken. BaseX adventures starts at an advanced level of >querying a host of XML files. W3Schools XQuery seems all about >querying existing databases, I can't find anything on how to add or >update a single record. > >I'm sure with enough trial and error I'll work out how to do it. My >point is that I feel it ought to be more obvious how to carry out the >most basic CRUD operations. > >Best regards, >Thomas > > > >------------------------------ > >Message: 2 >Date: Sat, 24 Aug 2013 23:31:36 +0200 >From: Dimitar Popov <dp(a)basex.org> >To: basex-talk(a)mailman.uni-konstanz.de >Subject: Re: [basex-talk] Documentation >Message-ID: <1377379896.5833.0.camel@darkrider> >Content-Type: text/plain; charset="UTF-8" > > >On Sat, 2013-08-24 at 16:25 +0100, Thomas Daly wrote: > > Hello, > > > > Thank you for this system, which looks promising. > > > > I would like to request better documentation to show how to do the > > most basic things. I am trying to create a new database and add a > > single new record to it. I don't want to start with a pre-written > > XML document. So using the command line client tool: > > > > > CREATE DB users > > Database 'users' created in 214.89 ms. > > > > Then I refer to the ADD command > > http://docs.basex.org/wiki/Commands#ADD which suggests an XML string > > can be added. So I try: > > > > > ADD <record>hello</record> > > Name '' is invalid. > > > > All the examples of ADD involve adding existing XML files. A path to > > the database is referred to, but having just created the database I > > have no idea what the path is. > >BaseX supports the notion of collections, i.e. one can store multiple >XML documents into a single database. Each non-empty database contains >at least one document. Each stored document must have a name. This is >the reason why when calling the ADD command with an XML fragment one >must specify the name of the new document. However, if a file is >specified as input, then the file name is implicitly used as a name of >the new document. > >Similar behavior has the CREATE DB command. If called with a file, then >a document with the name of the file will be created. If called with an >XML fragment, then the database name will be used as the name of the >first document. The following examples illustrate the two commands: > > > CREATE DB db1 >Database 'db1' created in 68.92 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >----------------------------------------- > > > ADD mydoc.xml >Path "mydoc.xml" added in 15.36 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >------------------------------------------- > 0 1 2 1 0 0 DOC mydoc.xml > 1 1 1 1 1 0 ELEM a > > > ADD TO doc2.xml <a/> >Path "doc2.xml" added in 4.5 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >------------------------------------------- > 0 1 2 1 0 0 DOC mydoc.xml > 1 1 1 1 1 0 ELEM a > 2 3 2 1 2 0 DOC doc2.xml > 3 1 1 1 3 0 ELEM a > > > CREATE DB db2 mydoc.xml >Database 'db2' created in 12.57 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >------------------------------------------- > 0 1 2 1 0 0 DOC mydoc.xml > 1 1 1 1 1 0 ELEM a > > > CREATE DB db3 <a/> >Database 'db3' created in 13.6 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >----------------------------------------- > 0 1 2 1 0 0 DOC db3.xml > 1 1 1 1 1 0 ELEM a > > > > Referring to tutorials and slides on page > > http://docs.basex.org/wiki/Getting_Started, the link to XMLPrague > > 2013 is broken. > >Thanks, I fixed the link. Please, report such inaccuracies or feel free >to edit the wiki yourself. > > > BaseX adventures starts at an advanced level of querying a host > of XML files. W3Schools XQuery seems all about > > querying existing databases > >The BaseX documentation contains only the BaseX specific functionality - >the purpose is not to duplicate the W3C specification or the tutorials >at W3Schools. However, XQuery questions are readily answered on the >mailing list ;) > > > I can't find anything on how to add or update a single record. > >The XQuery Update Facility might be helpful to you [1]. > > > I'm sure with enough trial and error I'll work out how to do it. My > > point is that I feel it ought to be more obvious how to carry out the > > most basic CRUD operations. > >I couldn't agree more. On the other hand the BaseX team gives its best >to maintain the documentation and is always open to improvement >suggestions. So if you have any concrete ideas how the documentation can >be made more useful, they will be most welcome. > >Regards, >Dimitar > >[1] http://www.w3.org/TR/xquery-update-10/ > > > > >------------------------------ > >_______________________________________________ >BaseX-Talk mailing list >BaseX-Talk(a)mailman.uni-konstanz.de >https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > >End of BaseX-Talk Digest, Vol 44, Issue 24 >******************************************

2 1

Documentation
by Thomas Daly 24 Aug '13

24 Aug '13

Hello, Thank you for this system, which looks promising. I would like to request better documentation to show how to do the most basic things. I am trying to create a new database and add a single new record to it. I don't want to start with a pre-written XML document. So using the command line client tool: > CREATE DB users Database 'users' created in 214.89 ms. Then I refer to the ADD command http://docs.basex.org/wiki/Commands#ADD which suggests an XML string can be added. So I try: > ADD <record>hello</record> Name '' is invalid. All the examples of ADD involve adding existing XML files. A path to the database is referred to, but having just created the database I have no idea what the path is. Referring to tutorials and slides on page http://docs.basex.org/wiki/Getting_Started, the link to XMLPrague 2013 is broken. BaseX adventures starts at an advanced level of querying a host of XML files. W3Schools XQuery seems all about querying existing databases, I can't find anything on how to add or update a single record. I'm sure with enough trial and error I'll work out how to do it. My point is that I feel it ought to be more obvious how to carry out the most basic CRUD operations. Best regards, Thomas

2 1

BaseX Gui import (Add) doesn't replace items
by France Baril 20 Aug '13

20 Aug '13

Hi, Context: DB name A Collection B File C.xml with Hello In BaseX Gui, DB A is opened. In the Properties window, browse to the file C.xml, say you want to add in under B and click Add. Repeat the operation (to replace C.xml, with a new update C.xml) In BaseX Gui, try: for $x in /*[@id='i1'] return $x You'll get this: Hello Hello If you try this: for $x in /*[@id='i1'] return $x/base-uri() You'll get A/B/C.xml A/B/C.xml Applying db:optimize won't change anything. Basically, it looks like the content of the file is appended to the existing file. Expectation is that it should replace it. Side effect: When we open the file in XML Oxygen through WebDAV, the file appears to be empty. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 1

XQuery changes from 7.6 to 7.7
by Gerald de Jong 18 Aug '13

18 Aug '13

I am finding strange problems when I try using 7.7 which didn't appear before. I was building queries with XQUERY followed by \n and then the query, which worked in 7.6. XQUERY <Documents> { for $doc in collection('oscrtest/documents/Photograph')/Document order by $doc/Header/TimeStamp descending return $doc } </Documents> Now it warns me about the syntax of my query: "Syntax: XQUERY [query]" So then I take away the \n so that the query begins after "XQUERY " and my query becomes: XQUERY <Documents> { for $doc in collection('oscrtest/documents/Photograph')/Document order by $doc/Header/TimeStamp descending return $doc } </Documents> upon which it reports: "[XPST0003] Expecting closing tag </Documents>." Puzzling about why this happens, I adjust the query to: XQUERY <Documents>{ for $doc in collection('oscrtest/documents/Photograph')/Document order by $doc/Header/TimeStamp descending return $doc }</Documents> but then it reports: "[XPST0003] Expecting expression." I will have to stick to 7.6 until I understand what to do about these problems. What am I missing? -- Delving BV, Vasteland 8, Rotterdam http://www.delving.eu http://twitter.com/fluxe skype: beautifulcode +31629339805

2 2

Losing non-breakable spaces ( )
by France Baril 17 Aug '13

17 Aug '13

Hi, We are using a BaseX HTTP server (still on version 7.6), accessing files via WebDAV for authoring in XML Oxygen. At some point in the process, we lose our non-breakable spaces. If Isave a file with this content in BaseX: Test this It appears that files are saved correctly, because this query returns the p element: for $x in //text()[contains(., ' ')] return $x/parent::*. However, when we reopen the file in BaseX, the   has been replaced by a space. We tried the same experiment saving and opening the file on the file system to make sure the issue wasn't with XML Oxygen. The file reopens with the correct   character. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 1

xquery hangs in 7.7 release version (used to work fine in 7.7 beta)
by Srinivasan Muthu 17 Aug '13

17 Aug '13

Hi, We have been using basex 7.7 snapshot from June 20 and wanted to upgrade to the release version but looks like I have hit a bug with BaseX 7.7 release version while running a set of xqueries in sequence. I am able to reproduce this in BaseX 7.7 running in client-server mode on two different machines. Here are the steps to reproduce: - Launch BaseX 7.7 server (with defaults) - Launch BaseX command line client (run the file under bin/basexclient.bat that comes in zip) and run the following commands (also attached a screenshot): ---------------------------------------------------------- Username: admin Password: BaseX 7.7 [Client] Try help to get more information. *> create db d1 <hello/>* Database 'd1' created in 103.22 ms. *> xquery delete node doc('d1')//oops* Query executed in 25.03 ms. *> xquery let $doc := 'd1' return doc($doc)* ---------------------------------------------------------- At this point BaseX 7.7 server cannot be stopped using the stop batch file and I have to kill all processes using Task Manager. These set of commands works fine on BaseX 7.7 snapshot from June 20th. Let me know if this is a bug or am I missing something here. Thanks, Srini

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk