BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5250 discussions

JSON serialisation for results
by Bell, Darren S 03 Sep '13

03 Sep '13

Hi, I'm new to BaseX. We are running a simple XQuery: declare variable $documentguid as xs:string external; <utterances> { for $targetelements in /*:TEI/*:text/*:body/*:u[/*:TEI/*:teiHeader/*:fileDesc/*:publicationStmt/*:idno[@type='qudexdocument']=$documentguid] return <utterance> <guid>{data($targetelements/@xml:id)}</guid> <speaker>{data($targetelements/@who)}</speaker> <text>{data($targetelements/text())}</text> </utterance> } </utterances> by calling http://dahdsst2:8984/rest/DF?run=interviewutterances.xq&documentguid=q-25d5… All works well but our UI developers are not happy with the JSONML as a serialization format. I changed the output method to 'json' and this returns "[BXJS0002] JSON serialization: <json> expected as root node." So then I changed the <utterances> root element to <json> and then I get: [BXJS0002] JSON serialization: Element <json> must be typed as "object" or "array". I'm a bit lost at this point. I've consulted the documentation but there is not very much detail about the specific steps to go about serialising an XQuery output as JSON. The standard JSON format I'm trying to output is like so: { "utterances": { "utterance": [ { "guid": "q-2f0de4c5-7dfb-e211-b501-000bdb5cc6d5", "speaker": "interviewer", "text": "I'd like to start, if I may, by asking you your birth date." }, { "guid": "q-300de4c5-7dfb-e211-b501-000bdb5cc6d5", "speaker": "subject", "text": "November 9th, 1902." }, { "guid": "q-310de4c5-7dfb-e211-b501-000bdb5cc6d5", "speaker": "interviewer", "text": "Could you tell me how many children there were in your family?" } ] } } Any tips on how to go about this in BaseX would be much appreciated, Regards, ___________________________________ DARREN BELL Data and Services Developer ___________________________________ T +44(0) 1226 272144 E dbell(a)essex.ac.uk W ukdataservice.ac.uk ___________________________________ UK Data Service UK Data Archive University of Essex ___________________________________ Legal Disclaimer: Any views expressed by the sender of this message are not necessarily those of the UK Data Service or the UK Data Archive. This email and any files with it are confidential and intended solely for the use of the individual(s) or entity to whom they are addressed.

2 1

Re: [basex-talk] Mistaken order?
by Wendell Piez 02 Sep '13

02 Sep '13

Dear Arve, Ouch! The behavior is indeed as expected in 7.7. It is unexpected (and non-conformant) in 7.7 beta. The saddest thing is that I have 7.7 installed and could have tried it there before posting. :-( Cheers, Wendell Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^ On Mon, Sep 2, 2013 at 2:05 AM, Arve Gengelbach <ag(a)basex.org> wrote: > Hi Wendell, > > running your query on any database with BaseX version 7.7, everything > works as expected. Using the latter version? > > cheers, > Arve > > > Am 01.09.13 18:21, schrieb Wendell Piez: >> Dear BaseX, >> >> Running in the GUI, I execute: >> >> let $source := (/)[1] >> >> let $wrapped := <wrapper> >> { $source/*/* } >> <new/> >> </wrapper> >> >> return $wrapped/*/name() >> >> I expect to get a sequence of the names of element children of the >> document (root) element of the first entry in the currently open >> database, with a 'new' element named at the end. >> >> Instead, I get 'new' followed by the names of the elements in the >> document, with 'new' first. (And I see 'new' for ($insert/*/name())[1] >> and not for ($insert/*/name())[last()].) >> >> When I look at $insert itself, the document itself looks like what I expect. >> >> Where am I going wrong, or is this a bug? >> >> Cheers, Wendell >> >> >> Wendell Piez | http://www.wendellpiez.com >> XML | XSLT | electronic publishing >> Eat Your Vegetables >> _____oo_________o_o___ooooo____ooooooo_^ >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>

1 0

Mistaken order?
by Wendell Piez 01 Sep '13

01 Sep '13

Dear BaseX, Running in the GUI, I execute: let $source := (/)[1] let $wrapped := <wrapper> { $source/*/* } <new/> </wrapper> return $wrapped/*/name() I expect to get a sequence of the names of element children of the document (root) element of the first entry in the currently open database, with a 'new' element named at the end. Instead, I get 'new' followed by the names of the elements in the document, with 'new' first. (And I see 'new' for ($insert/*/name())[1] and not for ($insert/*/name())[last()].) When I look at $insert itself, the document itself looks like what I expect. Where am I going wrong, or is this a bug? Cheers, Wendell Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^

1 0

Re: [basex-talk] username after login with jetty's HashLoginModule AND parallel update queries
by Florian Eckey 29 Aug '13

29 Aug '13

Hi, that's the way I have realized the login before, but now I combine this with the http basic authentication, because otherwise you can download all files in the webapp directory without being logged in. I have realized it in that way, but now I can't get the username of the user who is logged in. Is there any way to read the "org.eclipse.jetty.security.UserIdentity" attribute in the session? I always get an error: HTTP ERROR 400 Problem accessing /restxq/getSession/org.eclipse.jetty.security.UserIdentity. Reason: Stopped at D:/Projects/******/basex77/basex/webapp/restxq/utilities.xqm, 35/18: [BXSE0002] Stored attribute cannot be retrieved: SessionAuthentication. Stack Trace: - D:/Projects/******/basex77/basex/webapp/restxq/utilities.xqm, 34/13 _____ Powered by Jetty:// The server stops at the line, where it tries to read the session attribute "org.eclipse.jetty.security.UserIdentity". Another question: Is there any way to realize parallel update queries in baseX? Cheers, Florian -----Ursprüngliche Nachricht----- Von: basex-talk-bounces(a)mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] Im Auftrag von Dirk Kirsten Gesendet: Montag, 26. August 2013 11:44 An: basex-talk(a)mailman.uni-konstanz.de Betreff: Re: [basex-talk] username after login with jetty's HashLoginModule Hello Florian, you might want to ask this question on the jetty mailing list as this seems to be not really specific to BaseX. You most likely also will get a more useful response as we are no jetty experts per se. However, I also couldn't find any HashLoginModule in our default jetty.xml (and I did a quick google search and could find anything), so I am not really sure what you actually do. Might be useful to post the relevant part of your jetty.xml. Btw, in our RestXQ-based applications we mainly use application-defined authentication, i.e. we first check the proper login within each output function, so something like: if(not(_:logged-in())) then () else where _:logged-in() is simply declare function _:logged-in() as xs:boolean { boolean(_:id()) }; and we set the session variable during login. Cheers, Dirk On 08/26/2013 11:25 AM, Florian Eckey wrote: > Hey, > > I have a problem with the jetty authentication. I use the > HashLoginModule, which is configured in the jetty.xml. The problem is, > that I find no way to write the username in the session, so after > login I have no username to deal with. Has anyone solved the same or a > similar problem? Or are there any tips how to implement a secure > login, after that I can use the entered username in the session? > > regards > > Florian > > _______________________________________________ > BaseX-Talk mailing list > <mailto:BaseX-Talk@mailman.uni-konstanz.de> BaseX-Talk(a)mailman.uni-konstanz.de > <https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > -- Dirk Kirsten, BaseX GmbH, <http://basex.org> http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 _______________________________________________ BaseX-Talk mailing list <mailto:BaseX-Talk@mailman.uni-konstanz.de> BaseX-Talk(a)mailman.uni-konstanz.de <https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 2

BaseX 7.7: The Happy-Birthday-Leo Edition
by Christian Grün 29 Aug '13

29 Aug '13

Hi everyone, we are excited to give you Version 7.7 of BaseX -- the Happy-Birthday-Leo Edition -- which provides a bunch of new and improved features: XQUERY - Support for XQuery 3.0 has been finalized http://docs.basex.org/wiki/XQuery_3.0 - the Unit Module allows standardized testing of XQuery applications http://docs.basex.org/wiki/Unit_Module - the Streaming Module speeds up operations on large files http://docs.basex.org/wiki/Streaming_Module - the Inspection Module provides reflection and documentation features http://docs.basex.org/wiki/Inspection_Module - we have added support for XQuery collations http://docs.basex.org/wiki/Full-Text#Collations - we have extended the Database, Archive, File and other Modules http://docs.basex.org/wiki/Module_Library WEB/HTTP SERVICES: - WebDAV has been enriched with locking features (sponsored feature!) http://docs.basex.org/wiki/WebDAV#Locking - RESTXQ has been improved and extended: http://docs.basex.org/wiki/RESTXQ CORE - improved database locking, including the use of custom lock strings http://docs.basex.org/wiki/Transaction_Management - database names have got more flexible http://docs.basex.org/wiki/Commands#Valid_Names - we have new options for simplifying the creation of large databases http://docs.basex.org/wiki/Options BaseX is one of the leading open source XML database and XQuery 3.0 processors, including full support for the W3C Update and Full Text extensions. An interactive GUI frontend gives you great insight into your XML documents, and the client-/server-architecture and web services make it a great framework for building powerful web applications. Please find more information at: http://basex.org Have fun with our new release! Looking forward to your feedback, Christian BaseX Team, 2013

3 2

Proposals. Custom query slot management, named instances and read-only databases
by Alexander Shpack 28 Aug '13

28 Aug '13

Hi everyone! Our current project, based on BaseX, was failed on launch, because we have any practice with optimization for NoSQL databases and take the bottleneck with write locks, but we take the unbelievable experience with BaseX. Today I know, how to get the maximum from this DB 1. Custom query slot management. It would be useful, if query command can take the number of taken slot. >From code side I know, that some type of requests is very simple, very fast, and DB can return rapidly the results back. And this type of requests may be sticked to some query slots permanently. From other side, heavy xQuery code may be managed automatically by BaseX 2. Named instances We need to start multiple BaseX servers to utilize more then one CPU core. It would be useful to set up the name for each instance by personal .basex config 3. Access mode Next proposal is simple. Allow to manage the type of access (read or write only, both) to DB for list of named instances. This proposal may help with the next architecture: many servers with one DBPATH. Server1 Server2 Server3 | | | -------------------------------- | | | | DB1 DB2 DB3 DB4 DB1 permissions Read: Server1, Server3 Write: Server2 DB2, DB3, DB4 permissions Read: Server1, Server2 Write: Server2 This may protect from DB corrupts. Is it interesting concept? -- s0rr0w

1 0

security issues
by Ertan Tike 27 Aug '13

27 Aug '13

Hi, We are providing an cloud based application development environment with using the basex database. We want to allow developers can write xquery commands to access database but some security issues has appeared. For example " file:list('c:/') " query returns the list of C:\ directory. Is it possible to exclude some of modules from basex engine or is there any other way to execute query in sandbox environment which allows only FLWOR expressions and basic modules like "Math". Scanning "file:" like prefixes may be a solution but maybe there is a better way to do it. Thank you for help. -- Ertan TİKE <http://www.6kare.com>

2 1

username after login with jetty's HashLoginModule
by Florian Eckey 26 Aug '13

26 Aug '13

Hey, I have a problem with the jetty authentication. I use the HashLoginModule, which is configured in the jetty.xml. The problem is, that I find no way to write the username in the session, so after login I have no username to deal with. Has anyone solved the same or a similar problem? Or are there any tips how to implement a secure login, after that I can use the entered username in the session? regards Florian

2 1

Re: [basex-talk] Documentation
by Thomas Daly 25 Aug '13

25 Aug '13

Thank you very much for your reply. I assume that in your example commands, mydoc.xml already existed as a file on your hard drive. In my case, the system looked for mydoc.xml rather than create it: > CREATE DB db1 Database 'db1' created in 14.41 ms. > ADD mydoc.xml Resource "/home/tcd/mydoc.xml" not found. Your 2nd ADD command worked, which I assume gives us an XML file empty apart from a root node <a/>: > ADD TO doc2.xml <a/> Path "doc2.xml" added in 2.72 ms. > INFO STORAGE PRE DIS SIZ ATS ID NS KIND CONTENT ------------------------------------------ 0 1 2 1 0 0 DOC doc2.xml 1 1 1 1 1 0 ELEM a Now I'd like to add a new node to the new document. I've tried two variants as follows: > XQUERY insert node <newnode/> into <a/> Query executed in 2.09 ms. > XQUERY insert node <newnode/> into doc('doc2.xml')/a Stopped at ., 1/33: [FODC0002] Resource '/home/tcd/doc2.xml' does not exist. Although the first XQUERY command appeared to work, if I export the XML file with the EXPORT command and examine it, unfortunately the new node is not present. The file just contains the <a/> node. Is there any variation of the EXPORT command that will simply echo the contents of the XML file to the terminal, rather than to a file? If not, that would be a useful addition. Best regards, Thomas At 11:00 25/08/2013, you wrote: >Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > >To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > >You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > >When replying, please edit your Subject line so it is more specific >than "Re: Contents of BaseX-Talk digest..." > > >Today's Topics: > > 1. Documentation (Thomas Daly) > 2. Re: Documentation (Dimitar Popov) > > >---------------------------------------------------------------------- > >Message: 1 >Date: Sat, 24 Aug 2013 16:25:17 +0100 >From: Thomas Daly <thomas.daly(a)live.com> >To: basex-talk(a)mailman.uni-konstanz.de >Subject: [basex-talk] Documentation >Message-ID: <BLU0-SMTP12145626E8EAB6750E955A2914F0(a)phx.gbl> >Content-Type: text/plain; charset="us-ascii"; format=flowed > >Hello, > >Thank you for this system, which looks promising. > >I would like to request better documentation to show how to do the >most basic things. I am trying to create a new database and add a >single new record to it. I don't want to start with a pre-written >XML document. So using the command line client tool: > > > CREATE DB users >Database 'users' created in 214.89 ms. > >Then I refer to the ADD command >http://docs.basex.org/wiki/Commands#ADD which suggests an XML string >can be added. So I try: > > > ADD <record>hello</record> >Name '' is invalid. > >All the examples of ADD involve adding existing XML files. A path to >the database is referred to, but having just created the database I >have no idea what the path is. > >Referring to tutorials and slides on page >http://docs.basex.org/wiki/Getting_Started, the link to XMLPrague >2013 is broken. BaseX adventures starts at an advanced level of >querying a host of XML files. W3Schools XQuery seems all about >querying existing databases, I can't find anything on how to add or >update a single record. > >I'm sure with enough trial and error I'll work out how to do it. My >point is that I feel it ought to be more obvious how to carry out the >most basic CRUD operations. > >Best regards, >Thomas > > > >------------------------------ > >Message: 2 >Date: Sat, 24 Aug 2013 23:31:36 +0200 >From: Dimitar Popov <dp(a)basex.org> >To: basex-talk(a)mailman.uni-konstanz.de >Subject: Re: [basex-talk] Documentation >Message-ID: <1377379896.5833.0.camel@darkrider> >Content-Type: text/plain; charset="UTF-8" > > >On Sat, 2013-08-24 at 16:25 +0100, Thomas Daly wrote: > > Hello, > > > > Thank you for this system, which looks promising. > > > > I would like to request better documentation to show how to do the > > most basic things. I am trying to create a new database and add a > > single new record to it. I don't want to start with a pre-written > > XML document. So using the command line client tool: > > > > > CREATE DB users > > Database 'users' created in 214.89 ms. > > > > Then I refer to the ADD command > > http://docs.basex.org/wiki/Commands#ADD which suggests an XML string > > can be added. So I try: > > > > > ADD <record>hello</record> > > Name '' is invalid. > > > > All the examples of ADD involve adding existing XML files. A path to > > the database is referred to, but having just created the database I > > have no idea what the path is. > >BaseX supports the notion of collections, i.e. one can store multiple >XML documents into a single database. Each non-empty database contains >at least one document. Each stored document must have a name. This is >the reason why when calling the ADD command with an XML fragment one >must specify the name of the new document. However, if a file is >specified as input, then the file name is implicitly used as a name of >the new document. > >Similar behavior has the CREATE DB command. If called with a file, then >a document with the name of the file will be created. If called with an >XML fragment, then the database name will be used as the name of the >first document. The following examples illustrate the two commands: > > > CREATE DB db1 >Database 'db1' created in 68.92 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >----------------------------------------- > > > ADD mydoc.xml >Path "mydoc.xml" added in 15.36 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >------------------------------------------- > 0 1 2 1 0 0 DOC mydoc.xml > 1 1 1 1 1 0 ELEM a > > > ADD TO doc2.xml <a/> >Path "doc2.xml" added in 4.5 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >------------------------------------------- > 0 1 2 1 0 0 DOC mydoc.xml > 1 1 1 1 1 0 ELEM a > 2 3 2 1 2 0 DOC doc2.xml > 3 1 1 1 3 0 ELEM a > > > CREATE DB db2 mydoc.xml >Database 'db2' created in 12.57 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >------------------------------------------- > 0 1 2 1 0 0 DOC mydoc.xml > 1 1 1 1 1 0 ELEM a > > > CREATE DB db3 <a/> >Database 'db3' created in 13.6 ms. > > > INFO STORAGE >PRE DIS SIZ ATS ID NS KIND CONTENT >----------------------------------------- > 0 1 2 1 0 0 DOC db3.xml > 1 1 1 1 1 0 ELEM a > > > > Referring to tutorials and slides on page > > http://docs.basex.org/wiki/Getting_Started, the link to XMLPrague > > 2013 is broken. > >Thanks, I fixed the link. Please, report such inaccuracies or feel free >to edit the wiki yourself. > > > BaseX adventures starts at an advanced level of querying a host > of XML files. W3Schools XQuery seems all about > > querying existing databases > >The BaseX documentation contains only the BaseX specific functionality - >the purpose is not to duplicate the W3C specification or the tutorials >at W3Schools. However, XQuery questions are readily answered on the >mailing list ;) > > > I can't find anything on how to add or update a single record. > >The XQuery Update Facility might be helpful to you [1]. > > > I'm sure with enough trial and error I'll work out how to do it. My > > point is that I feel it ought to be more obvious how to carry out the > > most basic CRUD operations. > >I couldn't agree more. On the other hand the BaseX team gives its best >to maintain the documentation and is always open to improvement >suggestions. So if you have any concrete ideas how the documentation can >be made more useful, they will be most welcome. > >Regards, >Dimitar > >[1] http://www.w3.org/TR/xquery-update-10/ > > > > >------------------------------ > >_______________________________________________ >BaseX-Talk mailing list >BaseX-Talk(a)mailman.uni-konstanz.de >https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > >End of BaseX-Talk Digest, Vol 44, Issue 24 >******************************************

2 1

Documentation
by Thomas Daly 24 Aug '13

24 Aug '13

Hello, Thank you for this system, which looks promising. I would like to request better documentation to show how to do the most basic things. I am trying to create a new database and add a single new record to it. I don't want to start with a pre-written XML document. So using the command line client tool: > CREATE DB users Database 'users' created in 214.89 ms. Then I refer to the ADD command http://docs.basex.org/wiki/Commands#ADD which suggests an XML string can be added. So I try: > ADD <record>hello</record> Name '' is invalid. All the examples of ADD involve adding existing XML files. A path to the database is referred to, but having just created the database I have no idea what the path is. Referring to tutorials and slides on page http://docs.basex.org/wiki/Getting_Started, the link to XMLPrague 2013 is broken. BaseX adventures starts at an advanced level of querying a host of XML files. W3Schools XQuery seems all about querying existing databases, I can't find anything on how to add or update a single record. I'm sure with enough trial and error I'll work out how to do it. My point is that I feel it ought to be more obvious how to carry out the most basic CRUD operations. Best regards, Thomas

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk