BaseX-Talk

basex-talk@mailman.uni-konstanz.de

5251 discussions

Uploading a binary file through RestXQ
by Marco Lettere 16 Aug '16

16 Aug '16

Hello all, I'm currently trying to implement a service for uploading Images to a Basex db. There is a frontend service that serves an HTML + Javascript page which receives the upload as an AJAX call from the browser then POSTs the request to the backend service for storing into the db. There is no big issue when doing it directly by a command or a query. I've been even able to do it by using the following code inside the RestXQ of the frontend service: client:connect("localhost", 1984, "user", "pass") ! client:query(., "db:store('files', '" || $name || "', .)", map{ "" : $file}) But when I POST the data to the backend RestXQ I always get the data stored into the DB as *base64* encoded text which messes up the successive retrieves. This is the code I use on the backend: declare %rest:path("/service/files/{$name}") %rest:POST("{$body}") %rest:consumes("image/png", "image/jpg", "image/jpeg", "image/gif", "image/svg+xml") %output:method("text") function m:upload-maps($userid as xs:string, $name as xs:string, $body as item()){ let $stored := db:store("files", $name, $body) return <rest:response> <http:response status="201"/> </rest:response> }; I call this service from the frontend service with the following request where the media-type is according to the uploaded file extension: <http:request href="{$url}" method="POST"> <http:body media-type="image/png"> {$data} </http:body> </http:request> How do I ensure that the data gets into the DB with its correct raw binary format? Thanks, Marco.

2 11

Re: [basex-talk] Autocommit option using sql:connect to Oracle 11.2.0.3 with ojdbc6.jar
by Christian Grün 15 Aug '16

15 Aug '16

Hi Chris (cc to the list), > I've also attached the basexdebug.txt but it just shows the requests so > probably not useful. Sounds ok so far. I have slightly revised our SQL code (although it shouldn’t make a big difference), and I have uploaded a new snapshot [1]. Could you give it a try? In general, our SQL wrapper is pretty simple [1,2]. Maybe you could check if you get autocommit=false running with a plain Java JDBC code snippet? Hope this helps, Christian [1] http://files.basex.org/releases/latest/ [1] https://github.com/BaseXdb/basex/blob/9a700bf1f663b18eb578acb1a8aa8bbb4d4dd… [2] https://github.com/BaseXdb/basex/blob/9a700bf1f663b18eb578acb1a8aa8bbb4d4dd… > > Thanks, > > chris > > On 12 August 2016 at 14:46, Christian Grün <christian.gruen(a)gmail.com> > wrote: >> >> Could you try the -d command-line flag (or the command SET DEBUG true >> in the GUI) and check if you get some helpful feedback on stderr? >> >> >> On Fri, Aug 12, 2016 at 3:44 PM, chrisis <chrisisanon(a)gmail.com> wrote: >> > The connection is opened successfully.Not getting any feedback. >> > I'm doing a lot of inserts in a loop and it's committing after every >> > insert. >> > My issue is with the overhead of all the extra commits >> > >> > >> > >> > >> > >> > >> > Thanks, >> > >> > chris >> > >> > >> > On 12 August 2016 at 14:19, Christian Grün <christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> > I'm trying to set the autocommit option off and I can't seem to get >> >> > it >> >> > to >> >> > work. >> >> > I'm passing the option to sql:connect as a map >> >> > map { 'autocommit': false() } >> >> > I also tried map { 'autoCommit': false() } as the Oracle JDBC docs >> >> > seem >> >> > to >> >> > suggest. >> >> >> >> What’s happening? Do you get any feedback? >> >> >> >> Thanks >> >> Christian >> > >> > > >

2 1

BaseX 8.5.3: Improved thread safety
by Christian Grün 15 Aug '16

15 Aug '16

Hi everyone, Normally, we do not announce patch releases anymore, but we’d like to point out that we have spent quite some effort in making xquery:fork-join [1] more thread-safe! As usual, you can already play around with the upcoming 8.6 features [2], which are already available in our patch release. Have fun with the new version [3], your feedback is welcome, Christian [1] http://docs.basex.org/wiki/XQuery_Module#xquery:fork-join [2] http://docs.basex.org/index.php?search=8.6 [3] http://basex.org/downloads

1 0

Java
by Tushar Deshmukh 14 Aug '16

14 Aug '16

Namaste all, I have embedded jetty in my application. I am creating basex database. But this database is created on users/public folder in Windows. I wanted to create it under my application folder. For this I have executed context to set dbpath. But it's returning error. Please help how to set dbpath in Java. If possible please please give code snippet. Thanks

2 1

Autocommit option using sql:connect to Oracle 11.2.0.3 with ojdbc6.jar
by chrisis 12 Aug '16

12 Aug '16

I'm trying to set the autocommit option off and I can't seem to get it to work. I'm passing the option to sql:connect as a map map { 'autocommit': false() } I also tried map { 'autoCommit': false() } as the Oracle JDBC docs <http://docs.oracle.com/cd/E11882_01/appdev.112/e13995/constant-values.html#…>seem to suggest. Am I missing something obvious? Regards, Chris Sweeney

2 1

multiple inserts/update/deletes in single transaction
by Wang, Genneva 11 Aug '16

11 Aug '16

Hi I’m trying to figure out whether batched transaction would work for basex, and I came across the RUN and EXECUTE command specified in http://files.basex.org/releases/8.4/BaseX84.pdf page 58-59. The document mentioned following in the summary section: RUN:Evaluates the contents of file as XQuery expression. If the file ends with the suffix .bxs, the file content will be evaluated as command script. This command can be used to run several commands in a single transaction EXECUTE: Evaluates the specified input as command script. This command can be used to run several commands in a single transaction. I’ve tried this myself For example, I’d like to know if I batch 2 inserts, if one fails, would both inserts get rollback. I’m using a simple .bxs (attached and also listed below for your convenience) and run the execute using GUI. OPEN test ADD TO embedded7.xml <root>embedded</root> ADD TO embedded8.xml <root>embedded CLOSE The second ADD (embedded8.xml) is not a valid xml format so I’m expecting it to fail, and rollback both files if any of them have already added. But after executing this script, I’m seeing embedded7.xml have been added. Would you be able to confirm if this is the expected behavior ? If so, is there anyway that I can batch multiple inserts and ensures that these batch of files can be committed at the same time, and rollback all together if any of the file has an error ? Thank you very much for your help.

4 17

BaseX - Parse out to ORM and/or pandas json
by Sayth Renshaw 08 Aug '16

08 Aug '16

Hi I am readimg the docs and can use xpath and somewhat xquery, what i can't envision is the workfow one i have data established in xbase. The parsers in seem logical http://docs.basex.org/wiki/Parsers . So thinking i have data in my basex db and i want to explore it and analyze it in pandas. Pandas accepts a wide range of formats including xml. So i create my xpath query and i see the data i want how should i create an output say json as i could later use that as a data bag in a static website. Is this easy to keep and be repeatable? I asked about ORM because i use django orm is it to create a data feed so that an orm style typical setup can stay updated from basex? Sorry for the silly conceptual questions, cant get the lay of the land. Sayth

2 2

Troubles moving queries from client side to .xq files on the server side using REST.
by Mike Engledew 07 Aug '16

07 Aug '16

I have some running code that used the "propitiatory" basex communication method over TCP/IP. The application was calling basex "client" side (from an Ant task) so this was all fine. Being used to the SQL paradigm of "preparing" an SQL statement then executing it with different "host variable" values which gives a massive performance advantage over constantly preparing an SQL statement with different literal values plugged in, I chose the same approach for my original XQuery application. String partDelete = "declare namespace xyz=\"" + BaseXML.NAMESPACE_URL + "\";\n" + "declare variable $contributor external;\n" + "delete node /xyz:driver[@name=\"" + driver.getDriverName() + "\"]/xyz:part[@contributor=$contributor]"; This statement is executed multiple times from within a loop to delete many "parts", before each execution I perform :- pd.bind("$contributor", contributor); pd.execute() Now we are trying to move the code from being client side to server side, the server is using RESTful interfaces for all external interactions so we are migrating the BaseX interaction to REST too. I reasoned that if I created a partdelete.xq file on the server that I could then perform a rest request passing in the values of driver and contributor emulating the "host variable" approach. I created partdelete.xq module namespace xyz = 'http://my.basex.server.net/xyz'; declare variable $driver external; declare variable $contributor external; delete node /zss:driver[@name=\"$driver"]/zss:part[@contributor=$contributor] Then (using postman) performed a GET request on //http:my.basex.server.ne:8984/rest/ TESTDB?run=partdelete.xq&$driver=TESTDRVR&$contributor=LINUX During my experiments I have managed to get many different error messages, but never got even close to making this work. Questions: o Am I fooling myself that creating a server side .xq file is going to perform better than building a completed query on the client and sending that via REST without "variables"? o Is there a way to perform the equivalent "prepare/execute" method from the client without creating a .xq file on the server? o Can anyone suggest how I can get the server side .xq file to work? I also have a query which is executed before the delete to obtain the list of parts to delete. I was unable to make this work either. The .xq file looked like this module namespace xyz = 'http://my.basex.server.net/xyz'; declare variable $driver external; declare variable $contributor external; for $p in /xyz:driver[@name="$driver"]/xyz:part, $o in $p/xyz:part-outputs/xyz:part-output where $p/@contributor/data() = $contributor return data($o/@type)||"/"||data($p/@class)||"/"||data($p/@hostname) The query works fine from the client side, and since this is only executed once it's no big deal to prefill all the values and dispense with the variables and send it over REST. I could (I suppose) alternatively use the <variable element as indicated in the BaseX documentation, but it's unclear how that would offer any performance advantage. Being a lover of consistency I would like to move both queries over to the BaseX server side. Examples of some of the errors I managed to produce ... [XPST0081] No namespace declared for 'xyz:driver' [XPST0003] Library modules cannot be evaluated [XPDY0002] root(): no context value bound. Any help, advice or suggestions greatly appreciated. Mike

2 3

authentication with REST API
by Claudio Cacciari 04 Aug '16

04 Aug '16

Dear All, I'm working with a BaseX instance ver 8.5.1, deployed on a tomcat 7 as war package, on a centos 7.2. I'm trying to understand how to configure the REST API authentication. Apparently, using the REST API, the authentication is required for create/write operations, but not for reading. I mean that I can download an XML resource stored in the DB, just putting the path in the browser without performing any authentication. Would it be possible to configure it in order to put even the GET calls under authentication? Is my configuration wrong? I have added a username/password in the file web.xml: <web-app> [...] <context-param> <param-name>org.basex.user</param-name> <param-value>myuser</param-value> </context-param> <context-param> <param-name>org.basex.password</param-name> <param-value>mypassword</param-value> </context-param> <context-param> <param-name>org.basex.authmethod</param-name> <param-value>Basic</param-value> </context-param> [...] <servlet> <servlet-name>REST</servlet-name> <servlet-class>org.basex.http.rest.RESTServlet</servlet-class>  <init-param> <param-name>org.basex.user</param-name> <param-value>myuser</param-value> </init-param> <init-param> <param-name>org.basex.password</param-name> <param-value>mypassword</param-value> </init-param> </servlet> [...] which results in a user.xml file like this: $cat /usr/share/tomcat/webapps/BaseX851/data/users.xml <users> <user name="admin" permission="admin"> <password algorithm="digest"> <hash>8c6f257a751d87d1eae5ab59710a818a</hash> </password> <password algorithm="salted-sha256"> <salt>3631994636103909</salt> <hash>9d25a8e3dc227e54f098c3cf3b8d1ca92b76a3bebb62e0f04299beaaf443908d</hash> </password> </user> <user name="myuser" permission="create"> <password algorithm="digest"> <hash>d3adbad8e6540a70a8b958ab27eec9b8</hash> </password> <password algorithm="salted-sha256"> <salt>3629615605296334</salt> <hash>3b64152088b90a2944b07a3d63703cdb8bffd1ccc21e5a40fe2e1f2a19307647</hash> </password> </user> </users> Thanks, Claudio

2 2

BaseX performance 7.x vs 8.x
by Bondeson, Carl 04 Aug '16

04 Aug '16

I am seeing huge differences in the performance of a multi-threaded JBoss application recently upgraded from 7.9 to 8.4. The problem is that 8.4 is much slower than 7.9. Any ideas? Do I need to add indices or something along those lines? Carl R Bondeson IT Analyst 3 Information Technology Connecticut Department of Public Health 410 Capitol Ave Hartford, CT 06134 Phone: 860-509-7434 carl.bondeson(a)ct.gov<mailto:carl.bondeson@ct.gov> [logosmall]

4 10

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk