- BaseX-Talk - mailman.uni-konstanz.de

question on starting multiple instance of basex
by Wang, Genneva 04 Sep '16

04 Sep '16

Hi I’m trying to set up to having multiple instance of basex in my local dev environment, presumably to simulate production environment where our application is pointing to two different basex that running a different server. I’ve running basex as client server application in dev environment. Is there a way to do that? I’ve tried to start basex server with 2 different ports A and B, and also starting client with port A and B, but both seemed to be pointing to the same list of the databases that was created. Any tips would be greatly appreciated. Thanks! Regards, -Genneva

1 0

Fwd: REST API not working
by E. Wray Johnson 02 Sep '16

02 Sep '16

C:\Users\Administrator>basexserver -d BaseX 8.5.3 [Server] Server was started (port: 1984). On Thu, Sep 1, 2016 at 5:13 AM, Dirk Kirsten <dk(a)basex.org> wrote: > Hello, > > How do you start the basex server? Could you please start it in debug mode > and post us the console output? > Cheers, Dirk > > > On 08/31/2016 04:41 PM, E. Wray Johnson wrote: > > I apologize, by 12 I meant Windows Server 2012. > BaseX version is 8.5.3 > By TCP vs REST I mean for REST I was using default port 8984 instead of > the default server TCP port 1984 > For example: http://*admin*:*admin*@localhost:8984/*rest *OR > http://localhost:8984/ > *rest * > I run basexserver from DOS Command Prompt > *. * > I am using a web browser to test as I have many times before with version > 8.4 > I know the server is listening because it hangs and does not return, which > does not occur when the server is stopped. > > On Wed, Aug 31, 2016 at 9:15 AM, Dirk Kirsten <dk(a)basex.org> wrote: > >> Hello, >> >> Windows 12? I am an long-time linux-only user, but isn't the most >> current windows version 10 or am I missing the news completely? >> >> You will have to be much more specific. Please specify which BaseX >> version you use, please post how you start the basexserver and the >> console output and how you try to reach the REST endpoint. Also, I don't >> know what you mean by you are not confusing TCP and REST port. This >> statement doesn't really make sense, as REST uses TCP... >> >> Cheers >> >> Dirk >> >> >> On 08/31/2016 02:09 PM, E. Wray Johnson wrote: >> > Windows 12 server, running basexserver. Server is listening but hangs >> and never returns anything. When server is killed behavior is different so >> I can tell the server was listening on the REST port when running. I am >> not confusing the TCP port with REST port. >> >> -- >> Dirk Kirsten, BaseX GmbH, http://basexgmbh.de >> |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz >> |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: >> | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle >> `-- Phone: 0049 7531 91 68 276, Fax: 0049 7531 20 05 22 >> >> > > > -- > Dirk Kirsten, BaseX GmbH, http://basexgmbh.de > |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz > |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: > | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle > `-- Phone: 0049 7531 91 68 276, Fax: 0049 7531 20 05 22 > >

1 2

post about basex and parse trees
by Stefan Petrea 01 Sep '16

01 Sep '16

Hey, Recently worked on a project using BaseX [2]. I wrote a blog post about it here [1]. Something that might be interesting is building a Merkle tree [3] [4] in XQuery and storing/querying it in BaseX. [1] https://blog.garage-coding.com/2016/09/01/detecting-potentially-malicious-p… [2] https://github.com/wsdookadr/mdetect [3] https://github.com/wsdookadr/mdetect/blob/master/resources/mast.xql [4] https://en.wikipedia.org/wiki/Merkle_tree

1 0

Re: [basex-talk] REST API not working
by E. Wray Johnson 01 Sep '16

01 Sep '16

I apologize, by 12 I meant Windows Server 2012. BaseX version is 8.5.3 By TCP vs REST I mean for REST I was using default port 8984 instead of the default server TCP port 1984 For example: http://*admin*:*admin*@localhost:8984/*rest *OR http://localhost:8984/ *rest* I run basexserver from DOS Command Prompt *.* I am using a web browser to test as I have many times before with version 8.4 I know the server is listening because it hangs and does not return, which does not occur when the server is stopped. On Wed, Aug 31, 2016 at 9:15 AM, Dirk Kirsten <dk(a)basex.org> wrote: > Hello, > > Windows 12? I am an long-time linux-only user, but isn't the most > current windows version 10 or am I missing the news completely? > > You will have to be much more specific. Please specify which BaseX > version you use, please post how you start the basexserver and the > console output and how you try to reach the REST endpoint. Also, I don't > know what you mean by you are not confusing TCP and REST port. This > statement doesn't really make sense, as REST uses TCP... > > Cheers > > Dirk > > > On 08/31/2016 02:09 PM, E. Wray Johnson wrote: > > Windows 12 server, running basexserver. Server is listening but hangs > and never returns anything. When server is killed behavior is different so > I can tell the server was listening on the REST port when running. I am > not confusing the TCP port with REST port. > > -- > Dirk Kirsten, BaseX GmbH, http://basexgmbh.de > |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz > |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: > | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle > `-- Phone: 0049 7531 91 68 276, Fax: 0049 7531 20 05 22 > >

2 1

Problems with 8.5.3
by Marco Lettere 31 Aug '16

31 Aug '16

Hi all, after passing to 8.5.3 we have several points in our current application that stop working. The first one refers to the use of sql module. The following query worked neatly in previous version 8.5.1 beta .... let $init := sql:init("com.mysql.jdbc.Driver") let $connection := sql:connect("jdbc:mysql://localhost:3306/adb?useSSL=false", "user", "pass") return (sql:execute($connection, "select 1 + 1 from dual"), sql:close($connection)) returns: <sql:row xmlns:sql="http://basex.org/modules/sql"> <sql:column name="1 + 1">2</sql:column> </sql:row> In 8.5.3 we get the following stacktrace: Version: BaseX 8.5.3 Java: Oracle Corporation, 1.8.0_91 OS: Windows 7, x86 Stack Trace: java.lang.RuntimeException: Class org.basex.query.QueryResources can not access a member of class org.basex.query.func.sql.JDBCConnections with modifiers "" at org.basex.util.Util.notExpected(Util.java:62) at org.basex.query.QueryResources.index(QueryResources.java:121) at org.basex.query.func.sql.SqlFn.jdbc(SqlFn.java:36) at org.basex.query.func.sql.SqlConnect.item(SqlConnect.java:35) [….] We have also an issue with executing xquery:invoke on -xqm files that are stored in subdirectories of the invoking module. But I still have to repdroduce a SSCE first. Thanks for any support. Regards, Marco.

2 2

REST API not working
by E. Wray Johnson 31 Aug '16

31 Aug '16

Windows 12 server, running basexserver. Server is listening but hangs and never returns anything. When server is killed behavior is different so I can tell the server was listening on the REST port when running. I am not confusing the TCP port with REST port.

3 3

Basex server ports
by Bram Vanroy 31 Aug '16

31 Aug '16

Hi all I am trying to initialise multiple server on a single machine. This will probably be possibly by listening to different ports. The question that I have is that I am not sure which values to change in the .basex file. Candidates are: PORT SERVERPORT EVENTPORT STOPPORT Which of these cannot be the same when running a BaseX server on the same machine? Thank you in advance Bram Vanroy

3 3

REST API performance, massive disk IO
by Braunschweig, Björn 29 Aug '16

29 Aug '16

Hello everybody, Im using the basexhttp docker image: root@koala:/tmp# docker images | grep basexhttp basex/basexhttp 8.4.1 54d1e0001449 3 months ago 628.1 MB On ubuntu 14.04 [1] and the python client library: <https://github.com/lucalianas/pyBaseX> https://github.com/lucalianas/pyBaseX I have a performance problem with the setup. The database gets filled up by up to 64 parallel clients using the REST api. Currently the database has a size of 2GB, 74899811 Nodes, 305756 Documents. For every document I add, I can see a lot of disk I/O on my host with up to 80MB/s [2] by the org.basex.BaseXHTTP class. The size of the xml documents cannot be the cause, they are < 10KB. The corresponding response time of the api is in the range of 10-30 seconds [3]. Furthermore the basex docker container log shows a HTTPException and a strange Creating Database... for every request [4]. strace of the basex process shows massive open/write calls [5]. What am I doing wrong? :-) Thx, Björn Braunschweig [1] root@koala:~# cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=14.04 DISTRIB_CODENAME=trusty DISTRIB_DESCRIPTION="Ubuntu 14.04.5 LTS" root@koala:~# uname -a Linux koala 3.13.0-93-generic #140-Ubuntu SMP Mon Jul 18 21:21:05 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux [2] accumulated disk io after a couple of seconds root@koala:/tmp# iotop -a -P Total DISK READ : 3.88 K/s | Total DISK WRITE : 53.39 M/s Actual DISK READ: 3.88 K/s | Actual DISK WRITE: 52.84 M/s PID PRIO USER DISK READ DISK WRITE> SWAPIN IO COMMAND 62061 be/4 1984 8.00 K 2.20 G 0.00 % 0.01 % java -cp /usr/src/basex/basex-api/target~.2.jar: -Xmx2048m org.basex.BaseXHTTP d [3] my application log: 18 seconds till response 2016-08-15 14:52:00,337 | dmp043 | 46912496392256 | INFO | mdqi | add_document | 241 | saving document: urn:diasid:ast:kop01:0201502181219395 340000/mets.xml to db: mets 2016-08-15 14:52:18,164 | dmp043 | 46912496392256 | INFO | mdqi | add_document | 243 | RESPONSE (status code 201): 0 resource(s) replaced in 62.67 ms. [5] docker logs basex Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: _ REQUEST _________________________________ Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: (PUT /rest/mets/urn:diasid:ast:kop01:0201502150401114120000/mets.xml)@843076472 <mailto:org.eclipse.jetty.server.Request@32405378> org.eclipse.jetty.server.Request@32405378 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - Host: koala.gwdg.de:8984 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - Accept: */* Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - Authorization: Basic xxx Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - Content-Length: 7558 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - User-Agent: python-requests/2.10.0 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - Connection: keep-alive Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: - Accept-Encoding: gzip, deflate Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: _ RESPONSE ________________________________ Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: HTTP/1.1 201 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: Content-Type: text/plain;charset=UTF-8#015 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: #015 Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: Creating Database... Aug 12 13:44:21 koala docker/basex/ead004c4ce42[1167]: . 1.98 ms (458 MB) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: org.basex.http.HTTPException: 0 resource(s) replaced in 52.02 ms. Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.basex.http.HTTPCode.get(HTTPCode.java:57) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.basex.http.rest.RESTServlet.run(RESTServlet.java:31) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137 ) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java :231) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java :1086) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java: 193) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java: 1020) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135 ) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:1 16) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.Server.handle(Server.java:370) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpCo nnection.java:494) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnecti on.java:982) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(Abstr actHttpConnection.java:1043) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:236) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java :82) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint. java:696) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.j ava:53) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java: 608) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:5 43) Aug 12 13:44:22 koala docker/basex/ead004c4ce42[1167]: #011at java.lang.Thread.run(Thread.java:745) [4] root@koala:/tmp# strace -t -f -p 9675 -e trace=open -o /tmp/trace.log root@koala:/tmp# root@koala:/tmp# head trace.log 38813 14:23:12 open("/srv/BaseXData/mets/pth.basex", O_WRONLY|O_CREAT|O_TRUNC, 0666) = 129 38797 14:23:12 open("/srv/BaseXData/mets/inf.basex", O_RDONLY) = 76 38797 14:23:12 open("/srv/BaseXData/mets/tbli.basex", O_RDONLY) = 76 38797 14:23:12 open("/srv/BaseXData/mets/tbl.basex", O_RDWR|O_CREAT, 0666) = 76 38797 14:23:12 open("/srv/BaseXData/mets/txt.basex", O_RDWR|O_CREAT, 0666) = 121 38797 14:23:12 open("/srv/BaseXData/mets/atv.basex", O_RDWR|O_CREAT, 0666) = 127 38797 14:23:12 open("/srv/BaseXData/mets/upd.basex", O_WRONLY|O_CREAT|O_EXCL, 0666) = 128 38797 14:23:12 open("/srv/BaseXData/mets/pth.basex", O_RDONLY) = 128 38797 14:23:12 open("/srv/BaseXData/mets/tbli.basex", O_WRONLY|O_CREAT|O_TRUNC, 0666) = 128 38797 14:23:12 open("/srv/BaseXData/mets/inf.basex", O_WRONLY|O_CREAT|O_TRUNC, 0666) = 128

4 4

Docker run basexhttp and permission issues
by Michael Seiferle 28 Aug '16

28 Aug '16

Hi BaseX-Talk, in case any of you is using our docker images, in recent builds there seems to be a bug related to the ENTRYPOINT and the PARENT mvn Image we are using. If you encounter the following error message (in fact you should if you docker pulled recently ;-)): > ⇒ docker run basex/basexhttp > touch: cannot touch ‘/root/.m2/copy_reference_file.log’: Permission denied > Can not write to /root/.m2/copy_reference_file.log. Wrong volume permissions? You might want to override the ENTRYPOINT yourself: > docker run --entrypoint=basexhttp basex/basexhttp I already proposed a fix but I’d like someone with docker-expertise have a look, maybe s/o might want to add her or his 5cts ;-) https://github.com/BaseXdb/basex/pull/1346 <https://github.com/BaseXdb/basex/pull/1346> Best Michael -- Michael Seiferle, BaseX GmbH, http://www.basexgmbh.de |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Fon: +49 7531 916 82 77

2 1

ignoring macos turds via webdav
by Kendall Shaw 19 Aug '16

19 Aug '16

Finder and /bin/cp leave turds wherever they go in some situations. If I use finder or cp in macos to write a file to a basex db mounted via webdav, the log shows something like: [propfind ] …/a.xml [put] …/a.xml [propfind] …/._a.xml [lock] .../a.xml [propfind] .../a.xml [propfind] …/._. [propfind] …/ Then finder complains “some data could not be read or written”, or cp complains “interrupted system call”. I imagine some sort of intermediate between Milton and basex could respond in a way that ignores the turds and responds as expected to macos. Assuming that it is the turds that are causing the problem, do you know of an existing server-side solution? Kendall

1 0

Strange Exception
by Christophe Marchand 19 Aug '16

19 Aug '16

Hello, I have a strange exception : Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.3 Java: Oracle Corporation, 1.8.0_91 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 120241192 - #used blocks: 469694 - #total locks: 469770 - access: 469693 (469694 > 469693] at org.basex.util.Util.notExpected(Util.java:60) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:458) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) at org.basex.data.Data.kind(Data.java:306) at org.basex.query.value.node.DBNode.<init>(DBNode.java:51) at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:68) at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:22) at org.basex.query.value.seq.Seq$1.next(Seq.java:77) at org.basex.query.expr.path.IterPath$1.next(IterPath.java:58) at org.basex.query.expr.path.IterPath$1.next(IterPath.java:36) at org.basex.query.expr.gflwor.For$1.next(For.java:79) at org.basex.query.expr.gflwor.GroupBy$1.init(GroupBy.java:131) at org.basex.query.expr.gflwor.GroupBy$1.next(GroupBy.java:98) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:174) at org.basex.query.expr.gflwor.For$1.next(For.java:99) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:95) at org.basex.query.expr.List$1.next(List.java:135) at org.basex.query.MainModule.cache(MainModule.java:91) at org.basex.query.QueryContext.iter(QueryContext.java:352) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:80) at org.basex.core.cmd.AQuery.query(AQuery.java:89) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.server.ClientListener.run(ClientListener.java:136) The XQuery is : for $fs in collection('FichiersBase')/forms group by $s := $fs/@supp return let $mv := max($fs/@omversion) for $f in $fs return if (empty($mv) or $f/@omversion >= $mv) then () else db:delete('FichiersBase', db:path($f)) ), db:optimize('FichiersBase') After this, trying a OPTIMIZE ALL on DATABASE FichiersBase, I have this exception : > OPEN FichiersBase Database 'FichiersBase' was opened in 744.68 ms. > OPTIMIZE ALL Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.3 Java: Oracle Corporation, 1.8.0_91 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 1 at org.basex.data.Namespaces.values(Namespaces.java:201) at org.basex.data.Data.namespaces(Data.java:450) at org.basex.io.serial.Serializer.node(Serializer.java:449) at org.basex.io.serial.Serializer.node(Serializer.java:176) at org.basex.io.serial.Serializer.serialize(Serializer.java:126) at org.basex.core.cmd.OptimizeAll$DBParser.parse(OptimizeAll.java:202) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.DiskBuilder.build(DiskBuilder.java:85) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:131) at org.basex.core.cmd.OptimizeAll.run(OptimizeAll.java:47) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.server.ClientListener.run(ClientListener.java:136) Any idea ? Does this mean my database is corrupted ? Best, Christophe

2 3

Python API error
by Sayth Renshaw 19 Aug '16

19 Aug '16

I created an issue on github #1342 it has been closed until mailing list confirms its a bug On Windows and Fedora with Python 2.7 and 3.5 I cannot import Session from the BaseXClient >> import BaseXClient >>> from BaseXClient import Session Traceback (most recent call last): File "<stdin>", line 1, in <module> ImportError: cannot import name Session Not sure if there is an obvious thing I am missing I was following the example on github https://github.com/BaseXdb/basex/blob/master/basex-api/src/main/python/Quer… Is there something super simple missing? Sayth

1 0

Example concatenates iterable to database name
by Sayth Renshaw 19 Aug '16

19 Aug '16

Hi Running 8.5.3 on windows. Currently open database is RaceXML1. I am running the example from here http://docs.basex.org/wiki/Databases for $i in 1 to 100 return db:open('books' || $i)//book/title as for $i in 1 to 100 return db:open('RaceXML1' || $i)//meeting/race What occurs though is that the iterable is concatenated to the database name and subsequently not found. Error: Stopped at C:/Users/Sayth/Documents/firstquery.xq, 2/15: [bxerr:BXDB0002] Database 'RaceXML11' was not found. To new to xquery to know why this is wrong. Full error is Error: Stopped at C:/Users/Sayth/Documents/firstquery.xq, 2/15: [bxerr:BXDB0002] Database 'RaceXML11' was not found. Compiling: - pre-evaluating (1 to 100) - rewriting descendant-or-self step(s) Optimized Query: for $i_0 in (1 to 100) return db:open(concat("RaceXML1", $i_0))/descendant::meeting/race Query: for $i in 1 to 100 return db:open("RaceXML1" || $i)//meeting/race Query plan: <QueryPlan compiled="true"> <GFLWOR> <For> <Var name="$i" id="0"/> <RangeSeq from="1" to="100"/> </For> <CachedPath> <DbOpen name="open(database[,path])"> <FnConcat name="concat(atom1,atom2[,...])"> <Str value="RaceXML1" type="xs:string"/> <VarRef> <Var name="$i" id="0"/> </VarRef> </FnConcat> </DbOpen> <IterStep axis="descendant" test="meeting"/> <IterStep axis="child" test="race"/> </CachedPath> </GFLWOR> </QueryPlan> Can you help? Sayth

2 7

XPath query with special char & fails
by Martin Manthey 19 Aug '16

19 Aug '16

Dear all, we use BaseX version 7.9 BaseX nodes and the XPath query of the getNodes()-method contains the char "&" and an exception is thrown. Example: //File[@originalLocation='E:\data\bugs\prom-9366\file & codemodel']/CopiedLocations/CopiedLocation If we use JDOM Nodes the query does not fail in this case. Why JDom can execute this query and BaseX cannot? Is there a general possibility to avoid this special char in a BaseX query, except masked it, or could it be solved in a higher version of BaseX? best regards

2 1

Using BaseXServer and BaseXHTTP at the same time?
by Kendall Shaw 18 Aug '16

18 Aug '16

Hi, Does the fact that basexhttp starts servers on 1984 and 8984 mean that I can have one program using client/server and another using rest using the same databases at the same time? Kendall

2 1

question on XML with prolog
by Wang, Genneva 18 Aug '16

18 Aug '16

Hi Christian, As I was testing some xml files, I realized that xml file with prolog, the prolog will always get removed when persisted in basex. Is that the expected behavior? Is there some option that the prologs can be saved along with the xml file ? Any tips would be greatly appreciated. Thanks! Regards, -Genneva

2 1

Uploading a binary file through RestXQ
by Marco Lettere 16 Aug '16

16 Aug '16

Hello all, I'm currently trying to implement a service for uploading Images to a Basex db. There is a frontend service that serves an HTML + Javascript page which receives the upload as an AJAX call from the browser then POSTs the request to the backend service for storing into the db. There is no big issue when doing it directly by a command or a query. I've been even able to do it by using the following code inside the RestXQ of the frontend service: client:connect("localhost", 1984, "user", "pass") ! client:query(., "db:store('files', '" || $name || "', .)", map{ "" : $file}) But when I POST the data to the backend RestXQ I always get the data stored into the DB as *base64* encoded text which messes up the successive retrieves. This is the code I use on the backend: declare %rest:path("/service/files/{$name}") %rest:POST("{$body}") %rest:consumes("image/png", "image/jpg", "image/jpeg", "image/gif", "image/svg+xml") %output:method("text") function m:upload-maps($userid as xs:string, $name as xs:string, $body as item()){ let $stored := db:store("files", $name, $body) return <rest:response> <http:response status="201"/> </rest:response> }; I call this service from the frontend service with the following request where the media-type is according to the uploaded file extension: <http:request href="{$url}" method="POST"> <http:body media-type="image/png"> {$data} </http:body> </http:request> How do I ensure that the data gets into the DB with its correct raw binary format? Thanks, Marco.

2 11

Re: [basex-talk] Autocommit option using sql:connect to Oracle 11.2.0.3 with ojdbc6.jar
by Christian Grün 15 Aug '16

15 Aug '16

Hi Chris (cc to the list), > I've also attached the basexdebug.txt but it just shows the requests so > probably not useful. Sounds ok so far. I have slightly revised our SQL code (although it shouldn’t make a big difference), and I have uploaded a new snapshot [1]. Could you give it a try? In general, our SQL wrapper is pretty simple [1,2]. Maybe you could check if you get autocommit=false running with a plain Java JDBC code snippet? Hope this helps, Christian [1] http://files.basex.org/releases/latest/ [1] https://github.com/BaseXdb/basex/blob/9a700bf1f663b18eb578acb1a8aa8bbb4d4dd… [2] https://github.com/BaseXdb/basex/blob/9a700bf1f663b18eb578acb1a8aa8bbb4d4dd… > > Thanks, > > chris > > On 12 August 2016 at 14:46, Christian Grün <christian.gruen(a)gmail.com> > wrote: >> >> Could you try the -d command-line flag (or the command SET DEBUG true >> in the GUI) and check if you get some helpful feedback on stderr? >> >> >> On Fri, Aug 12, 2016 at 3:44 PM, chrisis <chrisisanon(a)gmail.com> wrote: >> > The connection is opened successfully.Not getting any feedback. >> > I'm doing a lot of inserts in a loop and it's committing after every >> > insert. >> > My issue is with the overhead of all the extra commits >> > >> > >> > >> > >> > >> > >> > Thanks, >> > >> > chris >> > >> > >> > On 12 August 2016 at 14:19, Christian Grün <christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> > I'm trying to set the autocommit option off and I can't seem to get >> >> > it >> >> > to >> >> > work. >> >> > I'm passing the option to sql:connect as a map >> >> > map { 'autocommit': false() } >> >> > I also tried map { 'autoCommit': false() } as the Oracle JDBC docs >> >> > seem >> >> > to >> >> > suggest. >> >> >> >> What’s happening? Do you get any feedback? >> >> >> >> Thanks >> >> Christian >> > >> > > >

2 1

BaseX 8.5.3: Improved thread safety
by Christian Grün 15 Aug '16

15 Aug '16

Hi everyone, Normally, we do not announce patch releases anymore, but we’d like to point out that we have spent quite some effort in making xquery:fork-join [1] more thread-safe! As usual, you can already play around with the upcoming 8.6 features [2], which are already available in our patch release. Have fun with the new version [3], your feedback is welcome, Christian [1] http://docs.basex.org/wiki/XQuery_Module#xquery:fork-join [2] http://docs.basex.org/index.php?search=8.6 [3] http://basex.org/downloads

1 0

Java
by Tushar Deshmukh 14 Aug '16

14 Aug '16

Namaste all, I have embedded jetty in my application. I am creating basex database. But this database is created on users/public folder in Windows. I wanted to create it under my application folder. For this I have executed context to set dbpath. But it's returning error. Please help how to set dbpath in Java. If possible please please give code snippet. Thanks

2 1

Autocommit option using sql:connect to Oracle 11.2.0.3 with ojdbc6.jar
by chrisis 12 Aug '16

12 Aug '16

I'm trying to set the autocommit option off and I can't seem to get it to work. I'm passing the option to sql:connect as a map map { 'autocommit': false() } I also tried map { 'autoCommit': false() } as the Oracle JDBC docs <http://docs.oracle.com/cd/E11882_01/appdev.112/e13995/constant-values.html#…>seem to suggest. Am I missing something obvious? Regards, Chris Sweeney

2 1

multiple inserts/update/deletes in single transaction
by Wang, Genneva 11 Aug '16

11 Aug '16

Hi I’m trying to figure out whether batched transaction would work for basex, and I came across the RUN and EXECUTE command specified in http://files.basex.org/releases/8.4/BaseX84.pdf page 58-59. The document mentioned following in the summary section: RUN:Evaluates the contents of file as XQuery expression. If the file ends with the suffix .bxs, the file content will be evaluated as command script. This command can be used to run several commands in a single transaction EXECUTE: Evaluates the specified input as command script. This command can be used to run several commands in a single transaction. I’ve tried this myself For example, I’d like to know if I batch 2 inserts, if one fails, would both inserts get rollback. I’m using a simple .bxs (attached and also listed below for your convenience) and run the execute using GUI. OPEN test ADD TO embedded7.xml <root>embedded</root> ADD TO embedded8.xml <root>embedded CLOSE The second ADD (embedded8.xml) is not a valid xml format so I’m expecting it to fail, and rollback both files if any of them have already added. But after executing this script, I’m seeing embedded7.xml have been added. Would you be able to confirm if this is the expected behavior ? If so, is there anyway that I can batch multiple inserts and ensures that these batch of files can be committed at the same time, and rollback all together if any of the file has an error ? Thank you very much for your help.

4 17

BaseX - Parse out to ORM and/or pandas json
by Sayth Renshaw 08 Aug '16

08 Aug '16

Hi I am readimg the docs and can use xpath and somewhat xquery, what i can't envision is the workfow one i have data established in xbase. The parsers in seem logical http://docs.basex.org/wiki/Parsers . So thinking i have data in my basex db and i want to explore it and analyze it in pandas. Pandas accepts a wide range of formats including xml. So i create my xpath query and i see the data i want how should i create an output say json as i could later use that as a data bag in a static website. Is this easy to keep and be repeatable? I asked about ORM because i use django orm is it to create a data feed so that an orm style typical setup can stay updated from basex? Sorry for the silly conceptual questions, cant get the lay of the land. Sayth

2 2

Troubles moving queries from client side to .xq files on the server side using REST.
by Mike Engledew 07 Aug '16

07 Aug '16

I have some running code that used the "propitiatory" basex communication method over TCP/IP. The application was calling basex "client" side (from an Ant task) so this was all fine. Being used to the SQL paradigm of "preparing" an SQL statement then executing it with different "host variable" values which gives a massive performance advantage over constantly preparing an SQL statement with different literal values plugged in, I chose the same approach for my original XQuery application. String partDelete = "declare namespace xyz=\"" + BaseXML.NAMESPACE_URL + "\";\n" + "declare variable $contributor external;\n" + "delete node /xyz:driver[@name=\"" + driver.getDriverName() + "\"]/xyz:part[@contributor=$contributor]"; This statement is executed multiple times from within a loop to delete many "parts", before each execution I perform :- pd.bind("$contributor", contributor); pd.execute() Now we are trying to move the code from being client side to server side, the server is using RESTful interfaces for all external interactions so we are migrating the BaseX interaction to REST too. I reasoned that if I created a partdelete.xq file on the server that I could then perform a rest request passing in the values of driver and contributor emulating the "host variable" approach. I created partdelete.xq module namespace xyz = 'http://my.basex.server.net/xyz'; declare variable $driver external; declare variable $contributor external; delete node /zss:driver[@name=\"$driver"]/zss:part[@contributor=$contributor] Then (using postman) performed a GET request on //http:my.basex.server.ne:8984/rest/ TESTDB?run=partdelete.xq&$driver=TESTDRVR&$contributor=LINUX During my experiments I have managed to get many different error messages, but never got even close to making this work. Questions: o Am I fooling myself that creating a server side .xq file is going to perform better than building a completed query on the client and sending that via REST without "variables"? o Is there a way to perform the equivalent "prepare/execute" method from the client without creating a .xq file on the server? o Can anyone suggest how I can get the server side .xq file to work? I also have a query which is executed before the delete to obtain the list of parts to delete. I was unable to make this work either. The .xq file looked like this module namespace xyz = 'http://my.basex.server.net/xyz'; declare variable $driver external; declare variable $contributor external; for $p in /xyz:driver[@name="$driver"]/xyz:part, $o in $p/xyz:part-outputs/xyz:part-output where $p/@contributor/data() = $contributor return data($o/@type)||"/"||data($p/@class)||"/"||data($p/@hostname) The query works fine from the client side, and since this is only executed once it's no big deal to prefill all the values and dispense with the variables and send it over REST. I could (I suppose) alternatively use the <variable element as indicated in the BaseX documentation, but it's unclear how that would offer any performance advantage. Being a lover of consistency I would like to move both queries over to the BaseX server side. Examples of some of the errors I managed to produce ... [XPST0081] No namespace declared for 'xyz:driver' [XPST0003] Library modules cannot be evaluated [XPDY0002] root(): no context value bound. Any help, advice or suggestions greatly appreciated. Mike

2 3

authentication with REST API
by Claudio Cacciari 04 Aug '16

04 Aug '16

Dear All, I'm working with a BaseX instance ver 8.5.1, deployed on a tomcat 7 as war package, on a centos 7.2. I'm trying to understand how to configure the REST API authentication. Apparently, using the REST API, the authentication is required for create/write operations, but not for reading. I mean that I can download an XML resource stored in the DB, just putting the path in the browser without performing any authentication. Would it be possible to configure it in order to put even the GET calls under authentication? Is my configuration wrong? I have added a username/password in the file web.xml: <web-app> [...] <context-param> <param-name>org.basex.user</param-name> <param-value>myuser</param-value> </context-param> <context-param> <param-name>org.basex.password</param-name> <param-value>mypassword</param-value> </context-param> <context-param> <param-name>org.basex.authmethod</param-name> <param-value>Basic</param-value> </context-param> [...] <servlet> <servlet-name>REST</servlet-name> <servlet-class>org.basex.http.rest.RESTServlet</servlet-class>  <init-param> <param-name>org.basex.user</param-name> <param-value>myuser</param-value> </init-param> <init-param> <param-name>org.basex.password</param-name> <param-value>mypassword</param-value> </init-param> </servlet> [...] which results in a user.xml file like this: $cat /usr/share/tomcat/webapps/BaseX851/data/users.xml <users> <user name="admin" permission="admin"> <password algorithm="digest"> <hash>8c6f257a751d87d1eae5ab59710a818a</hash> </password> <password algorithm="salted-sha256"> <salt>3631994636103909</salt> <hash>9d25a8e3dc227e54f098c3cf3b8d1ca92b76a3bebb62e0f04299beaaf443908d</hash> </password> </user> <user name="myuser" permission="create"> <password algorithm="digest"> <hash>d3adbad8e6540a70a8b958ab27eec9b8</hash> </password> <password algorithm="salted-sha256"> <salt>3629615605296334</salt> <hash>3b64152088b90a2944b07a3d63703cdb8bffd1ccc21e5a40fe2e1f2a19307647</hash> </password> </user> </users> Thanks, Claudio

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk