BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

BaseX 8.0: DBA
by Christian Grün 15 Dec '14

15 Dec '14

Hi all, This is yet another update on the next, upcoming version of BaseX: We have added a new database administration (DBA) web frontend to our ZIP and EXE distributions. It allows you to create and administrate databases, evaluate queries in realtime, view log files, manage users, and more. It was completely written with XQuery and RESTXQ, apart from a few lines of Javascript code. The new frontend was added due to the known shortcomings of the Java GUI, which cannot be used to run queries on other servers. As a consequence, we have removed the server dialog from the desktop application. We hope that DBA will help you to write your own web applications based on RESTXQ! Some more infos and design goals can be found in our Wiki [1]. Have fun, we are looking forward to your feedback, Christian PS: NO, the web frontend does not provide all the cute features of the desktop gui, like the treemap, scatterplot, syntax highlighting, etc… But it may provide some of them in future. Your contributions are welcome! [1] http://docs.basex.org/wiki/DBA

5 12

Reg : Chunk By Chunk To DB
by Chandrasekhar 12 Dec '14

12 Dec '14

Dear Christian I am adding xml to the database using two ways in java 1) LocalSession ls = new LocalSession(context); ls.execute("ADD ","FILEPATH"); 2) ls.add("PATH", new FileInputStream("FILEPATH")); In first case taking time to adding the xml to database,when my xml is big and in databasesize also big.But this case memory consumption is very less. In second case it is adding to database very fast in both the cases.But it is consuming the memory.Is their any way to add xml to db with less memory and as well with performence. Is their any way to add xml with chunk by chunk to the database. MY XML MAX SIZE: 6GB Please do the needful. Regards Sekhar The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.

2 2

Upgrades and version compatibility
by Pascal Heus 12 Dec '14

12 Dec '14

Is there any documentation available around database compatibility across BaseX versions? For example, can I use a 7.6 database with 7.7 / 7.8 / 7.9 / 8.0 etc.? If I opena 7.6 database with 7.9, it may work may can the database still be used with 7.6 if I make any change? I we want to convert a 7.6 database to 7.9 or 8.0, what would be the easiest approach (besides a full reload of the source document, which in some case is not possible)? We have a couple projects running on 7.2 and 7.6 and trying to find a good upgrade strategy. Also, some users have opened these databases with more recent releases and experiencing stability issue so trying to determine if this could be a source of the problems. thanks *P

2 1

"User has already been assigned." and 500s errors with Docker
by Andreas Jung 11 Dec '14

11 Dec '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, I am experimenting with Docker and BaseX 8 (snapshot of yesterday). I wrote my own Dockerfile https://github.com/zopyx/docker-basex and create my own Docker image https://registry.hub.docker.com/u/zopyx/basex80/ My WebDAV test suite now throws continuously HTTP 500 errors and I see "User has already been assigned." messages on the basexhttp console. The BaseX log but talks about HTTP 200 responses. Thoughts? Andreas -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJUiWCrAAoJEADcfz7u4AZjiQgLwNIjTn34u+tTWDIXP2KZpyF0 tGEqgrjJFfiHSSNky6aCTNp8iKPXejZtNQNPGZVMj+0zzt4xtP3n9RhqWZyYCwln R1UtGUbJgALOqWWxA7ktdXm5baxk0W/WqU3PmHqZcor086K4kxHMO1Tk4r7RMPbm 397QeNKtBDpdRDF8r0k73ZQ373BtJodlY6UVpvilEUg0MwvqvgbsFZOmda9LWPsn XXh+L/zb5rurazGmJBkHfr7U+hlYo8VNzaq/LOlDkLb/QRGd/J9SXcpLF1CoQNzR 4euvezBH+SL6j6/JXn3jvDJ+abbQpStiHe44PD79GvWE0ZkBJ3y1+ocC11GiGu7l iFNRDiDfFw5Vwf6FZsikYzfFebZ28TUbYrOs0F57g1QRVhFo88FdZr4o+X4FHxJb 480YuERQdDvJ9t2pQ20Dlml2lh8rWKUl+3aAAF+lC39KC5Qw1SqIvL6lY2hs9dON bM1QDNs1Jt3eslsAM/+zmJVlxBBztec= =PzIZ -----END PGP SIGNATURE-----

2 3

BaseX 8.0: Updates, User Management
by Christian Grün 10 Dec '14

10 Dec '14

Hi all, Since a while now, BaseX 8.0 is on the agenda, and we are busy finishing all the features requested by you and ourselves. As promised, there will be no changes in the database layout: You can easily move on to 8.0 without needing to migrate your existing data. However, we have decided to discard the old user management in favor of a more up-to-date architecture [1]. Here are some of the most prominent changes: • An XQuery User Module allows you to manage users via XQuery • Permissions can now be manually edited (all credentials will be stored as XML) • Instead of md5, we now use salted sha256 hashes • Additionally, digest hashes are used for the new HTTP Digest Authentication, and for the existing client bindings (cram-md5 was dropped) As a result, credentials of existing databases cannot be migrated to 8.0. Moreover, the existing language bindings will need to be updated. The changes are marginal, so it shouldn't be a big deal [2]. If you want to help us, we welcome you to update your favorite bindings to the latest standard! And as you can guess… The latest snapshot is online [3]. Thanks for your attention, Christian PS: Our BaseX Users Meetup has been confirmed. It will be attached to the XMLPrague conference, and it will take place February 13 in the afternoon [4]. More to come! [1] http://docs.basex.org/wiki/User_Management [2] http://docs.basex.org/wiki/Clients [3] http://files.basex.org/releases/latest [4] http://lanyrd.com/2015/basex/

1 0

WebDAV issue in BaseX 8, how to track down
by Andreas Jung 10 Dec '14

10 Dec '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, I have a bunch Python code that runs with unittests perfectly against exist-db. However I have some issues with the WebDAV implementation of Base-X (tested against the latest 8.0 beta snapshot). In my case I am trying to read a file that exists over WebDAV (Pdb) print z_filename foo/index.html (Pdb) handle.listdir() [u'foo'] (Pdb) handle.listdir('foo') [u'index.html', u'index.xml'] But trying to open and read the file gives me a 400 error (Pdb) handle.open(z_filename) *** OperationFailedError: Server Error: 400 The BaseX log tells me about a 200 response: 20:37:05.917 0:0:0:0:0:0:0:1:56453 admin REQUEST [GET] http://localhost:8984/webdav/testing/foo/index.html 20:37:05.921 0:0:0:0:0:0:0:1:56453 admin 200 3.84 ms However I see this on the console: Stopped at ., 1/112: [XQST0109] Character map 'webdav' is not defined. Using Wireshark I can see that BaseX really responds with a 400 response. Bug? Andreas -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJUiKJXAAoJEADcfz7u4AZjNHILwI24MILvLMEHV+UmNen83v6e OwjgtfZfVXZlFNTBiWwaAq/JqzBCaEaaYkmqz5uzBDyzMgkzP/XxqiGNjwgfvy+z sIEasvwhfOfEpsf0W8GFEVpnqoT8sdpaZenozz53HTeOzVgwXBct9gSP8+/0/h6C pfy9Vcj9Nm4PX6Ed5uAEuHvLFO1gmAXKHsx+qXjAMUwXFvmznJYYTTNnoXRvrBjS b7dkXPIyBQU3j6c3L6oCBMWn6f6vCoEFs3i4aqfl+uUSBoNoR/TixhyS8/kfJCCT mK6wabjLdGnI6HcM7ll27S/TrWAmKNbY08LfAfJqtu/CwYy5paeW5qjGF3CGInr9 Da634m0LaNfqGcJPkcH5+s5q7GQMj3kF1sZIPLGv3o34VZFiLzPwoh/+Ei9RASXW JesluV+bXiRsZlLf3Uly9PSn8xc/PNECCLDF1F/6J0dJAn4//oHrXHrHEom3vSsZ eqFy3niG6lXnTBMJUYhc/KlvliKSrdc= =PG2F -----END PGP SIGNATURE-----

2 2

Reg : update was not completed
by Chandrasekhar 10 Dec '14

10 Dec '14

Dear Chirstain While updating the database i am getting the Database is being updated, or update was not completed Error. While running my application due to the network problems my application terminating ,In this case if any database updation operations are interrupting.Is their any commit kind of techniques are their,please provide some information. Thanks&Regards ChandraSekhar The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.

2 1

XML-Director project announced
by Andreas Jung 10 Dec '14

10 Dec '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi there, please allow me to announce a new toy project "XML-Director" of mine that will be powered by eXist-db or Base-X. https://www.andreas-jung.com/contents/announcing-the-xml-director-xml-cms-p… http://www.xml-director.info Andreas -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJUiFMCAAoJEADcfz7u4AZjpaQLwOap2DL61tsTSdrMVj8xthvR ZQTlqKIbjB4boM9WBFpYrbIMUl288v0GRob+MXRADhB/tT80eeIg9fOw1M5pzNUm XKpxKixbIaSXZkcsnwsuOJfkmdtS17umQwEkYvptGrbk+MZBMDcWtMcWYPYN52Vz MJy/W9u61YkpEeB6Aic/1pkuGogCg585KpQDtgy0noBN8XXnyM3cdW3lizSai0Nu qusFNkpT4/7CEW/idWacf2wEqJETB49do+Qxc5ivfBshu/8YF9yuMo+74gVbeHHf fqyy6uOyslNbUsgHEopSD28ZNMluSYhNm0ipiSpr3EzdOVSN5A7JufB9XNsSF/yu l4srwKaRP9n64GHK3Ehqk+1VpineUzizd+C/esYG4y9onYww5l/XO2grgarMKddN xIRhgMqokJRixo9wQJXNwA3haCRyLV9plRxr3t0ql54+SCEmOehL4lK4LDFUv0Qx QsjfapjYgKyrO+PPR2gxAks9aexSp5o= =ONb+ -----END PGP SIGNATURE-----

3 3

Re: [basex-talk] database problem
by Christian Grün 10 Dec '14

10 Dec '14

Hi Achim (cc to the list), Thanks for the details. Could you possibly try the latest snapshot of BaseX [1] and tell us if the problem persists with that version? Thanks, Christian [1] http://files.basex.org/releases/latest/ On Wed, Dec 10, 2014 at 12:28 PM, Achim Baumgartner <achim_baumgartner(a)yahoo.de> wrote: > Hello Christian, > > Thank you for your prompt answer. > Inspect from basex tool (under command section) gives me back > > Checking main table (75055 nodes): > - 0 invalid node kinds > - 0 invalid parent references > - 0 wrong parent/descendent relationships > No inconsistencies found. > > What I do PoetSession is an xml doc that is replaced around 20 times > before the database ends up in the described state. > It works a couple of times and then it goes wrong in the query following the > replace. > (every step in the application changes something to it and then > i use new Replace(path,content).execute(context) to update it. > > > Kind regards, > > Achim. > > > > Christian Grün <christian.gruen(a)gmail.com> schrieb am 11:48 Mittwoch, > 10.Dezember 2014: > > > Hi Achim, > > Thanks for your mail. It seems as if your database has possibly gone > corrupt. The INSPECT command can e.g. be used to analyze the data > structures of a given database [1]. > > If the problem persists after recreating your database, please don't > hesitate to provide us with your input data (if it's confidential, > feel free to drop me a personal note). > > Best, > Christian > > [1] http://docs.basex.org/wiki/Commands#INSPECT > > > > On Wed, Dec 10, 2014 at 11:34 AM, Achim Baumgartner > <achim_baumgartner(a)yahoo.de> wrote: >> Hello Dr. Grün, >> >> I open the database 'Collection' in the basex tool >> and enter the following query >> >> for $x in collection('Collection') >> return $x//PoetSession >> >> and get the following error message under Query Info. >> If you want I can provide you with the database files. >> >> Kind regards, >> >> Achim. >> >> >> Error: >> Improper use? Potential bug? Your feedback is welcome: >> Contact: basex-talk(a)mailman.uni-konstanz.de >> Version: BaseX 7.9 >> Java: Sun Microsystems Inc., 1.6.0_21 >> OS: Windows XP, x86 >> Stack Trace: >> java.lang.RuntimeException: Data Access out of bounds: >> - pre value: 75055 >> - #used blocks: 294 >> - #total locks: 294 >> - access: 293 (294 > 293] >> at org.basex.util.Util.notExpected(Util.java:53) >> at >> org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:508) >> at >> org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:194) >> at org.basex.data.Data.kind(Data.java:284) >> at org.basex.query.value.node.DBNode.<init>(DBNode.java:53) >> at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:65) >> at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:19) >> at org.basex.query.value.seq.Seq$1.next(Seq.java:92) >> at org.basex.query.gflwor.For$1.next(For.java:71) >> at org.basex.query.gflwor.GFLWOR$2.next(GFLWOR.java:74) >> at org.basex.query.MainModule$1.next(MainModule.java:98) >> at org.basex.query.QueryContext.execute(QueryContext.java:580) >> at org.basex.query.QueryProcessor.execute(QueryProcessor.java:101) >> at org.basex.core.cmd.AQuery.query(AQuery.java:82) >> at org.basex.core.cmd.XQuery.run(XQuery.java:22) >> at org.basex.core.Command.run(Command.java:329) >> at org.basex.core.Command.execute(Command.java:94) >> at org.basex.gui.GUI.exec(GUI.java:417) >> at org.basex.gui.GUI.access$500(GUI.java:41) >> at org.basex.gui.GUI$8.run(GUI.java:361) >> Compiling: >> - pre-evaluating fn:collection("Collection") >> - simplifying descendant-or-self step(s) >> Query: >> for $x in collection('Collection') return $x//PoetSession >> Optimized Query: >> for $x_0 in (db:open-pre("Collection",0), db:open-pre("Collection",766), >> ...) return $x_0/descendant::PoetSession >> Query plan: >> <QueryPlan> >> <GFLWOR> >> <For> >> <Var name="$x" id="0"/> >> <DBNodeSeq size="103"> >> <DBNode name="Collection" pre="0"/> >> <DBNode name="Collection" pre="766"/> >> <DBNode name="Collection" pre="1242"/> >> <DBNode name="Collection" pre="2008"/> >> <DBNode name="Collection" pre="2777"/> >> </DBNodeSeq> >> </For> >> <IterPath> >> <VarRef> >> <Var name="$x" id="0"/> >> </VarRef> >> <IterStep axis="descendant" test="PoetSession"/> >> </IterPath> >> </GFLWOR> >> </QueryPlan> >> > >

1 0

database problem
by Achim Baumgartner 10 Dec '14

10 Dec '14

Hello Dr. Grün, I open the database 'Collection' in the basex tool and enter the following query for $x in collection('Collection')return $x//PoetSession and get the following error message under Query Info.If you want I can provide you with the database files. Kind regards, Achim. Error:Improper use? Potential bug? Your feedback is welcome:Contact: basex-talk(a)mailman.uni-konstanz.deVersion: BaseX 7.9Java: Sun Microsystems Inc., 1.6.0_21OS: Windows XP, x86Stack Trace: java.lang.RuntimeException: Data Access out of bounds:- pre value: 75055- #used blocks: 294- #total locks: 294- access: 293 (294 > 293] at org.basex.util.Util.notExpected(Util.java:53) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:508) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:194) at org.basex.data.Data.kind(Data.java:284) at org.basex.query.value.node.DBNode.<init>(DBNode.java:53) at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:65) at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:19) at org.basex.query.value.seq.Seq$1.next(Seq.java:92) at org.basex.query.gflwor.For$1.next(For.java:71) at org.basex.query.gflwor.GFLWOR$2.next(GFLWOR.java:74) at org.basex.query.MainModule$1.next(MainModule.java:98) at org.basex.query.QueryContext.execute(QueryContext.java:580) at org.basex.query.QueryProcessor.execute(QueryProcessor.java:101) at org.basex.core.cmd.AQuery.query(AQuery.java:82) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:329) at org.basex.core.Command.execute(Command.java:94) at org.basex.gui.GUI.exec(GUI.java:417) at org.basex.gui.GUI.access$500(GUI.java:41) at org.basex.gui.GUI$8.run(GUI.java:361)Compiling:- pre-evaluating fn:collection("Collection")- simplifying descendant-or-self step(s)Query:for $x in collection('Collection') return $x//PoetSessionOptimized Query:for $x_0 in (db:open-pre("Collection",0), db:open-pre("Collection",766), ...) return $x_0/descendant::PoetSessionQuery plan:<QueryPlan> <GFLWOR> <For> <Var name="$x" id="0"/> <DBNodeSeq size="103"> <DBNode name="Collection" pre="0"/> <DBNode name="Collection" pre="766"/> <DBNode name="Collection" pre="1242"/> <DBNode name="Collection" pre="2008"/> <DBNode name="Collection" pre="2777"/> </DBNodeSeq> </For> <IterPath> <VarRef> <Var name="$x" id="0"/> </VarRef> <IterStep axis="descendant" test="PoetSession"/> </IterPath> </GFLWOR></QueryPlan>

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk