BaseX-Talk

basex-talk@mailman.uni-konstanz.de

9 participants
5241 discussions

Re: [basex-talk] Database creation from a directory tree
by Andreas Weiler 29 Dec '10

29 Dec '10

Hi David, the syntax of the create command changed between the releases of 6.1 and 6.3.4. In release 6.1 you have to use: create db C:\Users\David\Documents\OpenSong\songpacks\Songs songs Kind regards, Andreas Am 28.12.10 18:00, schrieb David leigh: > > Here are my command line results from 6.3.4: > > C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin > > BaseX 6.3.5 [Client] > > Try "help" to get more information. > > > drop db songs > > Database 'songs' was dropped. > > > create db song > > Database 'song' created in 1683.61 ms. > > > info index > > Tags > > - Structure: Hash > > - Entries: 0 > > Attributes > > - Structure: Hash > > - Entries: 0 > > Text Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Attribute Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Full-Text Index > > - Not available > > Path Summary > > doc() 1x > > > info table > > Stopped at line 1, column 10: > > Syntax: INFO ([DATABASE|INDEX|STORAGE]) > > Show information on current database. > > Shows information on the currently opened database: > > - no argument: show global information > > - DATABASE: shows database information > > - INDEX: shows index information > > - STORAGE [start end] | [query]: show internal database table > > > info storage > > PRE DIS SIZ ATS NS KIND CONTENT > > ------------------------------------- > > 0 1 1 1 0 DOC song > > > info > > General Information > > Database Path: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX\data > > Used Main Memory: 895 KB > > Database Creation > > Whitespace Chopping: ON > > Entity Parsing: OFF > > Indexes > > Path Summary: ON > > Text Index: ON > > Attribute Index: ON > > Full-Text Index: OFF > > > > > So, for 6.3.4, it creates from the command line, but it's empty. The > root of that path has NO files in it. The 5861 files are in all the > subdirectories. > > Then, when I try the same syntax with 6.1, I get the following results: > > > create db songs C:\Users\David\Documents\OpenSong\songpacks\Songs > > Stopped at line 1, column 17: > > Syntax: CREATE [DB|COLL|FS|INDEX|USER] [...] > > Create database, index or user. > > Creates a new database, index or user: > > - DB [path] [name?]: > > creates the database [name] for the file or directory [path] > > - COLL [name]: > > creates an empty database [name] > > - INDEX [TEXT|ATTRIBUTE|FULLTEXT|PATH]: > > creates the specified index > > - FS [path] [name] ([mountpoint] [backingstore]): > > creates filesystem database [name] for [path] > > (using [mountpoint] and [backingstore] if FUSE is activated) > > - USER [name] [password?]: > > creates the specified user > > Summary: > > 6.1 GUI -- works as I want it > > 6.1 command line -- can't get it to create > > 6.3.4 GUI -- creates but with only 14 entries > > 6.3.4 command line -- creates, but it's empty > > I don't mind staying with 6.1, but I DO want to do everything with the > command line. > > Is the ADD syntax the same, in that I can simply specify the path and > it will recurse the whole directory tree? > > Thanks!!! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Tuesday, December 28, 2010 01:29 PM > *To:* david(a)leighweb.com > *Cc:* basex-talk(a)mailman.uni-konstanz.de > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the > command line. So, any help in that area would also be appreciated. > > > Could you provide your syntax? > > The syntax should be: > create db dbname path/to/folder > > The missing extension shouldnt be a problem, i just tested it. > > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > We will check for modifications between the releases. As quick > workaround you could try to create an empty database and then add the > documents with the Database/Add documents menu. > > Kind regards, > Andreas > > Am 28.12.10 12:55, schrieb David leigh: > > I've just installed 6.3.4 and I've noticed a difference from version 6.1. > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the command > line. So, any help in that area would also be appreciated. > > Thank you, > > David > > DavidEmailSig <mailto:david@leighweb.com> > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >

2 1

Database creation from a directory tree
by David leigh 28 Dec '10

28 Dec '10

I've just installed 6.3.4 and I've noticed a difference from version 6.1. In the GUI in 6.1, I can create a database from a whole directory hierarchy of 5,681 individual XML files. When I point to the same source file directory and using the 6.3.4 GUI (which I installed with a pre-release version of the installer), it only processes 14 files. No error message (that I saw) was produced. The behavior that I'm wanting is what 6.1 does. Glad to help in solving the problem. Additional question: That was in the GUI. I'd like to do the same thing using the command line with the .JAR file, but somewhere my syntax is not right. Additionally, all the XML files have NO EXTENSION so I don't know how to specify that either in the command line. So, any help in that area would also be appreciated. Thank you, David <mailto:david@leighweb.com> DavidEmailSig

2 1

Complete control from the command line
by David leigh 25 Dec '10

25 Dec '10

Hi, I'm new to basex and NOT a java person at all. I'm creating an application where a basex database is used to search for song lyrics. I'm using the autoit3 scripting language in Windows and interfacing to basex using the basex61.jar on the command line with the output file. I'm starting the server and then using the client for the queries. So far so good. The performance is amazing in both loading the database from thousands of individual XML documents and in querying the database. Quite pleased. My desire is to have an app where ALL the components reside in one directory or its subdirectories. I also want to be able to create and recreate the basex database programmatically using the CREATE on the command line. I understand that there exists a basex config file where certain parameters, like the data store location, can be set, but that the location of this file is assumed/fixed.i.e. I can't just put it anywhere I want it (like in the single directory I want this all to reside in). It seems that there are perhaps actual java commands that I could use when I launch the server and/or client that would allow me either to specify the location of the basex config file OR simply pass the parameters that I want to pass for specifying the location of the database. Unfortunately, none of the documentation on the site seems to address this level of interaction. Is there another source of more detailed documentation somewhere or could someone please guide me in this? I think it all boils down to how to tell basex, via the command line, where to put the data (for the server) and where it resides (for the client). Thank you very much! <mailto:david@leighweb.com> DavidEmailSig

2 1

Problems with XQuery matching records by compound key
by Jan Vlčinský (CAD) 25 Dec '10

25 Dec '10

Hi I am trying to match records from two different documents. Match key consists of two parts, so I simply build up a string from first and second match key and separate it by a hypen Here are source documents *Events.xml* <EVENTS>** * *<MSG id=*"{e8e85fdd-04d8-43ea-8090-e72337c3a30d}"* location=*"Prague"* event=*"Christmass"*/>** * *<MSG id=*"{7c94b2fc-b97c-4c09-b694-9993bfb2b93c}"* location=* "Bratislava"* event=*"Easterns"*/>** * *<MSG id=*"{bdbb11da-2c92-425d-9bf5-87c1e96e1bd4}"* location=*"Berlin"* event=*"Berlinale"*/>** </EVENTS>** * * *Reports.xml* <REPORTS>** * *<MSG id=*"{abcd}"* location=*"Prague"* event=*"Christmass"*/>** * *<MSG id=*"{efgh}"* location=*"Bratislava"* event=*"Easterns"*/>** * *<MSG id=*"{ijkl}"* location=*"Paris"* event=*"FassionFest"*/>** * *<MSG id=*"{mnqr}"* location=*"Moscow"* event=*"BalletFestival"*/>** </REPORTS> I am trying to find for each report all events, which are having the same location and event attributes So I build intermediate variables, containing pre-calculated keys And finally I try to find related events *match.xq* (:* *Construct* *matching* *keys* **for** *events* *:)** *let** **$event-msg-keys** *:=* * * *(*for** **$event** **in** */EVENTS/MSG** * **return** * * *<EVENT-MSG id="{$event/@id}" key="{concat($event/@location, '-', $event/@event)}"/>** * *)** * * (:* *Construct* *matching* *keys* **for** *reports* *:)** * * *let** **$report-msg-keys** *:=* * * *(*for** **$report** **in** */REPORTS/MSG* * * **return** * * *<REPORT-MSG id="{$report/@id}" key="{concat($report/@location, '-', $report/@event)}"/>** * *)** * * (:* *Find* *all* *events,* *related* **to** *each* *report:)** *for** **$report-msg** **in** **$report-msg-keys*** *let** **$report-msg-id** *:=* **$report-msg*/@id** *let** **$report-msg-key** *:=* **$report-msg*/@key** * * *let** **$related-events** *:=* * * *(*for** **$event-msg** **in** **$event-msg-keys*** * **where** **$event-msg*/@key* *=* **$report-msg-key*** * **return** **$event-msg*)** * * *return*** <REPORT-MSG id="{$report-msg-id}" key="{$report-msg-key}">** * *<RELATED-EVENTS>{$related-events}</RELATED-EVENTS></REPORT-MSG> However, resulting dokument does not show any related events <REPORT-MSG id=*"{abcd}"* key=*"Prague-Christmass"*>** * *<RELATED-EVENTS/>** </REPORT-MSG>** <REPORT-MSG id=*"{efgh}"* key=*"Bratislava-Easterns"*>** * *<RELATED-EVENTS/>** </REPORT-MSG>** <REPORT-MSG id=*"{ijkl}"* key=*"Paris-FassionFest"*>** * *<RELATED-EVENTS/>** </REPORT-MSG>** <REPORT-MSG id=*"{mnqr}"* key=*"Moscow-BalletFestival"*>** * *<RELATED-EVENTS/>** </REPORT-MSG> *Versions of BaseX* All the time I worked with GUI 1. I started testing on BaseX 6.3.4 2. I used a bit more complex data and query 3. After failing I tried on 6.3.1 4. There I was unable to open the collection with complains about Index out of bound Java error 5. Then I dropped the database and created it again. Trying to run the XQuery I got the same error. 6. returned back to 6.3.4 7. rewrote it to shorted sample, shown above I wonder, what I am doing wrong. Any advice? With best regards Jan Vlčinský

4 4

Use with Google App Engine
by Min Idzelis 20 Dec '10

20 Dec '10

I realize that BaseX can't be used as-is on the Google App Engine. The question I have is how much work would it be to get it up and running on the App Engine's datastore API instead of whatever you are using for indexing/storage. There is no access to a filesystem. The datastore does have a concept of hierarchical (parent-child) entities. In the datastore, the only operations that are supported are: get/put by key, inequality (<, >, =) filters, and a way to limit results that have a common ancestor (key). Would this be enough to support BaseX? Thanks, Min

4 8

(no subject)
by stefan coremans 19 Dec '10

19 Dec '10

The java binding explained under http://www.inf.uni-konstanz.de/dbis/basex/xqjb is working but i can't get it to work with a simple test class. where can i find some sample code ?

3 4

Responses in XML, uisng REST
by Mahender Didwania 17 Dec '10

17 Dec '10

Hi, BaseX returns XML for URLs like http://localhost:8984/basex/jax-rx/; however, database creation commands or collection creation commands result in text/plain content-type and plain-text being returned in response. Perhaps it will be useful, in pure XML processing apps, for these responses to also be in XML. Something like, <jax-rx:results xmlns:jax-rx="http://jax-rx.sourceforge.net"> <jax-rx:response status="201">Database 'Test' created in 38.22 ms.</jax-rx:response> </jax-rx:results> Regards, Mahender.

2 1

Hierarchical collections via REST
by Mahender Didwania 16 Dec '10

16 Dec '10

Hi, The changelog for 6.3.1 says: [ADD] REST: support for hierarchical collections added; details will follow I am using 6.3.4, but if I send a post request to /server/collection/subcollection, only the collection gets created (and the document is added to collection, not to subcollection). In view of the above, could you please throw more light on how the subcollections can be created using REST and how documents can be added to subcollections using REST? Thanks, Mahender

3 3

Re: [basex-talk] Hierarchical collections via REST
by Mahender Didwania 16 Dec '10

16 Dec '10

Hi, sscce below: Sequence1: Action: curl -i -X PUT "http://localhost:8984/basex/jax-rx/abcde" curl -i -X POST -H "Content-Type: text/xml" -d "<HelloWorld/>" "http://localhost:8984/basex/jax-rx/abcde/subA/docA" Expectation: Creation of docA in subcollection subA under collection abcde Actual: Creation of document named subAdocA in collection abcde Sequence2: Action: curl -i -X POST -H "Content-Type: text/xml" -d "<HelloWorld/>" "http://localhost:8984/basex/jax-rx/abcde/subA/docA" Expectation: Two documents with the same name in the same collection (at same hierarchy level) should be disallowed. Actual: Two documents with the same name in the same collection (at same hierarchy level) are allowed. I do not know how things will work later when xquery operations will be invoked using document name (i.e., which one will be fetched out of the two documents, since both have the same name). curl -i -X POST -H 'Content-Type: application/query+xml' -d '<query xmlns="http://jax-rx.sourceforge.net"><text>for $doc in collection("abcde") return base-uri($doc)</text></query>' 'localhost:8984/basex/jax-rx/' HTTP/1.1 200 OK Content-Type: text/xml Content-Length: 246 Server: Jetty(6.1.26) <jax-rx:results xmlns:jax-rx="http://jax-rx.sourceforge.net"><jax-rx:result>file:(somePath)/subAdocA</jax-rx:result><jax-rx:result>file:(somePath)/subAdocA</jax-rx:result></jax-rx:results> A delete using document name deletes all documents with the same name at the same hierarchy level: curl -i -X DELETE "http://localhost:8984/basex/jax-rx/abcde/subAdocA" HTTP/1.1 200 OK Content-Type: text/plain Transfer-Encoding: chunked Server: Jetty(6.1.26) 2 document(s) deleted in 1.2 ms. Regards, Mahender ----- Original Message ----- From: "Christian Grün" <christian.gruen(a)gmail.com> To: "Mahender Didwania" <mahender(a)didwania.co.uk> Cc: "basex-talk" <basex-talk(a)mailman.uni-konstanz.de> Sent: Wednesday, December 15, 2010 4:26:41 PM GMT +00:00 GMT Britain, Ireland, Portugal Subject: Re: [basex-talk] Hierarchical collections via REST > I am using 6.3.4, but if I send a post request to /server/collection/subcollection, only the collection gets created (and the document is added to collection, not to subcollection). Could you provide us with an sscce that allow us to reproduce the issue? > In view of the above, could you please throw more light on how the subcollections can be created using REST and how documents can be added to subcollections using REST? The documentation will be updated with the upcoming official release. Best, Christian

1 0

Limit of 32 attributes per element
by Peter Fischer 15 Dec '10

15 Dec '10

Dear all, when testing BaseX with the TPoX benchmark workload (http://tpox.sourceforge.net/) I could not load the input data set since it contains elements with more than 32 attributes. The large number of attributes stems from the FIXML data (http://www.fixprotocol.org/specifications/fix4.4fixml) contained in the workload, so it is not just a stress test by the benchmark designers. Is there any way to lift this limitation? Best Regards, Peter -- Dr. Peter Fischer Systems Group/D-INFK/ETH Zurich peter.fischer(a)inf.ethz.ch Tel: +41/44/632 36 16 http://www.systems.ethz.ch/people/petfisch Universitätstr 6, CAB E75

3 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk