- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Query corrupts my database
by Christian Grün 21 Jan '11

21 Jan '11

Hi Mark, this is due to a missing namespace declaration. You can either explicitly specify your namespace... declare default element namespace "http://www.w3.org/2002/07/owl#"; doc('test')/Ontology ...or use a namespace wildcard to match the root element: doc('test')/*:Ontology Hope this helps, Christian On Thu, Jan 20, 2011 at 11:16 PM, Mark Boon <mboon(a)blueplanetsoftware.com> wrote: > OK, I enter the following commands in the BaseX UI. > create database test > insert node <Ontology/> into doc('test') > replace node collection('test')/Ontology with <Ontology > xmlns="http://www.w3.org/2002/07/owl#" > xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" > xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > xml:base="http://www.w3.org/2002/07/owl#"> > <Prefix name="rdf" IRI="http://www.w3.org/1999/02/22-rdf-syntax-ns#"/> > <Prefix name="rdfs" IRI="http://www.w3.org/2000/01/rdf-schema#"/> > <Prefix name="xsd" IRI="http://www.w3.org/2001/XMLSchema#"/> > <Prefix name="owl" IRI="http://www.w3.org/2002/07/owl#"/> > <SubClassOf> > <Class IRI="http://ar#boat"/> > <Class IRI="http://ar#vehicle"/> > </SubClassOf> > </Ontology> > Now, if I do > collection('test') > it shows me that the element was in fact inserted as it prints: > <Ontology xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" > xmlns="http://www.w3.org/2002/07/owl#" > xml:base="http://www.w3.org/2002/07/owl#"> > <Prefix name="rdf" IRI="http://www.w3.org/1999/02/22-rdf-syntax-ns#"/> > <Prefix name="rdfs" IRI="http://www.w3.org/2000/01/rdf-schema#"/> > <Prefix name="xsd" IRI="http://www.w3.org/2001/XMLSchema#"/> > <Prefix name="owl" IRI="http://www.w3.org/2002/07/owl#"/> > <SubClassOf> > <Class IRI="http://ar#boat"/> > <Class IRI="http://ar#vehicle"/> > </SubClassOf> > </Ontology> > However, if I enter: > collection('test')/Ontology > it's empty. Isn't that unusual? I do note that in the "Query Info" panel it > prints: > - removing unknown tag/attribute "Ontology" > although it doesn't do so in my larger example. > When I try to execute the same 'replace...' command again, it tells me: > Error: [XUDY0027] Replace target must not be empty. > Mark Boon > > On Jan 20, 2011, at 11:39 AM, Christian Grün wrote: > > Hi Mark, > > I'm sorry, but I think I need some more information to find a helpful > answer. Do you have a little example (sscce) that allows us to > reproduce the issue? > > Christian > ___________________________ > > On Thu, Jan 20, 2011 at 10:27 PM, Mark Boon > <mboon(a)blueplanetsoftware.com> wrote: > > OK, I tried with BaseX 6.5. Now I don't get an error, but now my Ontology > > element remains empty. > > This is the output of the query: > > Query: replace node collection('bm_test_iam')/BOT-L/Ontology with <Ontology > > xmlns="http://www.w3.org/2002/07/owl#" > > xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" > > xmlns:xsd="http://www.w3.org/2001/XMLSchema#" > > xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > > xml:base="http://www.w3.org/2002/07/owl#"> > > Compiling: > > - pre-evaluating collection("bm_test_iam") > > Result: replace node document-node { "bm_test_iam" }/*:BOT-L/*:Ontology with > > element { "Ontology" } { attribute { "xml:base" } { > > "http://www.w3.org/2002/07/owl#" }, element { "Prefix" } { attribute { > > "name" } { "rdf" }, attribute { "IRI" } { > > "http://www.w3.org/1999/02/22-rdf-syntax-ns#" } }, element { "Prefix" } { > > attribute { "name" } { "rdfs" }, attribute { "IRI" } { > > "http://www.w3.org/2000/01/rdf-schema#" } }, element { "Prefix" } { > > attribute { "name" } { "xsd" }, attribute { "IRI" } { > > "http://www.w3.org/2001/XMLSchema#" } }, element { "Prefix" } { attribute { > > "name" } { "owl" }, attribute { "IRI" } { "http://www.w3.org/2002/07/owl#" } > > }, element { "SubClassOf" } { element { "Class" } { attribute { "IRI" } { > > "http://ar#boat" } }, element { "Class" } { attribute { "IRI" } { > > "http://ar#vehicle" } } } } > > Query plan: > > <Replace> > > <IterPath> > > <document-node() name="bm_test_iam"/> > > <IterStep axis="child" test="*:BOT-L"/> > > <IterStep axis="child" test="*:Ontology"/> > > </IterPath> > > <CElem> > > <Item value="Ontology" type="xs:QName"/> > > <CAttr> > > <Item value="xml:base" type="xs:QName"/> > > <Item value="http://www.w3.org/2002/07/owl#" type="xs:string"/> > > </CAttr> > > <CElem> > > <Item value="Prefix" type="xs:QName"/> > > <CAttr> > > <Item value="name" type="xs:QName"/> > > <Item value="rdf" type="xs:string"/> > > </CAttr> > > <CAttr> > > <Item value="IRI" type="xs:QName"/> > > <Item value="http://www.w3.org/1999/02/22-rdf-syntax-ns#" > > type="xs:string"/> > > </CAttr> > > </CElem> > > <CElem> > > <Item value="Prefix" type="xs:QName"/> > > <CAttr> > > <Item value="name" type="xs:QName"/> > > <Item value="rdfs" type="xs:string"/> > > </CAttr> > > <CAttr> > > <Item value="IRI" type="xs:QName"/> > > <Item value="http://www.w3.org/2000/01/rdf-schema#" > > type="xs:string"/> > > </CAttr> > > </CElem> > > <CElem> > > <Item value="Prefix" type="xs:QName"/> > > <CAttr> > > <Item value="name" type="xs:QName"/> > > <Item value="xsd" type="xs:string"/> > > </CAttr> > > <CAttr> > > <Item value="IRI" type="xs:QName"/> > > <Item value="http://www.w3.org/2001/XMLSchema#" type="xs:string"/> > > </CAttr> > > </CElem> > > <CElem> > > <Item value="Prefix" type="xs:QName"/> > > <CAttr> > > <Item value="name" type="xs:QName"/> > > <Item value="owl" type="xs:string"/> > > </CAttr> > > <CAttr> > > <Item value="IRI" type="xs:QName"/> > > <Item value="http://www.w3.org/2002/07/owl#" type="xs:string"/> > > </CAttr> > > </CElem> > > <CElem> > > <Item value="SubClassOf" type="xs:QName"/> > > <CElem> > > <Item value="Class" type="xs:QName"/> > > <CAttr> > > <Item value="IRI" type="xs:QName"/> > > <Item value="http://ar#boat" type="xs:string"/> > > </CAttr> > > </CElem> > > <CElem> > > <Item value="Class" type="xs:QName"/> > > <CAttr> > > <Item value="IRI" type="xs:QName"/> > > <Item value="http://ar#vehicle" type="xs:string"/> > > </CAttr> > > </CElem> > > </CElem> > > </CElem> > > </Replace> > > Timing: > > - Parsing: 0.87 ms > > - Compiling: 1.21 ms > > - Evaluating: 2.33 ms > > - Printing: 0.14 ms > > - Total Time: 4.55 ms > > When I now do collection('bm_test_iam')/BOT-L/Ontology the "Text" panel just > > contains: > > <Ontology/> > > where I expected it to contain the XML I just inserted. > > Mark Boon > > > On Jan 20, 2011, at 11:13 AM, Mark Boon wrote: > > On Jan 20, 2011, at 11:09 AM, Christian Grün wrote: > > Mark, > > thanks for your mails. Just a short one.. Does the same error occur > > with the latest version of BaseX (6.5)? > > Christian > > Actually, I just picked up this work where I left it a few weeks ago. Some > > reorganization at work made me change e-mail so I hadn't followed this list > > either. So I missed that a new version came out. I'll try it immediately. > > I'll get back with the result. > > Mark > > _______________________________________________ > > BaseX-Talk mailing list > > BaseX-Talk(a)mailman.uni-konstanz.de > > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > > >

2 2

Transform table to tree
by Erdal Karaca 21 Jan '11

21 Jan '11

I have a table that is to be transformed to a tree: <entry id="entry1" parentId="parentOfThisEntry" /> <entry id="entry2" parentId="parentOfThisEntry" /> <entry id="entry3" parentId="parentOfThisEntry" /> <entry id="entry4" parentId="parentOfThisEntry" /> The tree structure can be constructed by the id/parentId relation. I failed to achieve this... :-( I am using basex 6.5.

5 5

Query corrupts my database
by Mark Boon 20 Jan '11

20 Jan '11

I've been trying to keep an OWL ontology in the BaseX database. It's a little contrived but I thought it should work. But whenever I insert the ontology it corrupts my entire collection. I have a single Ontology node, that initially is just an empty element. Then I perform the following query: replace node collection('bm_test_iam')/BOT-L/Ontology with <Ontology xmlns="http://www.w3.org/2002/07/owl#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xml:base="http://www.w3.org/2002/07/owl#"> <Prefix name="rdf" IRI="http://www.w3.org/1999/02/22-rdf-syntax-ns#"/> <Prefix name="rdfs" IRI="http://www.w3.org/2000/01/rdf-schema#"/> <Prefix name="xsd" IRI="http://www.w3.org/2001/XMLSchema#"/> <Prefix name="owl" IRI="http://www.w3.org/2002/07/owl#"/> <SubClassOf> <Class IRI="http://ar#boat"/> <Class IRI="http://ar#vehicle"/> </SubClassOf> </Ontology> I get an error. Same thing when I run this query from the BasX UI. This is what I see in the "Query Info" panel: Query: replace node collection('bm_test_iam')/BOT-L/Ontology with <Ontology xmlns="http://www.w3.org/2002/07/owl#" xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#" xmlns:xsd="http://www.w3.org/2001/XMLSchema#" xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xml:base="http://www.w3.org/2002/07/owl#"> <Prefix name="rdf" IRI="http://www.w3.org/1999/02/22-rdf-syntax-ns#"/> <Prefix name="rdfs" IRI="http://www.w3.org/2000/01/rdf-schema#"/> <Prefix name="xsd" IRI="http://www.w3.org/2001/XMLSchema#"/> <Prefix name="owl" IRI="http://www.w3.org/2002/07/owl#"/> <SubClassOf> <Class IRI="http://ar#boat"/> <Class IRI="http://ar#vehicle"/> </SubClassOf> </Ontology> Error: Possible bug? Feedback is welcome: basex-talk(a)mailman.uni-konstanz.de BaseX 6.3.2: java.lang.RuntimeException: Possible bug? Feedback is welcome: basex-talk(a)mailman.uni-konstanz.de BaseX 6.3.2: Data Access out of bounds [pre:699, indexSize:5, access:5 > 4] org.basex.util.Util.notexpected(Util.java:46) org.basex.io.TableDiskAccess.cursor(TableDiskAccess.java:323) org.basex.io.TableDiskAccess.read1(TableDiskAccess.java:92) org.basex.data.Data.kind(Data.java:324) org.basex.query.item.DBNode$4.next(DBNode.java:272) org.basex.query.path.IterStep$1.next(IterStep.java:45) org.basex.query.iter.NodeIter.next(NodeIter.java:1) org.basex.query.path.IterPath$1.next(IterPath.java:66) org.basex.query.path.IterPath$1.next(IterPath.java:1) org.basex.query.up.Replace.item(Replace.java:59) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:47) org.basex.query.QueryContext.iter(QueryContext.java:360) org.basex.query.QueryContext.iter(QueryContext.java:324) org.basex.query.QueryContext.eval(QueryContext.java:282) org.basex.query.QueryProcessor.execute(QueryProcessor.java:104) org.basex.core.cmd.AQuery.query(AQuery.java:83) org.basex.core.cmd.XQuery.run(XQuery.java:22) org.basex.core.Command.run(Command.java:245) org.basex.core.Command.exec(Command.java:227) org.basex.core.Command.execute(Command.java:66) org.basex.gui.GUI.exec(GUI.java:383) org.basex.gui.GUI$5.run(GUI.java:346) Note: the XML I try to insert is created by Pellet, so I have little control over it. Not only does the query fail, but any subsequent query on the same collection now gives me a "Possible Bug?" message. Any ideas would be greatly appreciated. Mark Boon

2 4

Editorial change in wiki - XQuery 3.0 and GroupBy
by Jan Vlčinský (CAD) 19 Jan '11

19 Jan '11

Hi Reading http://docs.basex.org/wiki/XQuery_3.0 <http://docs.basex.org/wiki/XQuery_3.0>I found, that third code listing telling You can see this effect by changing the return statement to: return element {$income} {count($ppl)} is exactly the same return statement as in first code listing and shall be probably changed into return element {$income} {$ppl} I tried to tell that directly on wiki, but I got no permission to do that, so I use this mailing list for it. Jan PS: I did not test the sample, I only know, it shall differ from the first one and this is my estimation.

3 3

Importing CSV fles (BaseX 6.5)
by Jan Vlčinský (CAD) 18 Jan '11

18 Jan '11

Hi *BaseX 6.5 incl. rewritten web site is impressive*. Really. I go through it feature by feature and test it. Trying to import CSV file I have a problem 1. Creation of new database from xsv file or directory does not work (using default options, no changes) Reports "Line 1: Content is not allowed in prolog" 2. Adding document by Database - Add documents results in the same message 3. Trying to SET PARSER CSV did not change anything 4. Trying to add header with field names into imported file does not help Questions 1. How to import CSV fle 2. What CSV format is expected 1. tab, coma, semicolon? 2. header with field name allowed/expected? With best regards Jan

2 4

FileGuru: Important Note About Submission Of BaseX 6.5
by FileGuru 17 Jan '11

17 Jan '11

Hi,Thanks for submitting your software BaseX 6.5 We will review your software within 2 weeks and you will be notified via email if your software has been accepted. To speed up your submission please place a link to us on any page of your website and let us know. By linking to our site you can greatly improve the position of your listing in our archive. Linking back to us will also ensure a speedy review of your software. Here is linking code which you can use to link back to our site. Software Downloads at FileGuru If you prefer image, you can find nice buttons here Best Regards, FileGuru http://www.fileguru.com © 2000-2010, FileGuru.

1 0

Update BaseX - OK.
by basex-talk＠mailman.uni-konstanz.de 17 Jan '11

17 Jan '11

Dear Developer, Thank you for submitting BaseX to http://www.softviewer.com Submission details: Software: BaseX Version: 6.5 Author: BaseX Page: http://www.basex.org/ Download: http://files.basex.org/BaseX.jar URL: http://www.softviewer.com/download_detail.php?softid=221864 Submit: http://www.softviewer.com/submit_soft.php Submit type: Update Submit date: 2011-01-17 16:32:15 If you would like to provide a link to SoftViewer from your site, you can find a nice buttons at http://www.softviewer.com/link_to_us.html You can link to http://www.softviewer.com/download_detail.php?softid=221864 or our homepage: http://www.softviewer.com Best Regards, SoftViewer - http://www.softviewer.com

1 0

Release of BaseX 6.5, Homepage Relaunch
by Christian Grün 17 Jan '11

17 Jan '11

Dear all, We are excited to announce the relaunch of our homepage, which now includes commercial offerings such as professional support, individual software solutions, and training courses: http://basex.org/ Next, we have released Version 6.5 of BaseX, which offers the following new features: = Storage - Text compression, shrinking text nodes up to 50% - Enhanced collection support - Backup functionality - Built-in importers: HTML, Text, CSV = XQuery - XQuery 3.0 features, including GROUP BY and SWITCH statements - New file, HTTP, database and full-text functions - Built-in Lucene and Snowball Stemming for XQuery Full Text = GUI - New TreeView visualization - Improved database management = APIs - JAX-RX now supports hierarchical paths and external variables - Language Bindings extended with query iterators Thanks to your continuous feedback on BaseX! You can be sure that the project itself will remain Open Source, no matter what. We are looking forward to your responses, Christian BaseX Team 2011

1 0

Extremely serious issue with magically disappearing databases
by Charles F. Munat 17 Jan '11

17 Jan '11

I have an embedded (soon to be unembedded) Base-X database supporting a website written in Scala. I have a very basic caching mechanism. The structure of the DB is such: <data> <cache> <page>...</page> <page>...</page> </cache> <somethings> <something>...</something> </somethings> <otherthings> <otherthing>...</otherthing> </otherthings> </data> I have a huge (1000+ lines) XQuery that takes all the somethings and otherthings recursively and constructs a <page> item that includes the html content of the page thus: <page uri="/" expires=""> <name>home</name> <content> <html> <head>...</head> <body>...</body> </html> </content> </page> This page is then saved into /data/cache. The way this works is simple. The main XQuery checks /data/cache/page[@uri=$uri] If it finds an unexpired page, it returns it. If it doesn't, it looks to see if such a page exists (in pieces) in the DB. If it does, it constructs the html page, inserts it into a <page> element along with some metadata (expires, etc.) and returns that. If no such page exists, it returns a 404 error page. Beauty, eh? And it works extremely well. Until I have an error in my XQuery, which, naturally, happens all the time during development. Just to make clear, here is the Scala that runs the query (from a Circumflex web app): get("(.)*".r) = { response.contentType("text/html") val url = uri.get(0).getOrElse("/") val out = executeQuery(Rx.pageQry(url)) match { case "" => "<p>Houston, we have a problem.</p>" case page if (page.substring(0,2) == "<p") => executeQuery("delete node /data/cache/page[@uri='" + url + "']") executeQuery("insert node " + page + " into /data/cache") executeQuery(Rx.pageQry(url)) case out => out } "<!DOCTYPE html>\n" + out } What this does is very simple. executeQuery simply runs the supplied query. Rx.pageQry just loads the huge query from a file and adds the call "local:getPage('/')" with the url inserted as a parameter. Right? Then the match looks to see if nothing at all comes back (case ""), or if a page that begins "<p" comes back (meaning a newly constructed query). The default is to spit the thing out. So in case one, we're screwed. In the default case, we serve the right page *or* a 404 error page. And in case two, we get the <page> for caching. In that instance, we delete any old page that might be in the cache with that URI, then insert the new page. Then we pull the html from the newly inserted page and serve that. I hope this is clear even if you don't write Scala. HERE IS THE PROBLEM: When I make an error in the big XQuery (the one loaded by Rx.pageQry), I get an error message from Base-X with the line number and the type of error. Beauty! So I fix the error and rerun the query AND MY DATABASE IS EMPTY. That's right: the entire database has been wiped. Running a / query gives me back <data> </data>. OUCH! If this happens in production (and this app is running in production right now), I might as well step in front of a bus. What, please, could be causing the database to dump itself? This has happened dozens of times! I'm willing to send the huge query off-list if anyone thinks that would help, but I don't see how the query *failing* and destroying the database could have anything to do with the query itself. I've looked at the Scala a million times and maybe I'm missing something, but the delete XQuery is /data/cache/page[etc.]. How can this destroy anything outside of /data/cache ? As for the insert query, how can inserting *anything* into /data/cache destroy things outside of /data/cache ? Am I missing something really basic, or is there a nasty bug in Base-X? Hopefully the former, but if it's the latter, I thought you should know. Could this be related to the embedded nature of the database? Thanks! Chas.

2 2

Is op:divide-dayTimeDuration function implemented?
by Jan Vlčinský (CAD) 16 Jan '11

16 Jan '11

Hi I am trying to use function op:divide-dayTimeDuration as declared at http://www.w3.org/TR/xquery-operators/#func-divide-dayTimeDuration <http://www.w3.org/TR/xquery-operators/#func-divide-dayTimeDuration>BaseX tells me either unknown namespace op, or unknown function. Is this supported by BaseX, or I shall find my own implementation written in XQuery? Jan

2 2

Multiple 'LocalSessions' with their own opened database
by Fabrice Etanchaud 14 Jan '11

14 Jan '11

Dear all, In Standard mode (Standalone server) Is it possible to have several 'LocalSessions', each with a possible different opened database ? I noticed that for each ClientSession, BaseXServer creates a child context. So in Standalone mode, is it possible to do the same and pass a child context to each LocalSession in order to run multiple queries on distinct databases at the same time ? BaseX is simply fantastic. Best regards, Fabrice Etanchaud

2 3

Users and Permissions when running BaseX locally
by Fabrice Etanchaud 14 Jan '11

14 Jan '11

Dear all, just to be sure of what I am doing... Are Users and Permissions stuff meaningless when running BaseX locally (as a library, I mean) ? Best regards, Fabrice Etanchaud

2 1

What happened to the DeepFS menu? Was it removed?
by dmccordjr＠yahoo.com 14 Jan '11

14 Jan '11

Hello I was wondering, What happened to the DeepFS Menu in the latest Trunk. Will it be returning? How can I create a DeepFS Database. I've started to learn BaseX. Currently, I use DeepFS like a Disk catalog. Was it somehow broken? If so. What is the ChangeSet of 6.1? I'm a Java Dev. So if you can point me in the right direction. I would Appreciate it. Thank you in advance.

2 1

Performance issues
by William Sandri 12 Jan '11

12 Jan '11

Hello, we are experiencing a weird performance issue in function calling. In many xqueries we use, we found that calling functions slows down the execution, sometimes it even hangs "forever". I tried to drill down to the problem and I think I isolated an odd behavior. Before presenting the example code, let me summarize a little bit: inside a for-loop we call a thousand times a function passing some parameters. I declared 3 functions, 2 of which take 1 parameter and the last one takes 2 parameters. For simplicity's sake the parameter "objectId" is never used, but that doesn't affect the experiment. When I call any of the 1-parameter functions, execution takes less than 2 seconds, but when I call the 2-parameter function it runs endlessly. It seems that the combination of those two parameters is the point of performance issue. I hope you can illuminate me. Regards William Here it is an example: declare namespace xbpr = "http://www.bpeng.com/"; declare variable $amlDocName as xs:string :="aml"; declare variable $cxnDefsDocName as xs:string :="cxnDefsDocName"; declare function xbpr:testFast1($objectId as xs:string?){ let $docName := $cxnDefsDocName let $conn_typeof_target := doc($docName)/CxnDefs/CxnDef[@type="RdfsType"]/@target return $conn_typeof_target }; declare function xbpr:testFast2($docName as xs:string?){ let $conn_typeof_target := doc($docName)/CxnDefs/CxnDef[@type="RdfsType"]/@target return $conn_typeof_target }; declare function xbpr:testSlow($docName as xs:string?, $objectId as xs:string?){ let $conn_typeof_target := doc($docName)/CxnDefs/CxnDef[@type="RdfsType"]/@target return $conn_typeof_target }; let $instances := doc($amlDocName)/AML/Group//ObjDef for $instance in $instances let $objectId := $instance/(a)ObjDef.ID let $v := xbpr:testFast1($objectId) let $v := xbpr:testFast2($cxnDefsDocName) let $v := xbpr:testSlow($cxnDefsDocName, $objectId) return $v

3 6

Re: [basex-talk] Database creation from a directory tree
by Andreas Weiler 06 Jan '11

06 Jan '11

Hi David, just surround the command with quotes: java -cp BaseX.jar org.basex.BaseXClient -c "set createfilter *" Kind regards, Andreas Am 06.01.11 20:06, schrieb David leigh: > > Andreas, > > I spoke too soon about my success. > > If I do: > > set createfilter * > > from an */interactive/* commandline, it works. > > If I do the same thing as a */passed command/* it does NOT work, BUT a > passed command is accepted if I do: > > set createfilter '*' > > Unfortunately the filter is then incorrect! > > Here's my results from the DOS console: > > */C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin -c set createfilter */* > > */Error: Stopped at line 1, column 24:/* > > */Syntax: SET [option] ([value])/* > > */ Set global options (current values: try 'info')./* > > *//* > > */Available options [option] with value [value] = on/off:/* > > */- QUERYINFO: Display of query info/* > > */- DEBUG: Display of debug info/* > > */- SERIALIZE: Serialization of query results/* > > */- CHOP: Chopping of XML whitespaces/* > > */- ENTITY: Parsing of XML entities/* > > */- TEXTINDEX: Text indexing/* > > */- ATTRINDEX: Attribute value indexing/* > > */- FTINDEX: Full-text indexing/* > > */- PATHINDEX: Path indexing/* > > *//* > > */C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin/* > > */BaseX 6.3.5 [Client]/* > > */Try "help" to get more information./* > > *//* > > */> set createfilter */* > > */CREATEFILTER: */* > > */>/* > > So, I'm stuck again as it appears that the parser for the "-c" option > on the command line is slightly different from the command parser on > the interactive command line. Is there another way to do this? > > Thanks! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Friday, December 31, 2010 04:41 PM > *To:* david(a)leighweb.com > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Hi David, > > thanks a lot for your tests. > I couldnt fix the gui bug yet...but i can help you with command line... > > There is a createfilter option...it can be set with: > set createfilter * > > so all files in the folder are recognized for creating a database. > > I hope this works for now, > Happy new year, > Andreas > > Am 31.12.10 15:13, schrieb David leigh: > > Andreas, > > I just did an interesting test (using the version that the windows > installer installs: 6.3.4). > > I copied my directory tree of files and in the new copy, I gave all my > data files an extension of "xml" (previously they had NO extension). > NOW, both with the command line and the GUI, the full database is > created without any problem. To double check, I went back to the old > directory with no extensions and created a new database using a filter > of "*.*" and only 14 documents were created in the database (instead > of 5000+). > > Conclusions: > > In the command line you must have input documents with an extension of > "xml" since there is no visible way to provide a filter. > > The GUI interfaces differently than the command line with the basex > core since it can receive a filter as well as a path in the database > creation process > > The GUI filter functionality in 6.3.4 is different than in 6.1...for > me it is "broken" vs. how it works in 6.1 > > So, I think for my project to work completely, I need new > functionality: a file name filter that works correctly on the CREATE > DB statement in the command line interface. Does this sound correct > to you? > > Unfortunately, I don't have control over the extension names of my > input files as they are created by another piece of software. Until > I can do a create database in the command line, I'll have to do manual > gui-based (6.1 version) refreshes of the data or some sort of long > copy/rename process in the background. > > Thanks! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Wednesday, December 29, 2010 11:26 AM > *To:* david(a)leighweb.com <mailto:david@leighweb.com>; > BaseX-Talk(a)mailman.uni-konstanz.de > <mailto:BaseX-Talk@mailman.uni-konstanz.de> > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Hi David, > > the syntax of the create command changed between the releases of 6.1 > and 6.3.4. > > In release 6.1 you have to use: > > create db C:\Users\David\Documents\OpenSong\songpacks\Songs songs > > Kind regards, > Andreas > > Am 28.12.10 18:00, schrieb David leigh: > > Here are my command line results from 6.3.4: > > C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin > > BaseX 6.3.5 [Client] > > Try "help" to get more information. > > > drop db songs > > Database 'songs' was dropped. > > > create db song > > Database 'song' created in 1683.61 ms. > > > info index > > Tags > > - Structure: Hash > > - Entries: 0 > > Attributes > > - Structure: Hash > > - Entries: 0 > > Text Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Attribute Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Full-Text Index > > - Not available > > Path Summary > > doc() 1x > > > info table > > Stopped at line 1, column 10: > > Syntax: INFO ([DATABASE|INDEX|STORAGE]) > > Show information on current database. > > Shows information on the currently opened database: > > - no argument: show global information > > - DATABASE: shows database information > > - INDEX: shows index information > > - STORAGE [start end] | [query]: show internal database table > > > info storage > > PRE DIS SIZ ATS NS KIND CONTENT > > ------------------------------------- > > 0 1 1 1 0 DOC song > > > info > > General Information > > Database Path: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX\data > > Used Main Memory: 895 KB > > Database Creation > > Whitespace Chopping: ON > > Entity Parsing: OFF > > Indexes > > Path Summary: ON > > Text Index: ON > > Attribute Index: ON > > Full-Text Index: OFF > > > > > So, for 6.3.4, it creates from the command line, but it's empty. The > root of that path has NO files in it. The 5861 files are in all the > subdirectories. > > Then, when I try the same syntax with 6.1, I get the following results: > > > create db songs C:\Users\David\Documents\OpenSong\songpacks\Songs > > Stopped at line 1, column 17: > > Syntax: CREATE [DB|COLL|FS|INDEX|USER] [...] > > Create database, index or user. > > Creates a new database, index or user: > > - DB [path] [name?]: > > creates the database [name] for the file or directory [path] > > - COLL [name]: > > creates an empty database [name] > > - INDEX [TEXT|ATTRIBUTE|FULLTEXT|PATH]: > > creates the specified index > > - FS [path] [name] ([mountpoint] [backingstore]): > > creates filesystem database [name] for [path] > > (using [mountpoint] and [backingstore] if FUSE is activated) > > - USER [name] [password?]: > > creates the specified user > > Summary: > > 6.1 GUI -- works as I want it > > 6.1 command line -- can't get it to create > > 6.3.4 GUI -- creates but with only 14 entries > > 6.3.4 command line -- creates, but it's empty > > I don't mind staying with 6.1, but I DO want to do everything with the > command line. > > Is the ADD syntax the same, in that I can simply specify the path and > it will recurse the whole directory tree? > > Thanks!!! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Tuesday, December 28, 2010 01:29 PM > *To:* david(a)leighweb.com <mailto:david@leighweb.com> > *Cc:* basex-talk(a)mailman.uni-konstanz.de > <mailto:basex-talk@mailman.uni-konstanz.de> > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the > command line. So, any help in that area would also be appreciated. > > > Could you provide your syntax? > > The syntax should be: > create db dbname path/to/folder > > The missing extension shouldnt be a problem, i just tested it. > > > > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > We will check for modifications between the releases. As quick > workaround you could try to create an empty database and then add the > documents with the Database/Add documents menu. > > Kind regards, > Andreas > > Am 28.12.10 12:55, schrieb David leigh: > > I've just installed 6.3.4 and I've noticed a difference from version 6.1. > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the command > line. So, any help in that area would also be appreciated. > > Thank you, > > David > > DavidEmailSig <mailto:david@leighweb.com> > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >

2 2

Read block? Kill me now.
by Charles F. Munat 06 Jan '11

06 Jan '11

So I went live with my embedded Base-X website and that has been a very painful learning experience. I had been opening the DB on each request and running various queries, but assumed that the process would close it when it exited. That was bad, bad, bad. About an hour after I uploaded the new site (and after I'd gone to bed for a nine hour snooze), the site started serving a 500 error code because too many files were open. OK, figured that out. So I created a singleton and with a method that opens the database in a try/catch block, and closes it in the finally block. Problem solved. Sort of. Apologies for the Scala, but here is the singleton code: object DB { private val context = new Context() new org.basex.core.cmd.Set("dbpath", "/var/www/db").execute(context) def executeQuery(query: String): String = { try { new Open("data").execute(context) new XQuery(query).execute(context) } catch { case _ => new CreateDB("data", "<data/>").execute(context) new XQuery(query).execute(context) } finally { new Close().execute(context) } } } Try blocks in Scala return a value, so this method returns the output of the passed-in XQuery. Works like a charm. When a request is received, my servlet (using Circumflex, a Scala web framework) creates a new RequestRouter class. A "get" method is called and passed the URL. Here is that class and method, which shows how I am calling the above DB object: class Main extends RequestRouter { get(url) = { val query = Rx.getQuery(url) val output = DB.executeQuery(qry) "<!DOCTYPE html>\n" + output } } This passes the URL (url) to a method on another singleton (Rx.getQuery) which returns an XQuery based on the URL. That query is passed to DB.executeQuery which stores the output in the immutable variable "output." I then prepend a doctype and serve it as text/html. This runs great... for about an hour. Then the server stops responding altogether. I've searched the logs, and I found this error: java.io.IOException: Stream Closed java.io.RandomAccessFile.seek(Native Method) org.basex.io.TableDiskAccess.readBlock(TableDiskAccess.java:349) org.basex.io.TableDiskAccess.cursor(TableDiskAccess.java:326) org.basex.io.TableDiskAccess.read1(TableDiskAccess.java:92) org.basex.data.Data.kind(Data.java:305) org.basex.query.item.DBNode$4.next(DBNode.java:273) org.basex.query.path.IterStep$1.next(IterStep.java:45) org.basex.query.path.AxisPath.iter(AxisPath.java:437) org.basex.query.path.AxisPath.iter(AxisPath.java:406) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.For$1.init(For.java:127) org.basex.query.expr.For$1.next(For.java:92) org.basex.query.expr.FLWR$1.next(FLWR.java:63) org.basex.query.expr.Constr.<init>(Constr.java:53) org.basex.query.expr.CElem.item(CElem.java:112) org.basex.query.expr.CElem.item(CElem.java:1) org.basex.query.expr.CFrag.item(CFrag.java:1) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:49) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.FLWR$1.next(FLWR.java:67) org.basex.query.iter.Iter.finish(Iter.java:65) org.basex.query.expr.ParseExpr.value(ParseExpr.java:73) org.basex.query.expr.Func.iter(Func.java:80) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.FuncCall.iter(FuncCall.java:76) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.TypeCase.iter(TypeCase.java:95) org.basex.query.expr.TypeSwitch.iter(TypeSwitch.java:74) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.Constr.<init>(Constr.java:52) org.basex.query.up.Replace.item(Replace.java:50) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:49) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.ParseExpr.value(ParseExpr.java:73) org.basex.query.expr.GFLWOR.iter(GFLWOR.java:298) org.basex.query.expr.GFLWOR.iter(GFLWOR.java:291) org.basex.query.expr.GFLWOR.iter(GFLWOR.java:266) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.ParseExpr.value(ParseExpr.java:73) org.basex.query.up.Transform.iter(Transform.java:86) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.FLWR$1.next(FLWR.java:67) org.basex.query.iter.Iter.finish(Iter.java:65) org.basex.query.expr.ParseExpr.value(ParseExpr.java:73) org.basex.query.expr.Func.iter(Func.java:80) org.basex.query.QueryContext.iter(QueryContext.java:306) org.basex.query.expr.FuncCall.iter(FuncCall.java:76) org.basex.query.QueryContext.iter(QueryContext.java:306) I'm guessing that this is some sort of race condition? What is the trick to using Base-X in embedded mode? Do I need to be doing some sort of threading here? (I have managed to avoid learning anything about threads for 15 years now. Hate to ruin that record.) Suggestions? Advice? At this point I'm seriously thinking of just running Base-X as a server and connecting through a connection pool, but I have to figure that out tonight, so if there's an easier answer, I'd sure love to know it. Thanks again for all your help! Chas.

2 5

Fwd: Re: Fwd: Re: How to retrieve HTTP request parameters and use them in XQuery with BaseX
by Andreas Weiler 05 Jan '11

05 Jan '11

-------- Original-Nachricht -------- Betreff: Re: [basex-talk] Fwd: Re: How to retrieve HTTP request parameters and use them in XQuery with BaseX Datum: Wed, 5 Jan 2011 09:51:07 +0000 Von: software developer <computer.software.developer(a)gmail.com> An: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> Hi Andreas, Wonderful, thanks a lot!! Great work. On Mon, Jan 3, 2011 at 10:02 AM, Andreas Weiler <andreas.weiler(a)uni-konstanz.de <mailto:andreas.weiler@uni-konstanz.de>> wrote: Hi there, i fixed the bug and attached the newest version of our api. Don't hesitate to ask for more help, Kind regards Am 31.12.10 16:52, schrieb Andreas Weiler: Hi, this feature isnt enabled for the run command yet. We put that on our todo-list and get it done as fast as possible. You could also have a look into our language bindings (for other ways then REST) [1], here you can also bind variables to queries. If your query is not to large, i guess the network traffic for sending the query for each request should not be too much. Kind regards, Andreas [1] http://www.inf.uni-konstanz.de/dbis/basex/bindings Am 31.12.10 16:18, schrieb software developer: Hi, The parameters are not bound to variables when a query is invoked via the run parameter. For example, I store my query in myquery.xq on the server side; if the query contains current-time() invocation of the URL http://localhost:8984/basex/jax-rx?wrap=no&run=myquery.xq&var=$x=21%01$y=2 <http://localhost:8984/basex/jax-rx?wrap=no&run=myquery.xq&var=$x=21%01$y=2> <http://localhost:8984/basex/jax-rx?wrap=no&run=myquery.xq&var=$x=21%01$y=2 <http://localhost:8984/basex/jax-rx?wrap=no&run=myquery.xq&var=$x=21%01$y=2>> results in display of current date-time but if the query contains declare variable $x as xs:integer external; declare variable $y as xs:integer external; $x*$y I get the error Stopped at line 1, column 34 in myquery.xq: [XQDY0002] No value defined for "$x as xs:integer". The parameters are correctly bound to variables when a query is invoked via the query parameter named query as you described, but that is not what I am after. Is this a bug? Is there a workaround? _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

1 0

Too many open files? Ack!
by Charles F. Munat 04 Jan '11

04 Jan '11

Got this error: org.basex.core.BaseXException: /var/www/xxx/db/data/atv.basex (Too many open files) Oh, noes! What does this mean? I was just hitting the page quickly. I'm sunk if people can't hit the page repeatedly. Is there a setting to adjust this? Is it a heap space issue? How can I make sure this never happens? I have an embedded database. I load it through the application (no file). I don't know what you call that. It uses one big XQuery to generate the page. Any ideas? Thanks very much! Chas.

3 5

Java binding - BaseXClient.receive and BaseXClient.execute methods
by Fabrice Etanchaud 04 Jan '11

04 Jan '11

Dear all at dbis, best greetings for the new year ! in the java binding class 'BaseXClient', is there any reason not to add UTF-8 encoding when transforming outputstream into string ? String receive() throws IOException { final ByteArrayOutputStream os = new ByteArrayOutputStream(); receive(os); return os.toString("UTF-8"); // return os.toString(); } public String execute(final String cmd) throws IOException { final OutputStream os = new ByteArrayOutputStream(); execute(cmd, os); return os.toString("UTF-8"); // return os.toString(); } In which encoding is BaseX data internally stored, and then restituted ? best regards, Fabrice ETANCHAUD

3 6

Root?
by Charles F. Munat 04 Jan '11

04 Jan '11

I have an embedded Base-X database in a web application. I have a huge XQuery that involves a lot of local functions, many of them recursive. In several of these functions, I need to query the database to look up referenced elements. I can't for the life of me figure out a way to access the database without doing one of two things: 1. My document root is /data. I can let $root := /data and then pass that into every function. Passing things into functions rather than setting global variable is certainly and FP way of doing things, but in this instance it seems to me that it should be the scope I'm working in. 2. If something else I pass into the function is a node in the database, then I can, for example, use $node/root() to back up to the root node. But sometimes I'm only passing in a string and I still need to query the whole database. Is there some way to access the root easily from within a function? I am very confused by the whole "context" idea. I've looked all over, but I must be searching using the wrong terms, or it simply isn't done. Anyone know a way? Thanks, Chas.

3 3

Fwd: Re: Root?
by Andreas Weiler 04 Jan '11

04 Jan '11

-------- Original-Nachricht -------- Betreff: Re: [basex-talk] Root? Datum: Tue, 04 Jan 2011 08:56:13 -0300 Von: Charles F. Munat <charles.munat(a)gmail.com> An: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> Actually, this is perfect. Exactly what I was trying to do -- set a global variable. I must have had the syntax wrong, because it wasn't working. But this is great. One less thing to pass around. When you're query involves a couple dozen functions, it gets tiresome. Thanks much for all your help! This makes it a lot easier. Chas. On 01/04/2011 8:24 AM, Andreas Weiler wrote: > Hi Chas, > > thanks for you example, that made it easy to understand. > The database context isn't available in own declared functions and > variables. > So you could use the doc('database') function and run the following query: > > declare variable $data as node() := doc('database')/data; > > declare function local:getPersonFromID($id) { > $data/persons/person[@id=$id] > }; > > local:getPersonFromID('1') > > So it's almost the same than your workaround. > The doc('database') function gives you access to your database. > > I'm sorry there is no easier way, > kind regards, > Andreas > > Am 04.01.11 11:26, schrieb Charles F. Munat: >> Sorry, it's hard to explain these things since I have no idea what, if >> anything, I'm doing wrong. Here's a basic example. >> >> I create a database in code: >> >> (I'm using Scala, but hopefully this is close enough so you can see >> what I'm doing.) >> >> private val context = new Context() >> new org.basex.core.cmd.Set("dbpath", "/var/www/xxx/db").execute(context) >> >> try { >> new Open("data").execute(context) >> } catch { >> case _ => new CreateDB("data", "<data/>").execute(context) >> } >> >> So now I have a new database that contains only<data/>. I now load it: >> >> val file = "/var/www/xxx/content/persons.xml" >> new XQuery("insert node " + >> XML.loadFile(file).toString + >> " into /data").execute(context) >> >> Now my data is in the embedded database. Suppose the file looked like >> this: >> >> <persons> >> <person id="1"> >> <names> >> <given>John</given> >> <family>Lennon</family> >> </names> >> </person> >> <person> >> <names id="2"> >> <given>Paul</given> >> <family>McCartney</family> >> </names> >> </person> >> </persons> >> >> Now I can run an XQuery like this (really just XPath): >> >> /data/persons/person[@id='1'] >> >> And I'll get back: >> >> <person id="1"> >> <names> >> <given>John</given> >> <family>Lennon</family> >> </names> >> </person> >> >> Simple, right? >> >> But if I do this: >> >> declare function local:getPersonFromID($id) { >> /data/persons/person[@id=$id] >> }; >> >> local:getPersonFromID('1') >> >> Then I get this error: >> >> No context item set for 'root()'. >> >> The workaround I've been using is this: >> >> declare function local:getPersonFromID($data, $id) { >> $data/persons/person[@id=$id] >> }; >> >> let $data := /data >> return local:getPersonFromID('1') >> >> There must be a better way. >> >> Does this make more sense? >> >> Chas. >> >> On 01/04/2011 5:47 AM, Andreas Weiler wrote: >>> Hi Chas, >>> >>> i actually don't understand what your concrete problem is, but you could >>> have a look >>> in our xquery database functions: >>> http://www.inf.uni-konstanz.de/dbis/basex/xq-db >>> >>> If you have opened the database before running queries, the whole >>> database is in your context and so it is used >>> in the queries. >>> >>> Kind regards, >>> Andreas >>> >>> Am 04.01.11 00:54, schrieb Charles F. Munat: >>>> I have an embedded Base-X database in a web application. I have a huge >>>> XQuery that involves a lot of local functions, many of them recursive. >>>> In several of these functions, I need to query the database to look up >>>> referenced elements. I can't for the life of me figure out a way to >>>> access the database without doing one of two things: >>>> >>>> 1. My document root is /data. I can let $root := /data and then pass >>>> that into every function. Passing things into functions rather than >>>> setting global variable is certainly and FP way of doing things, but >>>> in this instance it seems to me that it should be the scope I'm >>>> working in. >>>> >>>> 2. If something else I pass into the function is a node in the >>>> database, then I can, for example, use $node/root() to back up to the >>>> root node. But sometimes I'm only passing in a string and I still need >>>> to query the whole database. >>>> >>>> Is there some way to access the root easily from within a function? I >>>> am very confused by the whole "context" idea. I've looked all over, >>>> but I must be searching using the wrong terms, or it simply isn't done. >>>> >>>> Anyone know a way? >>>> >>>> Thanks, >>>> >>>> Chas. >>>> _______________________________________________ >>>> BaseX-Talk mailing list >>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>> >

1 0

Fwd: RE: Database creation from a directory tree
by Andreas Weiler 03 Jan '11

03 Jan '11

-------- Original-Nachricht -------- Betreff: RE: [basex-talk] Database creation from a directory tree Datum: Fri, 31 Dec 2010 17:59:34 +0100 Von: David leigh <david(a)leighweb.com> Antwort an: <david(a)leighweb.com> An: 'Andreas Weiler' <andreas.weiler(a)uni-konstanz.de> Wohoo! That works great! Thanks. You've provided the missing link for me! Have a great new year! David DavidEmailSig <mailto:david@leighweb.com> *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] *Sent:* Friday, December 31, 2010 04:41 PM *To:* david(a)leighweb.com *Subject:* Re: [basex-talk] Database creation from a directory tree Hi David, thanks a lot for your tests. I couldnt fix the gui bug yet...but i can help you with command line... There is a createfilter option...it can be set with: set createfilter * so all files in the folder are recognized for creating a database. I hope this works for now, Happy new year, Andreas Am 31.12.10 15:13, schrieb David leigh: Andreas, I just did an interesting test (using the version that the windows installer installs: 6.3.4). I copied my directory tree of files and in the new copy, I gave all my data files an extension of "xml" (previously they had NO extension). NOW, both with the command line and the GUI, the full database is created without any problem. To double check, I went back to the old directory with no extensions and created a new database using a filter of "*.*" and only 14 documents were created in the database (instead of 5000+). Conclusions: In the command line you must have input documents with an extension of "xml" since there is no visible way to provide a filter. The GUI interfaces differently than the command line with the basex core since it can receive a filter as well as a path in the database creation process The GUI filter functionality in 6.3.4 is different than in 6.1...for me it is "broken" vs. how it works in 6.1 So, I think for my project to work completely, I need new functionality: a file name filter that works correctly on the CREATE DB statement in the command line interface. Does this sound correct to you? Unfortunately, I don't have control over the extension names of my input files as they are created by another piece of software. Until I can do a create database in the command line, I'll have to do manual gui-based (6.1 version) refreshes of the data or some sort of long copy/rename process in the background. Thanks! David DavidEmailSig <mailto:david@leighweb.com> *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] *Sent:* Wednesday, December 29, 2010 11:26 AM *To:* david(a)leighweb.com <mailto:david@leighweb.com>; BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> *Subject:* Re: [basex-talk] Database creation from a directory tree Hi David, the syntax of the create command changed between the releases of 6.1 and 6.3.4. In release 6.1 you have to use: create db C:\Users\David\Documents\OpenSong\songpacks\Songs songs Kind regards, Andreas Am 28.12.10 18:00, schrieb David leigh: Here are my command line results from 6.3.4: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp BaseX.jar org.basex.BaseXClient -Uadmin -Padmin BaseX 6.3.5 [Client] Try "help" to get more information. > drop db songs Database 'songs' was dropped. > create db song Database 'song' created in 1683.61 ms. > info index Tags - Structure: Hash - Entries: 0 Attributes - Structure: Hash - Entries: 0 Text Index - Structure: Binary tree - Size: 4 Bytes - Entries: 0 Attribute Index - Structure: Binary tree - Size: 4 Bytes - Entries: 0 Full-Text Index - Not available Path Summary doc() 1x > info table Stopped at line 1, column 10: Syntax: INFO ([DATABASE|INDEX|STORAGE]) Show information on current database. Shows information on the currently opened database: - no argument: show global information - DATABASE: shows database information - INDEX: shows index information - STORAGE [start end] | [query]: show internal database table > info storage PRE DIS SIZ ATS NS KIND CONTENT ------------------------------------- 0 1 1 1 0 DOC song > info General Information Database Path: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX\data Used Main Memory: 895 KB Database Creation Whitespace Chopping: ON Entity Parsing: OFF Indexes Path Summary: ON Text Index: ON Attribute Index: ON Full-Text Index: OFF > So, for 6.3.4, it creates from the command line, but it's empty. The root of that path has NO files in it. The 5861 files are in all the subdirectories. Then, when I try the same syntax with 6.1, I get the following results: > create db songs C:\Users\David\Documents\OpenSong\songpacks\Songs Stopped at line 1, column 17: Syntax: CREATE [DB|COLL|FS|INDEX|USER] [...] Create database, index or user. Creates a new database, index or user: - DB [path] [name?]: creates the database [name] for the file or directory [path] - COLL [name]: creates an empty database [name] - INDEX [TEXT|ATTRIBUTE|FULLTEXT|PATH]: creates the specified index - FS [path] [name] ([mountpoint] [backingstore]): creates filesystem database [name] for [path] (using [mountpoint] and [backingstore] if FUSE is activated) - USER [name] [password?]: creates the specified user Summary: 6.1 GUI -- works as I want it 6.1 command line -- can't get it to create 6.3.4 GUI -- creates but with only 14 entries 6.3.4 command line -- creates, but it's empty I don't mind staying with 6.1, but I DO want to do everything with the command line. Is the ADD syntax the same, in that I can simply specify the path and it will recurse the whole directory tree? Thanks!!! David DavidEmailSig <mailto:david@leighweb.com> *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] *Sent:* Tuesday, December 28, 2010 01:29 PM *To:* david(a)leighweb.com <mailto:david@leighweb.com> *Cc:* basex-talk(a)mailman.uni-konstanz.de <mailto:basex-talk@mailman.uni-konstanz.de> *Subject:* Re: [basex-talk] Database creation from a directory tree Additional question: That was in the GUI. I'd like to do the same thing using the command line with the .JAR file, but somewhere my syntax is not right. Additionally, all the XML files have NO EXTENSION so I don't know how to specify that either in the command line. So, any help in that area would also be appreciated. Could you provide your syntax? The syntax should be: create db dbname path/to/folder The missing extension shouldnt be a problem, i just tested it. In the GUI in 6.1, I can create a database from a whole directory hierarchy of 5,681 individual XML files. When I point to the same source file directory and using the 6.3.4 GUI (which I installed with a pre-release version of the installer), it only processes 14 files. No error message (that I saw) was produced. The behavior that I'm wanting is what 6.1 does. Glad to help in solving the problem. We will check for modifications between the releases. As quick workaround you could try to create an empty database and then add the documents with the Database/Add documents menu. Kind regards, Andreas Am 28.12.10 12:55, schrieb David leigh: I've just installed 6.3.4 and I've noticed a difference from version 6.1. In the GUI in 6.1, I can create a database from a whole directory hierarchy of 5,681 individual XML files. When I point to the same source file directory and using the 6.3.4 GUI (which I installed with a pre-release version of the installer), it only processes 14 files. No error message (that I saw) was produced. The behavior that I'm wanting is what 6.1 does. Glad to help in solving the problem. Additional question: That was in the GUI. I'd like to do the same thing using the command line with the .JAR file, but somewhere my syntax is not right. Additionally, all the XML files have NO EXTENSION so I don't know how to specify that either in the command line. So, any help in that area would also be appreciated. Thank you, David DavidEmailSig <mailto:david@leighweb.com> _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

1 1

Working with embedded databases
by Charles F. Munat 02 Jan '11

02 Jan '11

I have a project using an embedded Base-X db that I access through application code. I want to view this information using the Base-X GUI. Currently, I use a REST interface to output the entire database as one large XML file. Then I import that file into Base-X using the GUI so that I can run queries on it with the benefits the GUI brings. But this process is cumbersome and is getting downright unwieldy as the size of the db grows. Is there a way to open the .basex files directly in the GUI to avoid this intermediate step? Thanks! Chas.

2 2

Free file hosting offer for BaseX (new features)
by DownloadRoute.com 02 Jan '11

02 Jan '11

January 2, 2011 ------------------------------- Dear Freeware author, only for freeware authors, we offer on our site hosting for your files for free. You can easy upload your BaseX file to our server which is located in US (Dallas, Texas). If you are interested just click on this URL and follow instructions on this page: http://files.downloadroute.com/reciprocal-url/BaseX-DBIS-Group-University-o… We have only limits that your file can't exceed 50MB and must be Freeware, but the traffic is unlimited. Sincerely, George www.DownloadRoute.com

1 0

Fwd: Re: Database creation from a directory tree
by Andreas Weiler 31 Dec '10

31 Dec '10

Forwarding to mailing-list...maybe interesting for others. -------- Original-Nachricht -------- Betreff: Re: [basex-talk] Database creation from a directory tree Datum: Fri, 31 Dec 2010 16:41:05 +0100 Von: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> An: david(a)leighweb.com Hi David, thanks a lot for your tests. I couldnt fix the gui bug yet...but i can help you with command line... There is a createfilter option...it can be set with: set createfilter * so all files in the folder are recognized for creating a database. I hope this works for now, Happy new year, Andreas Am 31.12.10 15:13, schrieb David leigh: > > Andreas, > > I just did an interesting test (using the version that the windows > installer installs: 6.3.4). > > I copied my directory tree of files and in the new copy, I gave all my > data files an extension of "xml" (previously they had NO extension). > NOW, both with the command line and the GUI, the full database is > created without any problem. To double check, I went back to the old > directory with no extensions and created a new database using a filter > of "*.*" and only 14 documents were created in the database (instead > of 5000+). > > Conclusions: > > 1.In the command line you must have input documents with an extension > of "xml" since there is no visible way to provide a filter. > > 2.The GUI interfaces differently than the command line with the basex > core since it can receive a filter as well as a path in the database > creation process > > 3.The GUI filter functionality in 6.3.4 is different than in 6.1...for > me it is "broken" vs. how it works in 6.1 > > So, I think for my project to work completely, I need new > functionality: a file name filter that works correctly on the CREATE > DB statement in the command line interface. Does this sound correct > to you? > > Unfortunately, I don't have control over the extension names of my > input files as they are created by another piece of software. Until > I can do a create database in the command line, I'll have to do manual > gui-based (6.1 version) refreshes of the data or some sort of long > copy/rename process in the background. > > Thanks! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Wednesday, December 29, 2010 11:26 AM > *To:* david(a)leighweb.com; BaseX-Talk(a)mailman.uni-konstanz.de > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Hi David, > > the syntax of the create command changed between the releases of 6.1 > and 6.3.4. > > In release 6.1 you have to use: > > create db C:\Users\David\Documents\OpenSong\songpacks\Songs songs > > Kind regards, > Andreas > > Am 28.12.10 18:00, schrieb David leigh: > > Here are my command line results from 6.3.4: > > C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX>java -cp > BaseX.jar org.basex.BaseXClient -Uadmin -Padmin > > BaseX 6.3.5 [Client] > > Try "help" to get more information. > > > drop db songs > > Database 'songs' was dropped. > > > create db song > > Database 'song' created in 1683.61 ms. > > > info index > > Tags > > - Structure: Hash > > - Entries: 0 > > Attributes > > - Structure: Hash > > - Entries: 0 > > Text Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Attribute Index > > - Structure: Binary tree > > - Size: 4 Bytes > > - Entries: 0 > > Full-Text Index > > - Not available > > Path Summary > > doc() 1x > > > info table > > Stopped at line 1, column 10: > > Syntax: INFO ([DATABASE|INDEX|STORAGE]) > > Show information on current database. > > Shows information on the currently opened database: > > - no argument: show global information > > - DATABASE: shows database information > > - INDEX: shows index information > > - STORAGE [start end] | [query]: show internal database table > > > info storage > > PRE DIS SIZ ATS NS KIND CONTENT > > ------------------------------------- > > 0 1 1 1 0 DOC song > > > info > > General Information > > Database Path: C:\Users\David\Documents\OpenSong\OpenSongSearch\BaseX\data > > Used Main Memory: 895 KB > > Database Creation > > Whitespace Chopping: ON > > Entity Parsing: OFF > > Indexes > > Path Summary: ON > > Text Index: ON > > Attribute Index: ON > > Full-Text Index: OFF > > > > > So, for 6.3.4, it creates from the command line, but it's empty. The > root of that path has NO files in it. The 5861 files are in all the > subdirectories. > > Then, when I try the same syntax with 6.1, I get the following results: > > > create db songs C:\Users\David\Documents\OpenSong\songpacks\Songs > > Stopped at line 1, column 17: > > Syntax: CREATE [DB|COLL|FS|INDEX|USER] [...] > > Create database, index or user. > > Creates a new database, index or user: > > - DB [path] [name?]: > > creates the database [name] for the file or directory [path] > > - COLL [name]: > > creates an empty database [name] > > - INDEX [TEXT|ATTRIBUTE|FULLTEXT|PATH]: > > creates the specified index > > - FS [path] [name] ([mountpoint] [backingstore]): > > creates filesystem database [name] for [path] > > (using [mountpoint] and [backingstore] if FUSE is activated) > > - USER [name] [password?]: > > creates the specified user > > Summary: > > 6.1 GUI -- works as I want it > > 6.1 command line -- can't get it to create > > 6.3.4 GUI -- creates but with only 14 entries > > 6.3.4 command line -- creates, but it's empty > > I don't mind staying with 6.1, but I DO want to do everything with the > command line. > > Is the ADD syntax the same, in that I can simply specify the path and > it will recurse the whole directory tree? > > Thanks!!! > > David > > DavidEmailSig <mailto:david@leighweb.com> > > *From:*Andreas Weiler [mailto:andreas.weiler@uni-konstanz.de] > *Sent:* Tuesday, December 28, 2010 01:29 PM > *To:* david(a)leighweb.com <mailto:david@leighweb.com> > *Cc:* basex-talk(a)mailman.uni-konstanz.de > <mailto:basex-talk@mailman.uni-konstanz.de> > *Subject:* Re: [basex-talk] Database creation from a directory tree > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the > command line. So, any help in that area would also be appreciated. > > > Could you provide your syntax? > > The syntax should be: > create db dbname path/to/folder > > The missing extension shouldnt be a problem, i just tested it. > > > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > We will check for modifications between the releases. As quick > workaround you could try to create an empty database and then add the > documents with the Database/Add documents menu. > > Kind regards, > Andreas > > Am 28.12.10 12:55, schrieb David leigh: > > I've just installed 6.3.4 and I've noticed a difference from version 6.1. > > In the GUI in 6.1, I can create a database from a whole directory > hierarchy of 5,681 individual XML files. When I point to the same > source file directory and using the 6.3.4 GUI (which I installed with > a pre-release version of the installer), it only processes 14 files. > No error message (that I saw) was produced. The behavior that I'm > wanting is what 6.1 does. Glad to help in solving the problem. > > Additional question: That was in the GUI. I'd like to do the same > thing using the command line with the .JAR file, but somewhere my > syntax is not right. Additionally, all the XML files have NO > EXTENSION so I don't know how to specify that either in the command > line. So, any help in that area would also be appreciated. > > Thank you, > > David > > DavidEmailSig <mailto:david@leighweb.com> > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk