BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5250 discussions

Re: [basex-talk] Storing and reading data - migrate from exist-db
by Christian Grün 27 May '13

27 May '13

Hi Bartosz (cc @basex-talk), if you want to cache your data in temporary files without losing synchronicity, you may take advantage of the (yet undocumented, but stable) locking options that have been introduced with BaseX 7.7. The following example query... declare option query:write-lock "file-io"; file:write-text("x.txt", '123') ...ensures that all other queries with a read-lock or write-lock option on the (arbitrarily chosen) "file-io" string, such as e.g.… declare option query:read-lock "file-io"; file:read-text("x.txt", '123') …will be queued until the query has been evaluated. Next, please note that XQuery demands that a doc() function in a query will always return the same document instance. In your example, this means that the second doc() function won’t repeatedly access the source file, but instead return the existing document node reference. You may surpass this by using fetch:text() or file:read-text() and parse-xml(): let $path := $path || '/index.xml' let $indexold := parse-xml(file:read-text($path))//index let $indexnew := <index>{ $indexold + 1 }</index> let $filewrite := file:write($path), $indexnew) let $index := parse-xml(file:read-text($path)) If you want to use pure XQuery (Update/3.0), however, you’ll have to split your query into several files, or you can use the helpful transform expression [1], which allows you to create updated main-memory instances, which can then be stored in databases or processed any other way. An example: copy $doc := parse-xml(file:read-text($path)) modify replace value of node $doc//index with $indexold + 1 return $doc As your problem is quite a frequent one, there’s some good chance that an upcoming version of XQuery Update will allow both updates and returned results in one query. I hope this gives you some inspiration, Christian [1] http://docs.basex.org/wiki/XQuery_Update#transform ___________________________ On Mon, May 27, 2013 at 12:44 PM, Bartosz Marciniak <marciniak.b(a)gmail.com> wrote: > Christan, > what I mean is reading updated data from db and then binding them to a > variable by let expression. > > > Initially, I tried to use file:write() function to store temporaty data in > the external file > using following solution: > > let $indexold := doc(concat($path , '/index.xml'))//index > let $indexnew := <index>{$indexold + 1}</index> > let $filewrite := file:write(concat($path , '/index.xml'), $indexnew, ()) > let $index := doc(concat($path , '/index.xml')) > > but I discoverd that the file:write() function is not synchronized. So I > tried to store temporary data in the db. > > > I hope I clearly presented the problem, if not please forget about that :-) > > > regards > Bartosz > > > > > > 2013/5/27 Christian Grün <christian.gruen(a)gmail.com> >> >> Hi Bartosz, >> >> ..what do you mean exactly with "the result"? >> >> Best, >> Christian >> >> > Christian, >> > thank you very much. This example works and explained a lot to me. >> > But could you just explain is it possible or not to evaluate further the >> > result? > >

1 0

invalid collection name?
by C. M. Sperberg-McQueen 27 May '13

27 May '13

Using the GUI interface to BaseX 7.2, when I select Database / Open and Manage ..., I get a list of the databases I have built over the time I've been using BaseX. When I try to open the collection named MEP.bigbooks, though, I get an error box saying "Name 'MEP.bigbooks' is invalid." In the "Manage Databases" dialog box, the information about the collection appears normal and plausible (at least, the size is about what I expect, and so on). It's only when I try to open the collection that I run into the error. I get similar errors on other collections which have . in their name; I do not get errors when opening other collections built (as far as I can remember) at the same time from the same data, if their name does not include a full stop. When I try renaming the collection without the full stop, I get the same error message. When I try to issue the command ALTER DATABASE MEP.bigbooks MEPbigbooks from the server command area of the GUI, I get a short syntax summary in the Query Info area complaining about the syntax of the command. When I replace MEP.bigbooks with MEP\.bigbooks and "MEP.bigbooks", I also get syntax errors. If I close the GUI and just rename the directory within my BaseXData directory, the database appears to open normally. I think I have two questions: Q1 is just renaming the directory a safe way (assuming no server is currently working with the data) to rename a collection? Should I do the same for all the other collections I have that don't currently open? I assume that if the 7.2 GUI won't let me rename them, it also will have trouble deleting them, so a related question is: is just deleting a sub-directory of BaseXData a safe way to delete a collection? Q2 Did the rules for names of collections change? Or is there some other cause? Speaking for myself, I guess that as a user I haven't thought much about what characters should be allowed in collection names, but I may have assumed that if they are not unrestricted, they would be restricted to being legal NCNames. I do kind of like using dots in names, so you can count this as one vote for relaxing the naming rules at some convenient moment. It's not a really important point, of course. best, Michael -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 2

Storing and reading data - migrate from exist-db
by Bartosz Marciniak 27 May '13

27 May '13

Hello, I'm trying to rewritte XQuery prepared for exist-db into baseX. I have a problem with storing data in the database. In exist-db xmldb:store() function returns a string and there is no problem to create let/return construct. Is it possible to create a similar solution in baseX? --- exist-db ----------------------------------------- xquery version "3.0"; declare function local:indexget() as item()* { let $index := doc('db/index.xml') return xs:integer($index/index/text()) }; declare function local:indexset($index as xs:integer) as xs:string? { let $newresource := xmldb:store('/db','index.xml', <index>{$index}</index>) return $newresource }; let $indexnew := local:indexget() + 1 let $newresource := local:indexset($indexnew) return local:indexget() ---------------------------------------------------- And these are baseX functions I wrote, but I don't know if is it possible to create solution similar to above? Can anyone help me solve this problem? ---- BaseX ---------------------------------------------- declare function local:indexget() as item()* { let $index := doc('/home/index.xml') return xs:integer($index/index/text()) }; declare %updating function local:indexset($index as xs:integer) { db:replace('index', 'index.xml', <index>{$index}</index>) }; (....) ------------------------------------------------------------ Regards Bartosz Marciniak

2 1

Full Text Indexing 8 GB DB !!
by John Best 27 May '13

27 May '13

Hi Team, I have a XML DB with approx 8 GB in size. The size of the DB will go on increasing through monthly updates. The size of monthly update will be around 10 MB in size.As the DB is storing text documents, I will have to index the full-text index again, after updating to speed up the process. Sometimes, I get Heap Space error too !! My DB will be stored at the user end. Then how come I will be able to Optimize it? Also the DB is created using a huge XML file. After viewing the Statistics (http://docs.basex.org/wiki/Statistics), I came to understand that the size of my DB is stands no where, when compared to at least, first 15-16 entries !!. This situation has always troubled me a lot. May be I am doing it in wrong way.. Can you guys put light on this? -- Have a nice day JBest

2 1

BaseXClient.php lacking more() and next()
by James Ball 26 May '13

26 May '13

Hello, I'm new to BaseX but am finding it very useful for somethings I'm working on. Today I've been working with the BaseX client for PHP and QueryExample.php fails for me saying the functions more() and next() are not defined. I'm not a PHP expert so I'm not sure if there is another way of achieving the same thing - but I did find an email chain on this list from April which suggested that the functions were missing and needed to be written by someone. I have taken the Ruby client as a guide and created the two functions in PHP but I'm just not sure that I've done it in the neatest way. 1) Is there a better way in PHP to get each result of a query so that more() and next() are not needed? 2) If not might my version of these functions be useful? If so, what is the process for submitting code? Thank you for your help. Regards, James Add two class variables $pos and $cache. public function more() { if ($this->cache == NULL) { $this->pos = 0; $this->session->send(chr(4).$this->id.chr(0)); while (!$this->session->ok()) { $temp = $this->session->readString(); $this->cache[] = $temp; } } return $this->pos < count($this->cache); } public function next() { if($this->more()) { return $this->cache[$this->pos++]; } }

2 1

WSSE + basex
by Marco Lettere 24 May '13

24 May '13

Hello all, I'm currently learning about using Web service security for adding security related tokens to SOAP messages. The basex functions of the crypto module come in very handy. I'm a bit confused on how to put the signature inside the proper headers of the soap message. Are there any hints? Thank you. M.

1 0

Re: [basex-talk] Processor for xsl.fo to create a pdf output
by Arve Gengelbach 24 May '13

24 May '13

Hi Elisabeth, Within XQuery, using the [Process Module], you could invoke any java based FO Processor as a java process. But therefor you first have to write the file to disk to hand it in as an argument. For example: proc:execute("java", ( "-Djava.awt.headless=true", "-classpath", $classpath, "org.apache.fop.cli.Main" (: , ... :) )) Depending on the FO Processor you use, refer to the invoking shell or batch script to see what arguments the java process needs. Hope this helps Arve Am 24.05.13 15:53, schrieb content agentis: > Is there a processor for *.fo files to create a pdf-file? > > This *.fo file is the result of a xsl-transformation and in the database. > > Outside the database I use the fop processor. Can this processor be > integrated and used in the database? > > How and what are the commands (xquery and command)? > > Best regards > > Elisabeth > > /____________________________________/ > > // > > /content///*agentis* > > Elisabeth Paul > > Marie-Curie-Straße 2 > > 79211 Denzlingen > > 07666/8813162 > > mailto: elisabeth.paul(a)contentagentis.de > > www.contentagentis.de > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > -- Arve Gengelbach, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

Processor for xsl.fo to create a pdf output
by content agentis 24 May '13

24 May '13

Is there a processor for *.fo files to create a pdf-file? This *.fo file is the result of a xsl-transformation and in the database. Outside the database I use the fop processor. Can this processor be integrated and used in the database? How and what are the commands (xquery and command)? Best regards Elisabeth ____________________________________ content agentis Elisabeth Paul Marie-Curie-Straße 2 79211 Denzlingen 07666/8813162 mailto: elisabeth.paul(a)contentagentis.de www.contentagentis.de

1 0

using data() is slow!
by James Wright 22 May '13

22 May '13

Hey Again, Sorry if I am here often. I got my system up and running and at first was seeing 1 second query times which is unacceptable. I started doing some research and trying different things. Here are some interesting things I found: 1) Using data() is SLOW!!! For example: (//DataElement(data(Name) = 'Transformer'])[1] : this takes 350 ms avg to complete (Most of it evaluation)(//DataElement(Name = 'Transformer')[1] : this takes 4 - 10 ms. Not sure why this is, but its good to know. I'm assuming the data() usage circumvents the indexes or something... 2) In a dynamic context is often worthwhile to 'construct' a query with the names embedded and execute xquery:eval rather than using variables within the expression. For example when trying to find a node based on a key property name which you don't know until run time: ($page:database//DataElement[(*|@*)[name() = $keyPropName)] = $entityId])[1] Above query takes about 1200 ms to complete in our data. If you have more than one of these being executed, it jumps to 10,000 ms or more!! xquery:eval("($context//" || $entityListName || "[" || $keyPropertyName || " = $entityId])[1]", map{ '$context' := $page:database, '$entityId' := $entityId }) This query takes between 2 - 8 ms to complete. Awesome!! Just thought I would share my findings! So far I am really enjoying BaseX!! Thanks for all the hard work! - James

1 0

Support for "Feature 'http://apache.org/xml/features/xinclude' is not recognized."
by subbarao＠intense.in 22 May '13

22 May '13

Dear BaseX, I am getting following exception while creating XML DB org.basex.core.BaseXException: "file://XML/Backup/149874654.XML": Feature 'http://apache.org/xml/features/xinclude' is not recognized. at org.basex.core.Command.execute(Command.java:73) at org.basex.core.Command.execute(Command.java:85) at core.data.CRSXqueryComp.addXML(CRSXqueryComp.java:123) And following are the Jars files using in my project BaseX671.jar basex-api.jar xmldb-api-1.0.jar xom-1.2.1.jar xwork-2.0.4.jar xalan.jar xalan-2.7.0.jar xercesImpl-2.9.1.jar xml.jar xml-apis.jar Please suggest me the way forward. Thanks & Regards Subbu

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk