BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5270 discussions

Re: [basex-talk] BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

On Mon, Dec 12, 2011 at 4:50 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: > Dear Christian, > Thank's for your quick reply. I try to give you an example as I don't > think my english is good enough to explain you otherwise: > For a xml like: > <AAA> > <BBB att1="bbb"> > <CCC att1="ccc"/> > <DDD att1="ddd"> > <EEE att1="eee"/> > </DDD> > </BBB> > </AAA> > If i search for "ddd" i need the result to be: > <AAA> > <BBB att1="bbb"> > <DDD att1="ddd"/> > </BBB> > </AAA> > > Maybe this result can be achieved using xquery, I'm not sure as I don't > know xquery well enough. I only tried using xpath, and with xquery I > only scratched the surface, and as it wasn't leading me in the right > direction and I was running out of time I had to use the solution that I've > send you. From what I could figure out in Serializer.java, it seems to me > that all the children of a result are serialized as well. I think it's > worth mentioning that I don't know the structure of the xml in which i'm > serching, and with XMLExtractSerializer I only use the xpath //*[@* > contains text '%s'] and it gives me the result I need. > If you think this can be achieved using XQuery please let me know and I'll > allocate more time to look into it. > Thank you for your time! > Best regards, > Tiberiu > > On Mon, Dec 12, 2011 at 4:22 PM, Christian Grün <christian.gruen(a)gmail.com > > wrote: > >> Dear Tiberiu Tofan, >> >> thanks for your code snippet, always welcome! Before including new >> code, I'd like to ensure that it will represent added value for other >> users as well, so.. may I ask what your XMLExtractSerializer class is >> supposed to do? Maybe it can also be realized via XQuery? >> >> Christian >> ___________________________ >> >> On Mon, Dec 12, 2011 at 3:15 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: >> > Hi, >> > I work on a project involving some large xml files that we need to >> search >> > for specific attribute values, and I tried a solution based on BaseX >> > database. After several hours of searching I found no way to serialize >> the >> > answer as I needed (the elements that had the searched attribute value >> and >> > all their parents). As I only had two days for a proof-of-concept I >> made my >> > own serializer and now the result is as I expect it to be. As I find >> these >> > feature to be useful I attached the source code and maybe you'll >> consider to >> > include such a feature in a future release. Unfortunately I had to hack >> > Serializer.java, as the node() method was final, and I suggest you at >> least >> > to make the Serializer more configurable (eg. a properties file for the >> > serialization options and the class to use and then >> > reflection, splitting the node() method into several override-able >> > sub-methods). >> > On the other hand, maybe there is a way to obtain the result I needed >> using >> > the existing features of basex, but as I told you I hadn't much time and >> > this seemed to me the quickest solution. >> > >> > Best Regards, >> > Tiberiu Tofan >> > >> > _______________________________________________ >> > BaseX-Talk mailing list >> > BaseX-Talk(a)mailman.uni-konstanz.de >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> > >

2 1

BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

Hi, I work on a project involving some large xml files that we need to search for specific attribute values, and I tried a solution based on BaseX database. After several hours of searching I found no way to serialize the answer as I needed (the elements that had the searched attribute value and all their parents). As I only had two days for a proof-of-concept I made my own serializer and now the result is as I expect it to be. As I find these feature to be useful I attached the source code and maybe you'll consider to include such a feature in a future release. Unfortunately I had to hack Serializer.java, as the node() method was final, and I suggest you at least to make the Serializer more configurable (eg. a properties file for the serialization options and the class to use and then reflection, splitting the node() method into several override-able sub-methods). On the other hand, maybe there is a way to obtain the result I needed using the existing features of basex, but as I told you I hadn't much time and this seemed to me the quickest solution. Best Regards, Tiberiu Tofan

2 1

basexhttp server serving html document?
by Erol Akarsu 10 Dec '11

10 Dec '11

Christian, I would like to know the scalability and performance of basex if we used it as Web server serving HTML documents for web clients. Think about we would be using basexhttp server. Have we done any load testing for multiple concurrent users on basexhttp server? Do we have any performance metrics available to share with me? Best Regards Erol Akarsu On Sat, Dec 10, 2011 at 6:16 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Christian, > > Nothing wrong on Basex side. > > It was my error no handling one type of input in html page. > > Basex works perfectly, > > It was first time to use Basex as web scrapping tool. It did indeed very > nicely and perfectly. > > Great job of Basex team > > Erol Akarsu > > > On Fri, Dec 9, 2011 at 4:55 PM, Christian Grün <christian.gruen(a)gmail.com>wrote: > >> ..wow, I've never managed to do segmentation faults with Java ;) Seems >> to be an error in your JVM, which will have to be reported to Oracle. >> >> How long did you run your script? Did you manage to find the script >> with the unparsed "µ" ? >> >> Christian >> ___________________________ >> >> On Fri, Dec 9, 2011 at 10:37 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> > Christian, >> > >> > Attached xquery file run gives segmentation fault. You can run it and >> see >> > it: >> > >> > eakarsu@ubuntu:~/Neweggdata/scripts$ xquery1 xq5 >> > /home/eakarsu/basex/bin/xquery1: line 20: 808 Segmentation fault >> java >> > -cp "$CP" $VM org.basex.BaseX "$@" >> > >> > Erol Akarsu >> > >> > >> > On Fri, Dec 9, 2011 at 10:55 AM, Christian Grün < >> christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> It's probably an encoding issue. Could you provide us with the >> >> relevant $url or original file? >> >> ___________________________ >> >> >> >> On Fri, Dec 9, 2011 at 4:24 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >> > Christian, >> >> > >> >> > It won't work with latest version of Basex also. >> >> > >> >> > Erol Akarsu >> >> > >> >> > >> >> > On Fri, Dec 9, 2011 at 9:52 AM, Christian Grün >> >> > <christian.gruen(a)gmail.com> >> >> > wrote: >> >> >> >> >> >> Thanks Erol, >> >> >> >> >> >> have you tried the latest version >> >> >> (http://files.basex.org/releases/latest/)? >> >> >> >> >> >> Best, >> >> >> Christian >> >> >> ___________________________ >> >> >> >> >> >> On Fri, Dec 9, 2011 at 3:49 PM, Erol Akarsu <eakarsu(a)gmail.com> >> wrote: >> >> >> > >> >> >> > When I was fetching and parsing some html documents with >> >> >> > >> >> >> > let $doc := http:send-request(<http:request method='get' >> >> >> > href='{$url}'/>) >> >> >> > >> >> >> > I am getting an error: >> >> >> > >> >> >> > [FOHC0001] An HTTP error occurred: "1323441640568.xml" (Line 475): >> >> >> > Invalid >> >> >> > character found: 'µ'. >> >> >> > >> >> >> > It seems base is not able to handle special chracter 'µ'. >> >> >> > >> >> >> > >> >> >> > Erol Akarsu >> >> >> > >> >> >> > _______________________________________________ >> >> >> > BaseX-Talk mailing list >> >> >> > BaseX-Talk(a)mailman.uni-konstanz.de >> >> >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> > >> >> > >> >> > >> > >> > >> > >

2 1

Portuguese stemmer
by Michael Piotrowski 10 Dec '11

10 Dec '11

Hi, When trying to use the Portuguese stemmer (from the GUI), I get the following error: --8<---------------cut here---------------start------------->8--- Version: BaseX 7.0.2 Java: Apple Inc., 1.6.0_29 OS: Mac OS X, x86_64 Stack Trace: java.lang.NullPointerException org.basex.util.Token.token(Token.java:154) org.basex.util.ft.LuceneStemmer.stem(LuceneStemmer.java:133) org.basex.util.ft.Stemmer.nextToken(Stemmer.java:96) org.basex.util.ft.FTLexer.nextToken(FTLexer.java:119) org.basex.index.ft.FTBuilder.index(FTBuilder.java:122) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:48) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:1) org.basex.core.cmd.ACreate.index(ACreate.java:154) org.basex.core.cmd.ACreate.index(ACreate.java:131) org.basex.core.cmd.CreateIndex.run(CreateIndex.java:63) org.basex.core.Command.run(Command.java:328) org.basex.core.Command.run(Command.java:116) org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:135) --8<---------------cut here---------------end--------------->8--- I had a look in lucene-stemmers-3.4.0.jar; could the problem be that the Portuguese stemmer is actually a Snowball, not a Lucene stemmer? Thanks and best regards -- Dr.-Ing. Michael Piotrowski, M.A. <mxp(a)cl.uzh.ch> Institute of Computational Linguistics, University of Zurich Phone +41 44 63-54313 | OpenPGP public key ID 0x1614A044 * OUT NOW: Systems and Frameworks for Computational Morphology * <http://www.springeronline.com/978-3-642-23137-7>

3 8

basex 7.0.2: no context item for root error
by Andy Bunce 10 Dec '11

10 Dec '11

Hi with the factbook.xml database open in the 7.0.2 gui declare function local:linkto($id as xs:string){ let $d:=//city let $a:=$d[@id=$id] return $a }; local:linkto("f0_1461") Gives the "no context item for root" error on the //city line, but declare function local:linkto($id as xs:string){ let $a:=//city[@id=$id] return $a }; local:linkto("f0_1461") Works fine. Should it give the same error? If it should, and I try to pass the nodes into the function then the relative performance is not good at all. declare function local:linkto2($id as xs:string,$nodes as node()*){ let $c:=$nodes[@id=$id] let $n:=name($c[1]) return <a href="/fb/{$n}/{$id}"> {$c/name/string()} </a> }; let $caps:=//country/@capital/string() for $id in $caps return local:linkto2($id,//city) /Andy

2 3

Old factbook/Mo version
by Andy Bunce 10 Dec '11

10 Dec '11

Hi, The version of factbook.xml http://files.basex.org/xml/factbook.xml is not the latest. It suffers from repeated ids. The happens for cities in more than one province. http://www.dbis.informatik.uni-goettingen.de/Mondial/ has a more up to date version with a slightly different schema without this problem. (As used by existDb :-) /Andy

2 1

reporting a BUG in the IOFile class
by VORS, Guilhem (CIMPA SAS) 09 Dec '11

09 Dec '11

To all the baseX team, First of all I would like to thank you for the great tool you made. We use it almost every day in our team. One member had actually developed a pluggin for xml validation some years ago. To the bug trackers, I would like to report a strange behaviour regarding the IOFile class, using baseX702 jar file, eclipse indigo, along with JDK 1.7.0_01 When trying to execute the CreateDB command to build a local baseX database from a distant file (say fileInputPath = "//filer/distant/file.xml"), when you proceed with the static method by doing: BufferedInputStream bis = new BufferedInputStream(new FileInputStream( fileInputPath)); SAXSource saxSource = new SAXSource(new InputSource(bis)); SAXWrapper saxWrapper = new SAXWrapper(saxSource, context.prop); CreateDB.create(dbName, saxWrapper, context); Everything works fine. BUT, when you try to do the same using the non static method, by doing (which I need because I have to report the progress of the create command in a JProgressBar): create = new CreateDB(dbName, fileInputPath); create.execute(context); You get the following exception: org.basex.core.BaseXException: "filer/distant/file.xml ": (here the path where the command is run)/filer/distant/file.xml (unknown path or something like that (in French it's :"le chemin d'accès spécifié est introuvable")). After some bug tracking, it appears that in the function create, in static class PathList, inside the IOFile class, there is a mistreatment of the path, here is the function: static class PathList extends StringList { /** * Creates a path. * @param path input path * @return path */ String create(final String path) { final TokenBuilder tb = new TokenBuilder(); final int l = path.length(); for(int i = 0; i < l; ++i) { final char ch = path.charAt(i); if(ch == '\\' || ch == '/') add(tb); else tb.add(ch); } add(tb); for(int s = 0; s < size; ++s) { // if(s == 0 && (path.startsWith("\\\\") || path.startsWith("//"))) tb.add("//"); // this is my current "hack" to resolve the problem) if(s != 0 || path.startsWith("/")) tb.add('/'); tb.add(list[s]); } return tb.toString(); } If I don't uncomment my line, I get the error described above, because the TokenBuilder remove the first two '/' from the path it builds. What I have done to solve the problem, is to make a local copy of IOFile + CreateDB, and I have added the line commented, to add the leading '//' in front of remote file access. This workaround works well for my project, but it is not convenient for me, as I would like to get the new versions of baseX. Could you please find a way to resolve this problem, I don't know if it is intentional, or even if I'm using it the right way. Again thank you for your professional quality software. I'm waiting forward to have news from you. Guilhem VORS iSLM Business Solution Integration AIRBUS CIMPA SAS Phone : +33 (0) 5 61 53 50 28 Fax : +33 (0) 5 67 19 95 52 E-mail : guilhem.vors(a)airbus.com The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised. If you are not the intended recipient, please notify Airbus immediately and delete this e-mail. Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately. All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

2 1

can't call the outer most return value by name
by jidanni＠jidanni.org 09 Dec '11

09 Dec '11

Odd, one can see <R> but not access by it. Run this: declare function local:K($x){ switch ($x) case 2 return <R><name>N</name><o><name>Y</name></o></R> default return() }; " A",local:K(2)//*:R, " B",local:K(2)/o/name, (: shows we are already at the root :) " C",local:K(2)/., (: reveals R is really in there, but can't be called by name :) " D",local:K(2)/./R What's the deal?

2 1

Invalid character found: 'µ'.
by Erol Akarsu 09 Dec '11

09 Dec '11

When I was fetching and parsing some html documents with let $doc := http:send-request(<http:request method='get' href='{$url}'/>) I am getting an error: [FOHC0001] An HTTP error occurred: "1323441640568.xml" (Line 475): Invalid character found: 'µ'. It seems base is not able to handle special chracter 'µ'. Erol Akarsu

2 3

Command line arguments
by Erol Akarsu 09 Dec '11

09 Dec '11

Can I pass command line arguments to basex while executing a xquery script? Thanks Erol Akarsu

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk