- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

On Mon, Dec 12, 2011 at 4:50 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: > Dear Christian, > Thank's for your quick reply. I try to give you an example as I don't > think my english is good enough to explain you otherwise: > For a xml like: > <AAA> > <BBB att1="bbb"> > <CCC att1="ccc"/> > <DDD att1="ddd"> > <EEE att1="eee"/> > </DDD> > </BBB> > </AAA> > If i search for "ddd" i need the result to be: > <AAA> > <BBB att1="bbb"> > <DDD att1="ddd"/> > </BBB> > </AAA> > > Maybe this result can be achieved using xquery, I'm not sure as I don't > know xquery well enough. I only tried using xpath, and with xquery I > only scratched the surface, and as it wasn't leading me in the right > direction and I was running out of time I had to use the solution that I've > send you. From what I could figure out in Serializer.java, it seems to me > that all the children of a result are serialized as well. I think it's > worth mentioning that I don't know the structure of the xml in which i'm > serching, and with XMLExtractSerializer I only use the xpath //*[@* > contains text '%s'] and it gives me the result I need. > If you think this can be achieved using XQuery please let me know and I'll > allocate more time to look into it. > Thank you for your time! > Best regards, > Tiberiu > > On Mon, Dec 12, 2011 at 4:22 PM, Christian Grün <christian.gruen(a)gmail.com > > wrote: > >> Dear Tiberiu Tofan, >> >> thanks for your code snippet, always welcome! Before including new >> code, I'd like to ensure that it will represent added value for other >> users as well, so.. may I ask what your XMLExtractSerializer class is >> supposed to do? Maybe it can also be realized via XQuery? >> >> Christian >> ___________________________ >> >> On Mon, Dec 12, 2011 at 3:15 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: >> > Hi, >> > I work on a project involving some large xml files that we need to >> search >> > for specific attribute values, and I tried a solution based on BaseX >> > database. After several hours of searching I found no way to serialize >> the >> > answer as I needed (the elements that had the searched attribute value >> and >> > all their parents). As I only had two days for a proof-of-concept I >> made my >> > own serializer and now the result is as I expect it to be. As I find >> these >> > feature to be useful I attached the source code and maybe you'll >> consider to >> > include such a feature in a future release. Unfortunately I had to hack >> > Serializer.java, as the node() method was final, and I suggest you at >> least >> > to make the Serializer more configurable (eg. a properties file for the >> > serialization options and the class to use and then >> > reflection, splitting the node() method into several override-able >> > sub-methods). >> > On the other hand, maybe there is a way to obtain the result I needed >> using >> > the existing features of basex, but as I told you I hadn't much time and >> > this seemed to me the quickest solution. >> > >> > Best Regards, >> > Tiberiu Tofan >> > >> > _______________________________________________ >> > BaseX-Talk mailing list >> > BaseX-Talk(a)mailman.uni-konstanz.de >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> > >

2 1

BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

Hi, I work on a project involving some large xml files that we need to search for specific attribute values, and I tried a solution based on BaseX database. After several hours of searching I found no way to serialize the answer as I needed (the elements that had the searched attribute value and all their parents). As I only had two days for a proof-of-concept I made my own serializer and now the result is as I expect it to be. As I find these feature to be useful I attached the source code and maybe you'll consider to include such a feature in a future release. Unfortunately I had to hack Serializer.java, as the node() method was final, and I suggest you at least to make the Serializer more configurable (eg. a properties file for the serialization options and the class to use and then reflection, splitting the node() method into several override-able sub-methods). On the other hand, maybe there is a way to obtain the result I needed using the existing features of basex, but as I told you I hadn't much time and this seemed to me the quickest solution. Best Regards, Tiberiu Tofan

2 1

basexhttp server serving html document?
by Erol Akarsu 11 Dec '11

11 Dec '11

Christian, I would like to know the scalability and performance of basex if we used it as Web server serving HTML documents for web clients. Think about we would be using basexhttp server. Have we done any load testing for multiple concurrent users on basexhttp server? Do we have any performance metrics available to share with me? Best Regards Erol Akarsu On Sat, Dec 10, 2011 at 6:16 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Christian, > > Nothing wrong on Basex side. > > It was my error no handling one type of input in html page. > > Basex works perfectly, > > It was first time to use Basex as web scrapping tool. It did indeed very > nicely and perfectly. > > Great job of Basex team > > Erol Akarsu > > > On Fri, Dec 9, 2011 at 4:55 PM, Christian Grün <christian.gruen(a)gmail.com>wrote: > >> ..wow, I've never managed to do segmentation faults with Java ;) Seems >> to be an error in your JVM, which will have to be reported to Oracle. >> >> How long did you run your script? Did you manage to find the script >> with the unparsed "µ" ? >> >> Christian >> ___________________________ >> >> On Fri, Dec 9, 2011 at 10:37 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> > Christian, >> > >> > Attached xquery file run gives segmentation fault. You can run it and >> see >> > it: >> > >> > eakarsu@ubuntu:~/Neweggdata/scripts$ xquery1 xq5 >> > /home/eakarsu/basex/bin/xquery1: line 20: 808 Segmentation fault >> java >> > -cp "$CP" $VM org.basex.BaseX "$@" >> > >> > Erol Akarsu >> > >> > >> > On Fri, Dec 9, 2011 at 10:55 AM, Christian Grün < >> christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> It's probably an encoding issue. Could you provide us with the >> >> relevant $url or original file? >> >> ___________________________ >> >> >> >> On Fri, Dec 9, 2011 at 4:24 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >> > Christian, >> >> > >> >> > It won't work with latest version of Basex also. >> >> > >> >> > Erol Akarsu >> >> > >> >> > >> >> > On Fri, Dec 9, 2011 at 9:52 AM, Christian Grün >> >> > <christian.gruen(a)gmail.com> >> >> > wrote: >> >> >> >> >> >> Thanks Erol, >> >> >> >> >> >> have you tried the latest version >> >> >> (http://files.basex.org/releases/latest/)? >> >> >> >> >> >> Best, >> >> >> Christian >> >> >> ___________________________ >> >> >> >> >> >> On Fri, Dec 9, 2011 at 3:49 PM, Erol Akarsu <eakarsu(a)gmail.com> >> wrote: >> >> >> > >> >> >> > When I was fetching and parsing some html documents with >> >> >> > >> >> >> > let $doc := http:send-request(<http:request method='get' >> >> >> > href='{$url}'/>) >> >> >> > >> >> >> > I am getting an error: >> >> >> > >> >> >> > [FOHC0001] An HTTP error occurred: "1323441640568.xml" (Line 475): >> >> >> > Invalid >> >> >> > character found: 'µ'. >> >> >> > >> >> >> > It seems base is not able to handle special chracter 'µ'. >> >> >> > >> >> >> > >> >> >> > Erol Akarsu >> >> >> > >> >> >> > _______________________________________________ >> >> >> > BaseX-Talk mailing list >> >> >> > BaseX-Talk(a)mailman.uni-konstanz.de >> >> >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> > >> >> > >> >> > >> > >> > >> > >

2 1

Portuguese stemmer
by Michael Piotrowski 11 Dec '11

11 Dec '11

Hi, When trying to use the Portuguese stemmer (from the GUI), I get the following error: --8<---------------cut here---------------start------------->8--- Version: BaseX 7.0.2 Java: Apple Inc., 1.6.0_29 OS: Mac OS X, x86_64 Stack Trace: java.lang.NullPointerException org.basex.util.Token.token(Token.java:154) org.basex.util.ft.LuceneStemmer.stem(LuceneStemmer.java:133) org.basex.util.ft.Stemmer.nextToken(Stemmer.java:96) org.basex.util.ft.FTLexer.nextToken(FTLexer.java:119) org.basex.index.ft.FTBuilder.index(FTBuilder.java:122) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:48) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:1) org.basex.core.cmd.ACreate.index(ACreate.java:154) org.basex.core.cmd.ACreate.index(ACreate.java:131) org.basex.core.cmd.CreateIndex.run(CreateIndex.java:63) org.basex.core.Command.run(Command.java:328) org.basex.core.Command.run(Command.java:116) org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:135) --8<---------------cut here---------------end--------------->8--- I had a look in lucene-stemmers-3.4.0.jar; could the problem be that the Portuguese stemmer is actually a Snowball, not a Lucene stemmer? Thanks and best regards -- Dr.-Ing. Michael Piotrowski, M.A. <mxp(a)cl.uzh.ch> Institute of Computational Linguistics, University of Zurich Phone +41 44 63-54313 | OpenPGP public key ID 0x1614A044 * OUT NOW: Systems and Frameworks for Computational Morphology * <http://www.springeronline.com/978-3-642-23137-7>

3 8

basex 7.0.2: no context item for root error
by Andy Bunce 11 Dec '11

11 Dec '11

Hi with the factbook.xml database open in the 7.0.2 gui declare function local:linkto($id as xs:string){ let $d:=//city let $a:=$d[@id=$id] return $a }; local:linkto("f0_1461") Gives the "no context item for root" error on the //city line, but declare function local:linkto($id as xs:string){ let $a:=//city[@id=$id] return $a }; local:linkto("f0_1461") Works fine. Should it give the same error? If it should, and I try to pass the nodes into the function then the relative performance is not good at all. declare function local:linkto2($id as xs:string,$nodes as node()*){ let $c:=$nodes[@id=$id] let $n:=name($c[1]) return <a href="/fb/{$n}/{$id}"> {$c/name/string()} </a> }; let $caps:=//country/@capital/string() for $id in $caps return local:linkto2($id,//city) /Andy

2 3

Old factbook/Mo version
by Andy Bunce 11 Dec '11

11 Dec '11

Hi, The version of factbook.xml http://files.basex.org/xml/factbook.xml is not the latest. It suffers from repeated ids. The happens for cities in more than one province. http://www.dbis.informatik.uni-goettingen.de/Mondial/ has a more up to date version with a slightly different schema without this problem. (As used by existDb :-) /Andy

2 1

reporting a BUG in the IOFile class
by VORS, Guilhem (CIMPA SAS) 10 Dec '11

10 Dec '11

To all the baseX team, First of all I would like to thank you for the great tool you made. We use it almost every day in our team. One member had actually developed a pluggin for xml validation some years ago. To the bug trackers, I would like to report a strange behaviour regarding the IOFile class, using baseX702 jar file, eclipse indigo, along with JDK 1.7.0_01 When trying to execute the CreateDB command to build a local baseX database from a distant file (say fileInputPath = "//filer/distant/file.xml"), when you proceed with the static method by doing: BufferedInputStream bis = new BufferedInputStream(new FileInputStream( fileInputPath)); SAXSource saxSource = new SAXSource(new InputSource(bis)); SAXWrapper saxWrapper = new SAXWrapper(saxSource, context.prop); CreateDB.create(dbName, saxWrapper, context); Everything works fine. BUT, when you try to do the same using the non static method, by doing (which I need because I have to report the progress of the create command in a JProgressBar): create = new CreateDB(dbName, fileInputPath); create.execute(context); You get the following exception: org.basex.core.BaseXException: "filer/distant/file.xml ": (here the path where the command is run)/filer/distant/file.xml (unknown path or something like that (in French it's :"le chemin d'accès spécifié est introuvable")). After some bug tracking, it appears that in the function create, in static class PathList, inside the IOFile class, there is a mistreatment of the path, here is the function: static class PathList extends StringList { /** * Creates a path. * @param path input path * @return path */ String create(final String path) { final TokenBuilder tb = new TokenBuilder(); final int l = path.length(); for(int i = 0; i < l; ++i) { final char ch = path.charAt(i); if(ch == '\\' || ch == '/') add(tb); else tb.add(ch); } add(tb); for(int s = 0; s < size; ++s) { // if(s == 0 && (path.startsWith("\\\\") || path.startsWith("//"))) tb.add("//"); // this is my current "hack" to resolve the problem) if(s != 0 || path.startsWith("/")) tb.add('/'); tb.add(list[s]); } return tb.toString(); } If I don't uncomment my line, I get the error described above, because the TokenBuilder remove the first two '/' from the path it builds. What I have done to solve the problem, is to make a local copy of IOFile + CreateDB, and I have added the line commented, to add the leading '//' in front of remote file access. This workaround works well for my project, but it is not convenient for me, as I would like to get the new versions of baseX. Could you please find a way to resolve this problem, I don't know if it is intentional, or even if I'm using it the right way. Again thank you for your professional quality software. I'm waiting forward to have news from you. Guilhem VORS iSLM Business Solution Integration AIRBUS CIMPA SAS Phone : +33 (0) 5 61 53 50 28 Fax : +33 (0) 5 67 19 95 52 E-mail : guilhem.vors(a)airbus.com The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised. If you are not the intended recipient, please notify Airbus immediately and delete this e-mail. Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately. All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

2 1

can't call the outer most return value by name
by jidanni＠jidanni.org 09 Dec '11

09 Dec '11

Odd, one can see <R> but not access by it. Run this: declare function local:K($x){ switch ($x) case 2 return <R><name>N</name><o><name>Y</name></o></R> default return() }; " A",local:K(2)//*:R, " B",local:K(2)/o/name, (: shows we are already at the root :) " C",local:K(2)/., (: reveals R is really in there, but can't be called by name :) " D",local:K(2)/./R What's the deal?

2 1

Invalid character found: 'µ'.
by Erol Akarsu 09 Dec '11

09 Dec '11

When I was fetching and parsing some html documents with let $doc := http:send-request(<http:request method='get' href='{$url}'/>) I am getting an error: [FOHC0001] An HTTP error occurred: "1323441640568.xml" (Line 475): Invalid character found: 'µ'. It seems base is not able to handle special chracter 'µ'. Erol Akarsu

2 3

Command line arguments
by Erol Akarsu 09 Dec '11

09 Dec '11

Can I pass command line arguments to basex while executing a xquery script? Thanks Erol Akarsu

2 1

FW: database compatibility - adding several binary resource files
by Fabrice Etanchaud 09 Dec '11

09 Dec '11

Dear all at BaseX, 1. just in case... are databases created with BaseX 6.5 (and so backups) compatible with BaseX 7.0 ? 2. Is there a way to load several binary resource files with only one command or xquery function (like ADD or db:add for textual resources) ? Thank you for your fanstatic job. regards, Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

No results for query. Please help!
by Subhro Moitra 09 Dec '11

09 Dec '11

Hello, I am getting to know Basex702. I downloaded the war and its receiving requests at http://localhost:8080/BaseX702/rest (tomcat servlet container) I am using curl to query the REST urls for results. I used the command below to populate the initial data *$$ curl -i -X PUT -H "Content-Type: application/xml" -T "/tmp/bv_letsbuycom_standard_client_feed.xml" "admin:admin@localhost :8080/BaseX702/rest/bvstandard"* To confirm the PUT above i do this: *$$ curl -i "admin:admin@localhost:8080/BaseX702/rest/bvstandard"* .... ...... <rest:database name="bvstandard" resources="1" xmlns:rest=" http://www.basex.org/rest"> <rest:resource type="xml" content-type="application/xml" size="828733">bvstandard.xml</rest:resource> </rest:database> Another confirmation *$$ curl -i "admin:admin@localhost :8080/BaseX702/rest/bvstandard/bvstandard.xml"* * * The above shows the entire xml. So the data got loaded fine i believe. Now i am stuck. a query like below is not resulting any results. The xml document surely contains the path and data. *$$ curl -i "admin:admin@localhost :8080/BaseX702/rest/bvstandard?query=/Feed/Product&wrap=no"* There are multiple Product elements under the Feed element. And the above query returns empty results. I know i am doing something fundamentally wrong, but not sure what. However, a request like *$$ curl -i "admin:admin@localhost :8080/BaseX702/rest/bvstandard?query=//@id"* * * Shows results as expected, ie all the attributes *id * and its values are displayed. Please help. Aren't the values of query param in the GET url above, a XPATH expression? How to i execute a xpath on the DB to get the results, using the REST interface. The main purpose is to get some 100 MB large xml file into BaseX and then query it using a php client and display results on a web page. We at letsbuy.com is really interested in integrating BaseX in our application for handling all the XML feeds we consume. Please advice. Thanks, Subhro.

1 1

http request for binary resource
by Fabrice Etanchaud 09 Dec '11

09 Dec '11

Dear all, I'm trying to download a jpg from the web and then write it in a file. Everything goes right, but at the end the file is not a valid image... it contains extra bytes... could you please tell me where I went wrong ? declare default element namespace "http://www.w3.org/1999/xhtml"; file:write-binary('c:/fe/img.jpg', http:send-request(<http:request method='get' override-media-type=image/jpeg'/>, http:send-request(<http:request method='get' />, 'http://www.patentsoffice.ie/eregister/register/TMRegister.aspx?idAppli= 2005/01446')[2]//img/@src[contains(.,'TM')]/data() ) ) With a typeswitch I can see that the response body is a xs:base64Binary, so it should fit correctly in the file:write-binary function... best regards Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

3 2

BaseX on Android
by Andy Bunce 08 Dec '11

08 Dec '11

Hi, I remember seeing some discussion of research into this a while back. I have just got a Android tablet so was wondering what the state of play is on this? I come across JBED http://forum.xda-developers.com/showthread.php?t=1189303which seems to claim the ability to run jars though an emulation layer. I tried this but it is looking for a midlet/jad descriptor file. I will investigate this, but has anybody been down this route? /Andy

3 3

how to get at the XML within the XML?
by jidanni＠jidanni.org 08 Dec '11

08 Dec '11

I triggered a bug. make basex -q 'declare option output:cdata-section-elements "desc M";document{(doc("AMFMXTaiwan.gpx")//*:wpt[1]/*:desc/data())}' Potential bug? Improper use? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.0.2 Java: Sun Microsystems Inc., 1.6.0_26 OS: Linux, i386 Stack Trace: <--------------------by the way, there is 1 trailing whitespace here java.lang.ArrayIndexOutOfBoundsException: -1 org.basex.util.list.TokenList.peek(TokenList.java:116) org.basex.io.serial.OutputSerializer.finishText(OutputSerializer.java:230) org.basex.io.serial.Serializer.text(Serializer.java:134) org.basex.query.item.FTxt.serialize(FTxt.java:37) org.basex.query.item.FDoc.serialize(FDoc.java:59) org.basex.core.cmd.AQuery.query(AQuery.java:100) org.basex.core.cmd.XQuery.run(XQuery.java:22) org.basex.core.Command.run(Command.java:328) org.basex.core.Command.exec(Command.java:309) org.basex.core.Command.execute(Command.java:77) org.basex.server.LocalSession.execute(LocalSession.java:142) org.basex.server.Session.execute(Session.java:38) org.basex.core.Main.execute(Main.java:139) org.basex.BaseX.<init>(BaseX.java:89) org.basex.BaseX.main(BaseX.java:54) make: *** [3] Error 1 basex -q 'declare option output:cdata-section-elements "desc";document{data(doc("AMFMXTaiwan.gpx")//*:wpt[1]/*:desc)}' causes a similar bug. Input was http://radioscanningtw.jidanni.org/images/radioscanningtw/maps/AMFMXTaiwan.… All I was trying to do was figure out some way to do like fn-bea:inlinedXML Parses textual XML and returns an instance of the XQuery 1.0 Data Model. without having to say goodbye to basex. You see I'm trying to figure how to get a inner shred of XML, <description><![CDATA[<ul><li>復興廣播電台...</li><li>台北市士...</li><li>丙</li></ul>]]></description> parsed just like the enclosing file. Maybe I need some "util:eval()". You see I want to access the inner elements with //li[2] etc. instead of matches(*:desc,concat('/li><li>(',$x,')')) like a dweeb. Help.

2 3

Basex Http module error
by Erol Akarsu 05 Dec '11

05 Dec '11

I have been using http module w/o any issue before. Today, I tried it with latest release 7.0.2 but getting error "Error parsing entity as XML or HTML." Did I miss anything to run? return http:send-request(<http:request method='get' href=' http://www.google.com'/>) Error: [FOHC0002] Error parsing entity as XML or HTML. Thanks Erol Akarsu

3 3

Fwd: Insert position of attributes
by Jan Vlčinský (CAD) 04 Dec '11

04 Dec '11

Hi Regarding the (not existent) requirement for attribute order: In http://www.w3.org/TR/2008/REC-xml-20081126/#sec-starttags there is a note "Note that the order of attribute specifications in a start-tag or empty-element tag is not significant." And my recommendation is: Do not put any extra requirements to any XML, which is not really needed. In case of attributes, you may and up promissing your consumers that the order of attributes will be as you define, and later you may have problems switching tools, which follow W3C recommendation, but not your extra promise. So the general advice is: keep your promises at minimum possible, it will easy work for you and also for your partners. The same often applies, when people start insisting on certain XML encoding, encoding or not encoding of special characters - all these requirements are more cosmetic then practical and often do originate from people, who do not understand the topic so well, but are well trained in the exercise "find three differences it those two pictures". Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky On 2 December 2011 18:46, Dave Glick <dglick(a)dracorp.com> wrote: > After a little more investigation of the XQuery Update standard, it looks > to me like BaseX is doing this right and the standard does not allow for > positioning of attribute insertions (unless there’s another approach I’ve > overlooked). In case anyone else has a similar question – all insert > operations involving attributes resolve to the function > upd:insertAttributes which does not allow for positioning. It appears as > though the modifiers “as first” and “as last” are ignored in the case of > attributes.**** > > ** ** > > I suppose this makes sense if the ordering of attributes in XML is > unimportant and undefined. Can anyone clarify what the XML/XDM standard has > to say on the topic of attribute ordering? It’s a little confusing because > many XML processors attempt to present attributes with some kind of > explicit ordering (as an example, see the .NET XmlAttributeCollection class > which allows programmatic insertion of attributes before/after a reference > attribute).**** > > ** ** > > Thanks (again),**** > > ** ** > > Dave**** > > ** ** > > *From:* Dave Glick > *Sent:* Friday, December 02, 2011 12:37 PM > *To:* basex-talk(a)mailman.uni-konstanz.de > *Subject:* Insert position of attributes**** > > ** ** > > How would one go about inserting an attribute at a specific position > (i.e., somewhere other than at the front of the attribute list)? I would > expect the following expression would do the trick: “insert node attribute > aname {'avalue'} as last into //XYZ” but it still inserts the attribute at > the front of the attribute list.**** > > ** ** > > By looking at the code in the InsertAttribute update primitive, I can see > that it’s hardcoded to insert at the front of the attribute list. Does this > mean that there is no way to control attribute insertion location? Does the > XQuery Update standard not allow such an update or is this a bug/oversight > on the part of BaseX?**** > > ** ** > > Thanks!**** > > ** ** > > Dave**** > > ** ** > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

1 0

cdata-section-elements collisions
by jidanni＠jidanni.org 04 Dec '11

04 Dec '11

declare option output:cdata-section-elements "description"; works great, except that I want it to work only on my //Folder/description's not my //Placemark/description's. I read http://www.w3.org/TR/2010/REC-xslt-xquery-serialization-20101214/index.html… and http://docs.basex.org/wiki/Serialization and no matter what I do...

2 2

Hi! form Mongolia
by Tuguldur J 03 Dec '11

03 Dec '11

Dear Sir, My name is Tuguldur from Mongolia. I am database architecturer of CSMS. So i want to develop BaseX to Mongolian language so much. I'm finally done, but the one thing i can't change that application name of 7.0.3 "beta" to 7.0.3 /"бета хувилбар" in Mongolian/. If it is done, one international version may has done. so please how can i fix that own problem.I look forward to your reply. thank you. Yours sincerely Bayangol district, 7-25 Ulaanbaatar, Mongolia

2 1

running server commands from a script?
by C. M. Sperberg-McQueen 03 Dec '11

03 Dec '11

From time to time, I find myself wanting to run BaseX server commands from a shell script. For example, if I have two or three documents I'd like to add to a database, it's easy enough to do so from the GUI interface, or from the interactive server prompt. But if it's five or ten documents (and even more so if it's a few hundred or a few thousand documents), entering the commands interactively can become tedious and error prone. When the files are available on the local file system, I can use wildcards and I can add a directory at a time. But when the files are on a remote server and identified by URI instead of file name, I guess that won't work. What I think I'm looking for is the ability to specify a sequence of BaseX server commands and have it run that sequence of commands -- or some other way of being able to specify a list of filenames or URIs and have them all added to a given database. For example CREATE DATABASE demo OPEN demo ADD http://example.com/docs/a.xml ADD http://example.com/docs/b.xml ADD http://example.com/docs/c.xml ADD http://example.com/docs/d.xml ADD http://example.com/docs/e.xml ... ADD http://example.com/docs/z.xml RENAME http://example.com/docs/ / # I'd use ADD to a.xml http://example.com/docs/a.xml, but # that doesn't seem to have the effect I expect. But # RENAME works for what I need There is certainly a lot of BaseX documentation I have not read, but I have not found any mention of this kind of thing. Have I overlooked it? One technique that I guess would work would be to exploit the new REST interface (very nice, by the way!) and write a bash script that went something like this: curl http://localhost:8984/rest?command=CREATE+DATABASE+demo curl http://localhost:8984/rest/demo?command=ADD+http://example.com/docs/a.xml curl http://localhost:8984/rest/demo?command=ADD+http://example.com/docs/b.xml curl http://localhost:8984/rest/demo?command=ADD+http://example.com/docs/c.xml curl http://localhost:8984/rest/demo?command=ADD+http://example.com/docs/d.xml curl http://localhost:8984/rest/demo?command=ADD+http://example.com/docs/e.xml ... curl http://localhost:8984/rest/demo?command=ADD+http://example.com/docs/z.xml curl http://localhost:8984/rest/demo?command=RENAME+http://example.com/docs/+/ or rather CURL="curl --user X:secretpasswd" $CURL http://localhost:8984/rest?command=CREATE+DATABASE+demo etc. But if there is s nicer way to handle this case, I'd be glad to learn about it. Perhaps this is when I should buckle down and learn how to do this kind of thing with XQuery Update? Thanks! Michael Sperberg-McQueen -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

Re: [basex-talk] Insert position of attributes
by Dave Glick 03 Dec '11

03 Dec '11

After a little more investigation of the XQuery Update standard, it looks to me like BaseX is doing this right and the standard does not allow for positioning of attribute insertions (unless there's another approach I've overlooked). In case anyone else has a similar question - all insert operations involving attributes resolve to the function upd:insertAttributes which does not allow for positioning. It appears as though the modifiers "as first" and "as last" are ignored in the case of attributes. I suppose this makes sense if the ordering of attributes in XML is unimportant and undefined. Can anyone clarify what the XML/XDM standard has to say on the topic of attribute ordering? It's a little confusing because many XML processors attempt to present attributes with some kind of explicit ordering (as an example, see the .NET XmlAttributeCollection class which allows programmatic insertion of attributes before/after a reference attribute). Thanks (again), Dave From: Dave Glick Sent: Friday, December 02, 2011 12:37 PM To: basex-talk(a)mailman.uni-konstanz.de Subject: Insert position of attributes How would one go about inserting an attribute at a specific position (i.e., somewhere other than at the front of the attribute list)? I would expect the following expression would do the trick: "insert node attribute aname {'avalue'} as last into //XYZ" but it still inserts the attribute at the front of the attribute list. By looking at the code in the InsertAttribute update primitive, I can see that it's hardcoded to insert at the front of the attribute list. Does this mean that there is no way to control attribute insertion location? Does the XQuery Update standard not allow such an update or is this a bug/oversight on the part of BaseX? Thanks! Dave

2 1

Insert position of attributes
by Dave Glick 02 Dec '11

02 Dec '11

How would one go about inserting an attribute at a specific position (i.e., somewhere other than at the front of the attribute list)? I would expect the following expression would do the trick: "insert node attribute aname {'avalue'} as last into //XYZ" but it still inserts the attribute at the front of the attribute list. By looking at the code in the InsertAttribute update primitive, I can see that it's hardcoded to insert at the front of the attribute list. Does this mean that there is no way to control attribute insertion location? Does the XQuery Update standard not allow such an update or is this a bug/oversight on the part of BaseX? Thanks! Dave

1 0

Writing output to multiple files
by Andreas Karpf 01 Dec '11

01 Dec '11

Dear BaseX Team! After several unfortunately unsuccessful trials & errors I am appealing to with a question which should be easy for you to answer, as I think it is pretty basic. I have a BaseX database filled up with thousands of different but equally structured xml-documents. What I want to do is to parse out necessary information and transform that into html files with distinct names. Actually I can parse out all the information I want but the output at the moment is just one huge html-file. The corresponding xquery looks something like this (I just left the parts in there which seem in my opinion relevant for my question, for real the whole xquery files is much much longer) declare option output:method "html"; (:Define word count function:) declare namespace functx = "http://www.functx.com"; declare function functx:word-count ($arg as xs:string?) as xs:integer {count(tokenize($arg,'\W+')[. != ''])}; let $items:= for $docitem in .//docitem where (:Text length (number of tokens):) for $text in $docitem/text where functx:word-count($text)<250 return (:Language :) for $language in $docitem/@xml:lang where $language="en" return <html> <body> <h3>{data($docitem/headline/text())}</h3> {$docitem/text/p/text()} <br>ID: {data($docitem/@itemid)}</br> <br>Word count:{functx:word-count($text)}</br> </body> </html> return file:write("//htmlfolder/file.html", $items) At the moment I just get all the parsed out elements in one if also well structured html file. What I however want would be multiple html files as output which have a filename like "itemid.htm" from $docitem/@itemid which is a distinct and exact identifier for all the xml files in the database. how can I achieve that. I have tried it with something like the following, but it won't work and I don't arrive to figue it out why: let $docitem:= .//docitem let $doc_id := data($docitem/@itemid) let $documentname := concat('//htmlfolder/', $doc_id, '.html') return file:write($documentname, $items) BaseX always tells me that "no sequences are allowed regarding $docitem/@itemid". What could be the problem there, or how could I solve this problem. I have tried several combinations because from what I have found on the web regarding my problem the solution should go into a similar direction. Would please somebody of you be so nice to help me with that. Every hint would be very much appreciated! Best regards, Andreas

2 1

namespace limit?
by C. M. Sperberg-McQueen 01 Dec '11

01 Dec '11

Greetings! I've just downloaded BaseX 7.0.2, and was very happy to see the checkbox for "Skip corrupt (non-well-formed) files", since it makes it much much easier to create a BaseX database of the XSD test suite. But my attempt to build the database still fails with the message "idI001.xsd" (Line 2): Too many different namespaces (limit: 256). Since document idI001.xsd only declares 5 namespaces, I guess the 256-namespace limit is for the database, not for an individual document. Is there any way to ease the limit, or do I have to contemplate making multiple databases, each covering just part of the test suite? Thank you! Michael Sperberg-McQueen -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

3 7

Re: [basex-talk] ajax and http server - cross-domain, jsonp or proxy?
by Maud Ingarao 30 Nov '11

30 Nov '11

Hello, The support of jsonp would be very welcomed here, since several projects on tge-adonis use or will use the basex.tge-adonis.fr/rest service... For now, I went on with the proxy solution : http://hyperdonat.tge-adonis.fr/basex/basex.html Cheers, Maud On Sat, Oct 22, 2011 at 12:07 AM, < basex-talk-request(a)mailman.uni-konstanz.de> wrote: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Re: Performance of Basex 7.0 XQuery execution (Leo W?rteler) > 2. Re: Problems in using BaseX REST server - > IncompatibleClassChangeError javax.ws.rs.core.Response$Status > does not implement the requested interface (Pushkaraj Thorat) > 3. Re: ajax and http server - cross-domain, jsonp or proxy? > (Godmar Back) > 4. Re: ajax and http server - cross-domain, jsonp or proxy? > (Michael Seiferle) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Fri, 21 Oct 2011 14:12:50 +0200 > From: Leo W?rteler <lw(a)basex.org> > To: Constantine Hondros <Constantine.Hondros(a)tomtom.com> > Cc: basex-talk <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Performance of Basex 7.0 XQuery execution > Message-ID: <4EA161C2.3060908(a)basex.org> > Content-Type: text/plain; charset=UTF-8; format=flowed > > Dear Constantine, > > Am 20.10.2011 09:44, schrieb Constantine Hondros: > > Of course, I am really interested in more useful queries such as: > > > > //tns:poi[not(tns:id = preceding-sibling::tns:poi/tns:id)] > > this query basically compiles to two nested loops, the outer one > iterating over //tns:poi and the inner one over all preceding-siblings. > So it has an O(n^2) runtime. > > > I guess what I am asking is ... while most XPath queries I run are quick > to resolve, anything using preceding::, preceding-sibling:: or following::, > following-sibling:: essentially runs too slowly to be workable - at least, > on my sample dataset with about 100K sibling children of the root element. > > Well, that's an extreme example, 100'000^2 is a huge number of nodes to > traverse. I performed some tests with > a) 10'000 sibling elements inside the root: > <root> > <item id="1"/> > <item id="2"/> > [...] > <item id="10000"/> > </root> > > and the query //item[not(preceding-sibling::*)] > > b) 10'000 nested elements: > <root> > <item id="1"> > <item id="2"> > [...] > <item id="10000"/> > [...] > </item> > </item> > </root> > > and the query //item[not(ancestor::*)] > > The timings I get are almost identical, replacing "preceding" with > "following" or "ancestor" with "descendant" doesn't change much. > > > So is this any sort of known issue? Should I be looking at any sort of > configuration options? Is there any way to profile the execution of the > Xpath? > > My guess is that the number of nodes on the *-sibling-axes is usually > much bigger than on the vertical axes, so an expensive algorithm gets > unusable earlier. > > To return to your example query, you could drastically reduce its > runtime by only traversing the database once, comparing each node only > to the nodes with unique tns:ids found before. I'll use a left fold [1][2]: > > fold-left( > function($seq, $x) { > if($seq/tns:id = $x/tns:id) then $seq > else ($seq, $x) > }, > (), > //tns:poi > ) > > If you're OK with using not-yet-standard XQuery extensions, a map [3] > instead of a sequence can potentially be even faster: > > let $map := > fold-left( > function($map, $x) { > let $key := $x/tns:id > return if(map:contains($map, $key)) then $map > else map:new(($map, map:entry($key, $x))) > }, > map:new(), > //tns:poi > ) > for $key in map:keys($map) > return $map($key) > > But this won't preserve the relative ordering of the results. > > Hope that helped, > Cheers Leo > __________ > > [1] http://www.w3.org/TR/xpath-functions-30/#func-fold-left > [2] http://en.wikipedia.org/wiki/Fold_%28higher-order_function%29 > [3] http://docs.basex.org/wiki/Map_Functions > > > ------------------------------ > > Message: 2 > Date: Sat, 22 Oct 2011 01:40:23 +0530 > From: Pushkaraj Thorat <pushkaraj.thorat.devl(a)gmail.com> > To: Rositsa Shadura <rositsa.shadura(a)uni-konstanz.de> > Cc: basex-talk(a)mailman.uni-konstanz.de > Subject: Re: [basex-talk] Problems in using BaseX REST server - > IncompatibleClassChangeError javax.ws.rs.core.Response$Status does > not > implement the requested interface > Message-ID: > <CAH5ngE_gf655mnLuTCAjStd2X1cmWKJQk8xYTErMyFv4QnMYeQ(a)mail.gmail.com > > > Content-Type: text/plain; charset="iso-8859-1" > > Thanks Rositsa! > It is bit late to reply, but indeed it is a good to know. > > Regards > Pushkaraj > > On Fri, Mar 4, 2011 at 3:01 AM, Rositsa Shadura < > rositsa.shadura(a)uni-konstanz.de> wrote: > > > Hi all, > > > > I've just managed accidentally to reproduce the error. I noticed that the > > class javax.ws.rs.core.Response.**Status is defined in both > > jsr311-api-1.0.jar and jersey-core-1.4.jar but only the class in the > > jersey-core JAR implements the interface > javax.ws.rs.core.Response.**StatusType. > > This is why it is important that the jersey-core JAR appears before the > > jsr311-api JAR in the classpath. When not the error occurs. > > > > Greetings, > > Rositsa > > > > > > On Thu, 20 Jan 2011 12:03:45 +0100, Michael Seiferle < > > michael.seiferle(a)uni-**konstanz.de <michael.seiferle(a)uni-konstanz.de>> > > wrote: > > > > Hi Pushkaraj, > >> > >> thanks in return for your response. > >> I will see if I can reproduce that in my VM; so far you are the first > one > >> to report this issue, I'll let you know what I can find. > >> > >> Kind regards > >> > >> Michael > >> > >> Am 19.01.2011 um 20:19 schrieb Pushkaraj Thorat: > >> > >> Thanks for your response Michael, > >>> > >>> I am using java 1.6 > >>> > >>> pushkaraj@toothless:~$ java -version > >>> java version "1.6.0_17" > >>> Java(TM) SE Runtime Environment (build 1.6.0_17-b04) > >>> Java HotSpot(TM) Server VM (build 14.3-b01, mixed mode) > >>> pushkaraj@toothless:~$ > >>> > >>> Just to update, the rest server ran successfully on my windows machine. > >>> Not sure what problem faced on the linux(ubuntu) machine. I will debug > once > >>> I get some time. > >>> > >>> Thanks, Pushkaraj > >>> > >>> > >>> On Tue, Jan 18, 2011 at 3:46 AM, Michael Seiferle > <michael.seiferle@uni- > >>> **konstanz.de <michael.seiferle(a)uni-konstanz.de>> wrote: > >>> Dear Pushkaraj, > >>> > >>> I am deeply sorry for you having to mess around with that erroneous > >>> startup scripts. > >>> We fixed them in both the ZIP & DMG distribution, feel free to download > >>> them again. > >>> > >>> >> java.lang.**IncompatibleClassChangeError > >>> We have been trying to reproduce this error - but to no avail. > >>> Your error message might have to do something with your Java Version; > >>> please make sure you are running the latest version. > >>> > >>> Hope this helps! In case it does not, feel free to ask for more. > >>> > >>> Kind regards > >>> > >>> Michael > >>> > >>> Am 17.01.2011 um 22:00 schrieb Pushkaraj Thorat: > >>> > >>> > I am doing setup for REST enabled basex database with procedure > >>> mentioned in http://docs.basex.org/wiki/**JAX-RX_API< > http://docs.basex.org/wiki/JAX-RX_API>URL. > >>> > > >>> > Configuring & starting server and running failed due to class not > >>> found, but later I've modified the ./basexrest script as: (Included > all the > >>> jars in lib folder) > >>> > > >>> > ######START > >>> > #!/bin/bash > >>> > # Path to this script > >>> > PWD=`dirname $0` > >>> > # Paths to distributed files or source directories > >>> > BASEX=$PWD/BaseX.jar > >>> > BASEXAPI=$PWD/../lib/basex-**api.jar > >>> > # Classpath > >>> > LIB=$PWD/../lib > >>> > LIB_CP="" > >>> > for JAR_FILE in $LIB/*.jar > >>> > do > >>> > LIB_CP="$LIB/$JAR_FILE:$LIB_**CP" > >>> > done > >>> > CP=$BASEX:$BASEXAPI:$LIB_CP > >>> > # Options for virtual machine > >>> > VM=-Xmx1g > >>> > # Run REST server > >>> > java -cp "$CP" $VM org.basex.api.jaxrx.**JaxRxServer "$@" > >>> > > >>> > ######END > >>> > > >>> > after this, server started successfully, hit the URL - > >>> http://localhost:8984/basex/**jax-rx< > http://localhost:8984/basex/jax-rx>I am getting following exception: > >>> > > >>> > java.lang.**IncompatibleClassChangeError: Class > >>> javax.ws.rs.core.Response$**Status does not implement the requested > >>> interface javax.ws.rs.core.Response$**StatusType > >>> > at > com.sun.jersey.spi.container.**ContainerResponse.getStatus(** > >>> ContainerResponse.java:548) > >>> > at com.sun.jersey.spi.container.**ContainerResponse$** > >>> CommittingOutputStream.**commitWrite(ContainerResponse.**java:156) > >>> > at com.sun.jersey.spi.container.**ContainerResponse$** > >>> CommittingOutputStream.write(**ContainerResponse.java:133) > >>> > at org.basex.io.BufferedOutput.**flush(BufferedOutput.java:50) > >>> > at org.basex.io.PrintOutput.**flush(PrintOutput.java:126) > >>> > at org.basex.data.XMLSerializer.**cls(XMLSerializer.java:206) > >>> > at org.basex.data.Serializer.**close(Serializer.java:219) > >>> > at org.basex.api.jaxrx.BXJaxRx$1.**code(BXJaxRx.java:96) > >>> > at org.basex.api.jaxrx.BXCode.**run(BXCode.java:53) > >>> > at org.basex.api.jaxrx.BXOutput.**write(BXOutput.java:53) > >>> > at com.sun.jersey.core.impl.**provider.entity.** > >>> StreamingOutputProvider.**writeTo(**StreamingOutputProvider.java:**71) > >>> > at com.sun.jersey.core.impl.**provider.entity.** > >>> StreamingOutputProvider.**writeTo(**StreamingOutputProvider.java:**57) > >>> > at com.sun.jersey.spi.container.**ContainerResponse.write(** > >>> ContainerResponse.java:299) > >>> > > >>> > >>> > >>> ______________________________**_________________ > > BaseX-Talk mailing list > > BaseX-Talk(a)mailman.uni-**konstanz.de <BaseX-Talk(a)mailman.uni-konstanz.de > > > > https://mailman.uni-konstanz.**de/mailman/listinfo/basex-talk< > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> > > >

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk