- BaseX-Talk - mailman.uni-konstanz.de

XML DOCTYPE Problem
by Martin Reckziegel 03 Feb '14

03 Feb '14

Hello everybody, i'm using basex 7.7.2 in a university based project. I'm trying to store TEI XML files in the database but there is an error storing certain valid files. Using a rest PUT request to store a file starting like this: <?xml version="1.0"?> <!DOCTYPE TEI.2 PUBLIC "-//TEI P4//DTD Main DTD Driver File//EN" "http://www.tei-c.org/Guidelines/DTD/tei2.dtd" [ <!ENTITY % TEI.XML "INCLUDE"> <!ENTITY % PersProse PUBLIC "-//Perseus P4//DTD Perseus Prose//EN" "http://www.perseus.tufts.edu/DTD/1.0/PersProse.dtd" > %PersProse; ]> <TEI.2> <teiHeader type="text" status="new"> .... results in this error: > "tlg0003.xml.xml" (Line 5): ']' expected, '<' found. (Line 5 is %PersProse;) I have no clue how to interpret the error since non of the mention characters are in that line. Maybe this is resulting in some internal replacement? Anyway deleting line 5 resolves the error (but of course does not solve my problem since i don't want to alter the files) The problematic files are all valid, at least according to http://www.validome.org/xml/validate/ and http://validator.w3.org/check so i wonder why they are rejected by basex? kind regards, Martin Reckziegel

2 10

Comparision of basex with other xml databases.
by Shalin Makhija 03 Feb '14

03 Feb '14

Hello, I am a newbie to using XML- databases. I am working on "SEMANTIC SEARCH ENGINE" on java that uses a parser to parse the input and generates output in xml. I need to use a xml database for storing all those xml files and fire xpath/xqueries to retrieve my result from java clients. My dilemma is which one to use between BASE-X and EXIST-DB. Both have their own selling points. A W3C test summary reads using base-x is efficient. I will be highly obliged to you if you can give some more concrete points that insist on using base-x so that I can make a fair decision. Thanx in advance. -- *-Regards* *Shalin Makhija*

2 1

function idref() and one-to-many
by Tsvetanka Georgieva-Trifonova 02 Feb '14

02 Feb '14

Hi BaseX, My question is about function idref(). How it should be applied in case of one-to-many relationships? For example: <root> <a id = "a1" idref = "b1"> aaa1</a> <a id = "a2" idef = "b1">aaa2</a> <a id = "a3" idef= "b2"> aaa3</a> bb1 bb2 </root> The expression: idref("a3")/.. gives the following result: bb2 But the expression: idref("a1")/.. does not give any result. Thanks & regards, Tsvetanka

2 1

Introspection bug in BaseX7.8 beta 4cfa54c ?
by jean-marc Mercier 01 Feb '14

01 Feb '14

Hello, As bug https://github.com/BaseXdb/basex/issues/839 has been closed, I tried to upgrade from BaseX7.8 6aeaebf to BaseX beta_4cfa54c. Unfortunately, this bug still appears in 4cfa54c, and I rolled back again to beta 6aeaebf . Did I misunderstoog something ? Cheers

2 8

Make external variable declarations mandatory #833
by jean-marc Mercier 01 Feb '14

01 Feb '14

Hi, I am extensively using a function wrapping xquery:eval. My use case is roughly the following : declare function local:eval_helper($exp, $args){xquery:eval('$xml'||$exp,map{'$xml' := $args})}; declare variable $test := <toto><tata>1</tata></toto>; local:eval_helper3('//tata', $test) Since the following correction : [1] https://github.com/BaseXdb/basex/issues/833, the previous code raises now a [XPST0008] Undefined variable $xml. I have tried several combinations to find a workaround, none are working : - declare function local:eval_helper($exp, $args){xquery:eval(''||$exp,map{'' := $args})}; ([XPDY0050] Root of the context item must be a document node.). - declare function local:eval_helper($exp, $args){xquery:evaluate($arg||$exp)}; [XPTY0019] Steps within a path expression must yield nodes; xs:integer found. -- declare variable $xml external := "xml", : [XPST0008] Undefined variable $xml. What is the correct workaround ? Cheers Jean-Marc

3 4

Searching text using wildcards options
by John Best 31 Jan '14

31 Jan '14

Hi team, For the following query, using wildcards option, I am getting result as last 2 <a> nodes, but I am expecting the first 2 <a> nodes. !! let $a := <A> <a>Famu.</a> <a>Famu.Don</a> <a>FamuDon</a> <a>FamuDon.</a> </A> for $x in $a//a[text() contains text 'Famu..*' using wildcards] return $x Whats wrong? -- Have a nice day JBest

2 1

FW: How do I increase Java's heap size with the flag -Xmx<size>?
by DAIANE ROBERTA CANDIDA 31 Jan '14

31 Jan '14

Hello Dirk, You were right about the command used to increase Java's heap size, but my loading files don't work yet. The server has memory 988g When I put 500g in the option -Xmx it raised the error below: Error occurred during initialization of VM Unable to allocate bit map for parallel garbage collection for the requested heap size. Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. So I decreased it from 500 to 350 then the following error appears Out of Main Memory. You can try to: - increase Java's heap size with the flag -Xmx<size> - deactivate the text and attribute indexes. I already deactivated the indexes FTINDEX: OFF TEXTINDEX: OFF ATTRINDEX: OFF What should I do to import data into the basex? Regards, Daiane.

2 1

Use of attribute index
by Robert schlichtner 31 Jan '14

31 Jan '14

Hello, I found that a number of similar queries have quite different performance: xquery doc('mcev_temp_5/20140130_11_55_40.xml')//column[@name='KLV_m1_rdr']/v takes only 0.68ms, which is great. But xquery doc('mcev_temp_5/20140130_11_55_40.xml')//column[@name='KLV_m1_rdr']/v[1] takes 1479.81ms. If I change this to the equivalent (for my data) xquery (doc('mcev_temp_5/20140130_11_55_40.xml')//column[@name='KLV_m1_rdr'])/v[1] it runs fast again (0.53ms) Checking the query execution plan I found that only query 1 and 3 utilize the attribute index. I find this rather surprising, and I would like to ask if there is some general reason/rule why the second can not use the index, so I can avoid such 'bad' queries in the future. Thanks! (I am using BaseX 7.7.2 on Windows XP.) Regards, Robert

2 2

html and css
by Lars Johnsen 30 Jan '14

30 Jan '14

When running BaseX http-server, I wondered where resources like javascript and css should be located. The .xqm-file for the welcome RESTXQ module seems to fetch its svg and css from a static directory under webapp. However, when sending HTML code from within a home made query, it won't connect to any css neither within webapp nor webapp/static, nor even with an absolute path. Best Lars G Johnsen National Library of Norway

2 1

Parameter to xquery
by Lars Johnsen 30 Jan '14

30 Jan '14

Is it possible to pass parameters to xquery modules using BaseX scripting language? I tried something similar to to http-specification but had no luck. For example, if the code below is stored as add.xq, could $x and $y be supplied in a RUN add.xq command? declare variable $x external; declare variable $y external; let $res := $x + $y return $res All the best Lars G Johnsen National Library of Norway

2 1

How do you update Basex to 7.7.2 version?
by DAIANE ROBERTA CANDIDA 30 Jan '14

30 Jan '14

Hello, I have the Basex installed on the Ubunto Server and by the command apt-get install basex I can not update it because it is past of date, then I downloaded the basex_7.7.2-1.debian.tar.gz but I don't know how to execute the installation. Could you give me a tutorial to do the installation for updating of the basex? Regards, Daiane

5 6

Load lots xml but Unknown option 'ADDCACHE'
by DAIANE ROBERTA CANDIDA 29 Jan '14

29 Jan '14

Hello, I am trying to load a big xml dataset into the Basex but I am in trouble because it is taking so much time and then the message below is returned: Out of Main Memory. The following hints might help you: - increase Java's heap size with the flag -Xmx<size> - choose the internal XML parser in the GUI or via 'set intparse on' - deactivate the text and attribute indexes So I read the help topic in the web site http://comments.gmane.org/gmane.text.xml.basex.talk/2540 I realized that I didn't have set ADDCACHE ON. After that I wrote the following command lines on the linux OS: BaseX 7.0.2 [Client] Try "help" to get more information. > CREATE DB bd_inex2009 Database 'bd_inex2009' created in 66.81 ms. > SET AUTOFLUSH false AUTOFLUSH: OFF > SET ADDCACHE true Unknown option 'ADDCACHE'. > SET INTPARSE true INTPARSE: ON > SET DTD false DTD: OFF > ADD /home/arwen/daiane_oracle/loading_inex2009/new_page_xml2 Out of Main Memory. The problema persist yet. Finaly I downloaded the latest Basex release for Ubunto by the link https://launchpad.net/ubuntu/+source/basex/7.7.2-1 I don't know how to install the basex_7.7.2-1.debian.tar.gz on the server. Could you give me some help? I really need to load this database with those xml to complete a academic task. Regards Daiane

2 1

How to get file name + line number in query results
by Moshe Zuisman 29 Jan '14

29 Jan '14

Hi. I am using base-X as kind of repository for my XML files, to perform queries over all files I use. Number and size of files are not a problem - it is some 100+ files , each one few hundreds lines. To be more specific - those are xml files of IzPack installation. I have loaded all my files into database and perform different kinds of queries there. It works great. Problem is - that after I have found desired data, I have to look at which file at which place it really is located. What I am doing now is - just copy into clipboard piece of resulting data and performing "search in files" at all my XML files directory. Finally - it works, but I am sure - there have to be better way to do it... Can I somehow modify my query to cause base-X to "say" me - where calculated result is located at original file system?

2 2

Pearl pigments
by tony.zhao＠vip.188.com 29 Jan '14

29 Jan '14

1 0

os x app broken
by Charles Dietrich 27 Jan '14

27 Jan '14

When I attempt to open the unzipped BaseX.app (version 7.7.2), OS X reports that it is damaged. -- Charles

4 4

duplicate xmlns in wadl o/p
by Andy Bunce 27 Jan '14

27 Jan '14

given a function commented like: (:~ : return search results : <hit> : <entity>country</entity> : <name>name</name> : <url>...</url> : </hit> :) declare %rest:GET %rest:path("where4/api/search") %restxq:query-param("q", "{$q}") %output:method("json") function search($q){ The wadl function [1] produces: <wadl:resource path="/where4/api/search/"> <wadl:method name="GET"> <wadl:doc xmlns="http://www.w3.org/1999/xhtml">return search results <hit xmlns="" xmlns="http://www.w3.org/1999/xhtml"> <entity xmlns="">country</entity> <name xmlns="">name</name> <url xmlns="">...</url> </hit> </wadl:doc> <wadl:request> <wadl:param name="q" style="query"/> </wadl:request> <wadl:response> <wadl:representation mediaType="application/json"/> </wadl:response> </wadl:method> </wadl:resource> Regards /Andy [1] http://docs.basex.org/wiki/RESTXQ_Module#rest:wadl

2 2

BaseX as a Windows Service
by Sam Eklund 23 Jan '14

23 Jan '14

Is there a possibility to install BaseX server as a service under Windows? The -S switch to start BaseX in the background is nice, however a proper windows service would be even better! Anyone that has accomplished this? Best regards, Sam

4 6

XMLPrague, BaseX User Meeting
by Christian Grün 20 Jan '14

20 Jan '14

Dear all, we are pleased to give you the agenda for our BaseX User Meeting! As a little surprise, we can announce Michael Sperberg McQueen as additional speaker! This is the current list of speakers and talks: _ SESSION 1 _______ • 14:30 Christian Grün: BaseX: 12 Months, 12 Updates • 15:00 Michael Sperberg McQueen: Using BaseX for Off-the-cuff Queries • 15:30 Lars Johnsen: BaseX as a Corpus Tool _ SESSION 2 _______ • 16:30 Gerrit Imsieke: Using BaseX with RESTXQ as the Storage Back-end for a Web-based XML Editor • 16:55 Jean-Marc Mercier: Data Heterogeneity with XQUERY++ and BaseX • 17:20 Yoann Maingon: BaseX for Rapid Minimum Viable Product Prototyping • 17:45 Open Discussion The list may be subject to updates; the latest version will be found here: http://www.xmlprague.cz/preconf2014 http://lanyrd.com/2014/basex Conference tickets are still available. Spread the word! We are looking forward to meeting you in Prague, Christian

1 0

Paging takes time.
by Geet Gangwar 20 Jan '14

20 Jan '14

Hi, I have huge XML document containing around 70000000 child nodes. I want to implement paging on this, so that I can fetch a chunk of nodes at time, but as the start position value increases from 10000000 the execution time takes more than a second to execute, is there a any optimized way I can follow. I have written following code: public class XQJ { public static void main(String[] args) throws XQException { XQDataSource xqs = new BaseXXQDataSource(); xqs.setProperty("serverName", "localhost"); xqs.setProperty("port", "1984"); // Change USERNAME and PASSWORD values XQConnection conn = xqs.getConnection("admin", "admin"); XQPreparedExpression xqpe = conn.prepareExpression("declare namespace xbrli=' http://www.xbrl.org/2003/instance';" + " declare variable $doc as xs:string external;" + " declare variable $start as xs:integer external;" + " declare variable $pageSize as xs:integer external;" + " let $allMatches := doc($doc)/xbrli:xbrl/*" + " return subsequence($allMatches,$start,$pageSize)"); // " return $matches"); xqpe.bindString(new QName("doc"), "1389962424906/1389962424906/facts.xml", null); int totalRecords = 70000000; int pageSize = 10000; int noOfPages = totalRecords/pageSize; long startTime = 0; int start = 0; for(int i=0; i<noOfPages; i++){ startTime = System.currentTimeMillis(); start = i*pageSize; xqpe.bindInt(new QName("start"), start, null); xqpe.bindInt(new QName("pageSize"), pageSize, null); XQResultSequence rs = xqpe.executeQuery(); // while(rs.next()){} // System.out.println(rs.getItemAsString(null)); // System.out.println(start + " : " + (System.currentTimeMillis()-startTime)); } System.out.println(start + " : " + (System.currentTimeMillis()-startTime)); conn.close(); }

2 1

small bug in Basex
by Rob Stapper 20 Jan '14

20 Jan '14

Hi, While studying Leo's "Higher-Order XQuery Modules" I encountered a small bug in Basex. Probably a wrongly timed initialization of an internal locationpath-variable. If Basex starts with an editor-window active that contains a query with a doc-statement that contains a relative path, than when directly running this query triggers an error, see attachement: basex-error.txt. Leo's dijkstra-query also suffers from it. Regards, Rob Stapper PS. Leo's modules made me understand programming functional data structures in Basex. Thanx for that. --- Dit e-mailbericht bevat geen virussen en malware omdat avast! Antivirus-bescherming actief is. http://www.avast.com

2 1

RESTXQ & forward
by Marco Lettere 19 Jan '14

19 Jan '14

Hi all, I'm currently using a pattern where I POST to a rather generic restxq function that performs some pre-validation on the POST body. At that point, according to information I get from the request (path, headers) I call a subsequent more specific function through the <forward/> construct. It works nicely up to the access to the POST content which appears to be consumed defintely by the first function. Actually I get the following error at the called function: [BASX0003] Input could not be converted: "POST.xml" (Line 1): No input found. I don't see in the docs any way I can get forward to pass ahead the bost body and I thought it should be natural ... what am I missing? Regards, Marco Lettere. P.S. I'm using basex 7.7.

3 8

HTTP Module - digest authentication plans?
by Hans-Juergen Rennau 19 Jan '14

19 Jan '14

Dear BaseX team, are there any plans for supporting digest authentication? In my opinion this would be a minor breakthrough for the applicability of BaseX in typical enterprise environments (or at least in mine...), where many services require digest authentication. Support would mean that, for example, very lightweight BaseX scripting can be used for integration tasks and service testing. Another way to put it: highly valuable (and presently via XQuery inaccessible) information would be integrated into the information space on which to operate without further ado - just writing a BaseX script. Hence my strong interest. Kind regards, Hans-Jürgen

4 5

Detect Basex Query Type
by Alireza 17 Jan '14

17 Jan '14

Hi, We would like to detect if a basex query is read query or update query and then only allow read user queries to be executed. We receive a user query from an incoming request like this: http://host:port?query= "xquery" The goal is to check if "xquery" in the url above is a read or update query. We thought about checking the content of the query string and look for update operation keywords such |||||||||||| as insert, delete, etc. Is there any other better way to do that? Best, Alireza

2 1

Limitation on the number of accessed databases
by Fabrice Etanchaud 17 Jan '14

17 Jan '14

Dear all, Is there a limitation on the number of accessed databases via db :xxx functions ? Best regards, Fabrice Etanchaud Questel/Orbit

2 1

Re: [basex-talk] BaseX-Talk Digest, Vol 49, Issue 34
by iClays 17 Jan '14

17 Jan '14

I'm a software engineer who happens to use basex for our content management system. We current use the embedded basex option with Java. There is currently one apache tomcat server to one basex database. Now we are at position of using load balancing where we could have multiple tomcat servers talking to one basex database. Essentially, lets say we have 5 tomcat servers, we will have only one server writing to the only one basex database and the rest of the 4 tomcat servers reading from it. The problem is, after creating the 5 servers and configuring apache httpd server to have a load balancer, we notice a situation in which the first tomcat server opens the basex database and locks it from the rest of the servers access. Any attempt from tomcat server 2 to 4 to open the same database causes exception. How can we resolve this issue? Is there any simple approach to resolving this or BaseX is not designed for this purpose (i.e. one basex database being able to support multiple servers). Also is there a way of making the rest of the tomcat servers have only read access so it doesn't throw exception, etc? Please help.Thanks.

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk