- BaseX-Talk - mailman.uni-konstanz.de

running http server and GUI at the same time safely?
by C. M. Sperberg-McQueen 03 Dec '15

03 Dec '15

On the page about transaction management [1], the wiki says: As the standalone versions of BaseX (command-line, GUI) cannot be synchronized with other BaseX instances, we generally recommend working with the client/server architecture if concurrent write operations are to be performed. Am I right to interpret this as meaning that I can work safely in the BaseX GUI interface while the http version (or a servlet version) of BaseX is running at the same time, if any of the following conditions are observed? 1 The GUI and the server or servlet have different settings for DBPATH. 2 They are working with different databases. 3 One or the other of the interfaces is only reading, not writing, the database. Apart from wishing to understand the situation in general terms, the practical question I'm currently wondering about is how to make it safe for myself to have a version of BaseX running in the background managing a local database or two through a Web interface, while still being able to pop in to the GUI from time to time to do some quick queries. I rarely want to use the GUI for the databases for which I have Web interfaces, so if it's necessary to use a separate DBPATH, I could probably live with that. But sometimes it's convenient, so if I can get by, relying on point 3, that would be excellent. -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

AUTOOPTIMIZE - was true now false
by James Ball 02 Dec '15

02 Dec '15

Hello, I’m trying out AUTOOPTIMIZE for the first time and I’m not getting what I expect. Running: BaseX 8.3 beta ec9b627 A new database is created with a single document which has TEXTINDEX, ATTRINDEX, UPDINDEX and AUTOOPTIMISE all set to true. This is what INFO DATABASE shows (as I expect): Indexes Up-to-date: true TEXTINDEX: true ATTRINDEX: true FTINDEX: false TEXTINCLUDE: ATTRINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: true AUTOOPTIMIZE: true MAXCATS: 100 MAXLEN: 96 Now I add a new document (or more than one) to the database. I expect that Up-to-date will still be true and that AUTOOPTIMIZE will still be true. But what I see is both are now false: Indexes Up-to-date: false TEXTINDEX: true ATTRINDEX: true FTINDEX: false TEXTINCLUDE: ATTRINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: true AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96 Perhaps this is the expected behaviour and I’ve misunderstood AUTOOPTIMIZE? Or is there a bug? Many thanks, James

3 4

Re: [basex-talk] Sizing BaseX Server
by Christophe Marchand 01 Dec '15

01 Dec '15

Ok, thanks a lot, Dirk. I had the same feeling, SSD, lot of RAM, big procs, etc... The problem I have is the server will be a virtual machine, and I have to give sizing infos to infra to let them provision VMs... Thanks again, Christophe Le 01/12/2015 15:06, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Re: Sizing BaseX Server (Dirk Kirsten) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 1 Dec 2015 15:06:03 +0100 > From: Dirk Kirsten <dk(a)basex.org> > To: Christophe Marchand <cmarchand(a)oxiane.com> > Cc: basex-talk(a)mailman.uni-konstanz.de > Subject: Re: [basex-talk] Sizing BaseX Server > Message-ID: <565DA94B.2090809(a)basex.org> > Content-Type: text/plain; charset="utf-8" > > Hello Christophe, > > that's easy: The more you got, the better it is ;) > > More serious: It is hard, if not impossible, to tell. This very much > depends on your use case and how you intend to use BaseX in your > process. As a traditional database and having lots of read/write access, > you are most likely I/O bound. However, you can also do complex > operations using XQuery, so you could be CPU bound. > > I find it almost always beneficial to use SSDs instead of traditional > HDDs, but again: If you never touch the disk at all, this wouldn't make > a difference (but it also decreases the BaseX startup time, which is nice). > > The use cases just differs to much for BaseX - you can use BaseX > embedded into your smartphone application or on a large zServer, so it > is really though to give a general advice. For a practicable approach I > would always recommend you run your application at some standard server > and take a look using Java profiling where BaseX is bound and then > increase the according component. > > Cheers > Dirk > > On 12/01/2015 01:51 PM, Christophe Marchand wrote: >> Hello, >> >> I'm looking at documentation about sizing a basex server computer. >> What's best : kind of processor, number of cores, RAM, disk-system, >> according to database size. >> >> Is there something in documentation on these subjects ? >> >> Best regards, >> Christophe >> >> >> -- >> >> >> Christophe MARCHAND >> >> Consultant Formateur >> cmarchand(a)oxiane.com <mailto:cmarchand@oxiane.com> >> LD : (+33)1 84 19 19 76 >> GSM : +33 (0)6 23 41 09 17 >> >> oxiane >> >> 98, avenue du G?n?ral Leclerc >> 92100 Boulogne-Billancourt >> Standard : (+33)1 55 60 76 72 >> Fax : (+33)1 55 60 76 73 >> www.oxiane.com <http://www.oxiane.com> >> >> >> Notre catalogue formations 2015 >> >> Notre catalogue formations 2015 >> <http://www.oxiane.com/wp-content/uploads/2014/12/Oxiane_Catalogue-Formation…> >>

2 1

Sizing BaseX Server
by Christophe Marchand 01 Dec '15

01 Dec '15

Hello, I'm looking at documentation about sizing a basex server computer. What's best : kind of processor, number of cores, RAM, disk-system, according to database size. Is there something in documentation on these subjects ? Best regards, Christophe -- Christophe MARCHAND Consultant Formateur cmarchand(a)oxiane.com <mailto:cmarchand@oxiane.com> LD : (+33)1 84 19 19 76 GSM : +33 (0)6 23 41 09 17 oxiane 98, avenue du Général Leclerc 92100 Boulogne-Billancourt Standard : (+33)1 55 60 76 72 Fax : (+33)1 55 60 76 73 www.oxiane.com <http://www.oxiane.com> Notre catalogue formations 2015 Notre catalogue formations 2015 <http://www.oxiane.com/wp-content/uploads/2014/12/Oxiane_Catalogue-Formation…>

2 1

XML Prague: Little Update
by Christian Grün 01 Dec '15

01 Dec '15

Hi all, We are currently assembling the talks for our XML Prague User Meeting. You will soon find more information on our Lanyrd conference page [1]. For example, it’s not settled yet if the meeting will take place in the morning or afternoon (afternoon would be our favorite). We are still looking for speakers; please let us know if you are interested! All the best, Christian [1] http://lanyrd.com/2016/basex/

1 0

Running BaseX under Tomcat on a commercial Java hosting provider
by C. M. Sperberg-McQueen 01 Dec '15

01 Dec '15

In case there are other users of XQuery who are looking for a way to get an XQuery engine on the Web but are not sure how to go about it, I have described my adventures setting up one approach (running BaseX 7.9 under Tomcat 6 on a commercial Java hosting provider) in a blog post today, hoping that it might enable someone else to do it with less trouble and confusion than I had: http://cmsmcq.com/mib/?p=1368 When time allows, I expect to upgrade my Tomcat to Tomcat 7 so that I can install a current BaseX; I'll update the post then with information for BaseX 8.*. if those who understand Java development and deployment better than I do (or wish to do) find errors in the exposition or simpler ways to get things set up, I would be glad to have them pointed out. I'd also be interested in speculations as to why setting the default user in web.xml seems not to have worked, but at this point I doubt that it's worth significant effort to solve that problem. -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

3 2

RESTXQ : existing annotation for response headers ?
by Etanchaud Fabrice 30 Nov '15

30 Nov '15

Dear all, When I want to set response headers (for example to force a "save as..."), I currently have to write a specific response before the response body : <rest:response> <http:response> <http:header name="Content-Type" value="text/comma-separated-values; charset=utf-8"/> <http:header name="Content-Disposition" value="attachment; filename={concat($base, '_Parthenay.csv')}"/> </http:response> </rest:response> Is there an annotation to set header values directly in the function declaration ? Best regards, Fabrice

3 3

Geo Module Not found
by E. Wray Johnson 27 Nov '15

27 Nov '15

I am getting the following error: [XQST0059] Module 'http://expath.org/ns/geo' not found. I used the Windows exe setup. What am I missing?

2 1

Location of users.xml
by Tom Rauchenwald 27 Nov '15

27 Nov '15

Hi, is it possible to override the expected location of users.xml? >From the wiki (http://docs.basex.org/wiki/User_Management) > The permission file has been moved from the home directory to the > database directory. It was renamed from .basexperm to users.xml We're using the war distribution, and would prefer to either specify the location of users.xml via a parameter or have it reside in the war. Is this currently possible? Thanks, -tom

2 2

db:create, namespaces not stripped when input is variable?
by Hondros, Constantine (ELS-AMS) 27 Nov '15

27 Nov '15

Hello all, Any particular reason behind this observed behaviour? (Basex 8.3). .............................................................. [1] .............................................................. declare variable $test := <test xmlns:ce="http://www.elsevier.com/xml/ani/common" xmlns="http://www.elsevier.com/xml/ani/ani"> <ce:initials>M.S.</ce:initials> </test>; db:create('test', $test, 'blah', map {'stripns':true()}) .............................................................. [2] .............................................................. db:open('test')/* .............................................................. [3] .............................................................. <test xmlns="http://www.elsevier.com/xml/ani/ani" xmlns:ce="http://www.elsevier.com/xml/ani/common"> <ce:initials>M.S.</ce:initials> </test> I would have expected the namespaces to be shredded ... Cheers, Constantine ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

3 2

Cant add raw files explicitly or text index ms office docs
by E. Wray Johnson 26 Nov '15

26 Nov '15

Here is what I want to do: For a given folder and all its subfolders on my physical dive, mirror its contents including the contents of archives, parsing xml, json,html, text, etc. using their respective parser skipping invalids, and adding all other files as raw. I want archive files (*.zip, *.doxc) to be added as raw, however I want the text inside archive files like docx (ms-word) to be indexed and any files in the archives files that match a filter to be indexed. Note: It would be nice if there was a single db:add method that allowed me to specify a map of filters to parsers with options, where all files that do not match a filter (or are invalid) will be optionally added as raw.

3 3

file:read-binary performance
by Jérôme Chauveau 25 Nov '15

25 Nov '15

Hi, My restxq app is very slow to deliver raw files (css, images, js). For example, the restxq method takes around 600ms to load a png file in my browser when it takes only 2ms in a "direct" or "static" way. --------------------------------------- declare %rest:path("/editions/static/{$project}/{$file=.+}") function max.file:file( $project as xs:string, $file as xs:string ) as item()+ { let $path := file:parent(file:base-dir()) || 'editions/' || $project || '/ui/' || $file return ( web:response-header(map { 'media-type': web:content-type($path) }), file:read-binary($path) ) }; --------------------------------------- Why such a difference? How can I improve it? I am using BaseX 8.3 (war version). Regards, Jérôme -- Jérôme Chauveau - CERTIC-DSI - Campus I Université de Caen Normandie

2 2

Assigning incrementing number to 100ks of elements
by Chuck Bearden 24 Nov '15

24 Nov '15

BaseX 8.3.1, installed on Linux today from zip archive. I have about 137,000 target elements, each having an average of 550 descendant elements, and each taking about 45k of space on disk. The target elements each have an @uuid value, and I'd like to extract each @uuid value and assign it a unique number from an incrementing sequence of integers. I'd like to be able to start the sequence at an arbitrary value. I tried a recursive function I borrowed and modified from a StackOverflow post: declare function local:loop($seq, $count) { if(empty($seq)) then () else let $prod := $seq[1], $count := $count + 1 return ( <result> <id>{$count}</id> <uuid>{data($prod)}</uuid> </result>, local:loop(tail($seq), $count) ) }; and calling it like so: return <results>{ local:loop($pubs, 0) }</results> where $prod is a sequence of all the @uuid attributes (not the values, and not the whole elements). My query fails with the error: [bxerr:BASX0005] Stack Overflow: Try tail recursion? I'm using -Xmx6g and -Xss4m as flags for Java in the basexgui script. Is there some way to get BaseX to use tail recursion? Or is there another approach to doing what I want? Many thanks, Chuck

2 1

issue with stack trace in query-info window
by Rob Stapper 24 Nov '15

24 Nov '15

Hi Christian, I found that in case of a runtime error the links in the stack trace in the Query info window to the different locations in the program don't work anymore. I use of course the latest snapshot: BaseX 8.4 beta 3b6f6e0 Regards, Rob --- Dit e-mailbericht is gecontroleerd op virussen met Avast antivirussoftware. https://www.avast.com/antivirus

2 1

basex performance for high request number
by Filippo Gaudenzi 23 Nov '15

23 Nov '15

Hi all, I’m running some scripts to solve a NP-problem in order to check trees compatibility and i’m using Basex as a database for my hierarchy structure, indeed for each path/each node i run a query on the basexserver. This brings to have for a tree with 7 paths a 7! permutations and therefore at least 7!*4=21.000 queries (the query below) in a lapse of 5minutes. If i use the db in my localhost environment i see that basexserver goes over 150% of cpu usage. I was wondering how to increase the performance without causing the server crash. basex is running on a 2,6 GHz Intel Core i5 with 16gb of Ram, OS X 10.10.5 basex version is 8.2 Here the code i use: public class BaseXOntologyManager{ private final int PORT; private final String PASSWORD; private final String USERNAME; private final String ADDRESS; private final String DBNAME; /** * Constructor of the Basex ontology Manager * @param address The address of the DB * @param port The port to use to connect to the DB * @param username The username to use to connect to the DB * @param password The password to use to connect to the DB * @param dbName The db Name */ public BaseXOntologyManager(String address, int port, String username, String password, String dbName){//,boolean connected) { this.ADDRESS = address; this.PORT = port; this.USERNAME = username; this.PASSWORD = password; this.DBNAME = dbName; } private BaseXClient getOpenConnection() { try { BaseXClient session = new BaseXClient(this.ADDRESS, this.PORT, this.USERNAME, this.PASSWORD); return session; } catch (IOException e) { return null; } } /** * Return the subClasses of the element based on the ontology in the DB, * if the direct is true returns only the parents otherwise also the descendants * @param keyName The name of the Ontology to use * @param element the element to search in the param * @param direct true if you want only the parents * @return A list of subClasses of the ontology * @throws Exception when element doesn't belong to Ontology */ public ArrayList<String> getSubClasses(String keyName, String element, boolean direct) throws Exception { BaseXClient client = this.getOpenConnection(); if (client != null) { if(!checkExistence(element)) throw new Exception("notFound"+element); ArrayList<String> result = new ArrayList<String>(); String input = null; if (direct == true) { input = "for $n in db:open('" + this.DBNAME +"', '/" + keyName + "')//*[parent::" + element + "] return $n/name()"; } else { input = "for $n in db:open('" + this.DBNAME +"', '/" + keyName + "')//*[ancestor::" + element + "] return $n/name()"; } try { final BaseXClient.Query query = client.query(input); while (query.more()) { result.add(query.next()); } query.close(); result.add(element); return result; } catch (IOException e) { return null; } finally { try { client.close(); } catch (Exception e) { // TODO Auto-generated catch block e.printStackTrace(); } } }else{ System.out.println("CLIENT NULL"); } return null; } Thanks, Filippo

2 2

issue with the latest snapshot
by Rob Stapper 23 Nov '15

23 Nov '15

Gute Morgen, After installing the latest Basex snaphot (8.4) this morning, the new version couldn't resolved function calls to function that are located in imported modules while compiling. I get an error messages: "Unknown function '...'; similar: '...' ." After installing the previous version (8.3) everything worked fine again. I'm using windows 7 and basex is installed on my L:-drive. Hope this is enough information. Rob Stapper --- Dit e-mailbericht is gecontroleerd op virussen met Avast antivirussoftware. https://www.avast.com/antivirus

2 12

Curious "Stack Overflow: Try tail recursion?" error message
by Andy Bunce 20 Nov '15

20 Nov '15

Hi, Using a fresh install on 8.3.1 and running basexgui.bat on windows. I install this expath package https://github.com/expkg-zone58/ex-xparse/releases/download/v0.0.5/ex-xpars… Then, paste the following code into an editor window.. ------------------------ import module namespace xp="http://expath.org/ns/xparse"; "http://www.xqueryfunctions.com/xq/functx-1.0-doc-2007-01.xq" !unparsed-text(.) !xp:parse(.,map{"lang":"xquery"}) ----------------------- The result is the error... Stack Overflow: Try tail recursion? The curious part is.. if I keep retrying by clicking the execute button - after around 10 tries it starts working and seems to continue to work every time after that within that GUI instance. I have reproduced this on another pc. /Andy

2 2

Re: [basex-talk] Counting Occurences
by Christian Grün 20 Nov '15

20 Nov '15

Hi Ana (cc to the list), > I've tried using the "group by" clause, however, it only returns to me the > list of the present provinces, without the frequence, or, if I use the > "count" function, in only returns 1 (Since every curriculum on the > collection only contains a single occurence the province) Did you combine group by and count (as shown in the Wiki)? How does your current query look like? Christian > > Do you have any idea of how could I list the frequence of each province? > > Thank you for your help. > > 2015-11-20 15:17 GMT-02:00 Christian Grün <christian.gruen(a)gmail.com>: >> >> Hi Ana, >> >> The "group by" clause will help you here [1]. Hope this helps; feel >> free to ask if you need more examples. >> >> Christian >> >> [1] http://docs.basex.org/wiki/XQuery_3.0#group_by >> >> >> On Fri, Nov 20, 2015 at 6:06 PM, Ana Victória Ladeira >> <ladeira.ana(a)gmail.com> wrote: >> > Good afternoon! >> > >> > I have a collection of XML files in which all files contain the >> > attribute >> > //ENDERECO-PROFISISONAL/@UF >> > >> > In which UF is the province in which the person to whom the file makes >> > reference to lives. >> > >> > I want to develop a query that returns to me the number of occurences of >> > each province in the collection. I've tried using count and >> > distinct-values, >> > but it always return the value "1" for me. >> > >> > The query I'm trying to use is the following: >> > for $x in >> > >> > collection('Teste500')/CURRICULO-VITAE/DADOS-GERAIS/ENDERECO/ENDERECO-PROFISSIONAL >> > let $y := count(distinct-values($x/@UF)) >> > return $y >> > >> > The desired result would be, in a collection of documents in which 5 >> > people >> > live in SP, 3 in DF and 9 in AM would be the following: >> > >> > SP: 5 >> > DF: 3 >> > AM:9 >> > >> > Can somebody please help me with that? I'm still struggling with xQuery. >> > >> > > >

2 1

Counting Occurences
by Ana Victória Ladeira 20 Nov '15

20 Nov '15

Good afternoon! I have a collection of XML files in which all files contain the attribute //ENDERECO-PROFISISONAL/@UF In which UF is the province in which the person to whom the file makes reference to lives. I want to develop a query that returns to me the number of occurences of each province in the collection. I've tried using count and distinct-values, but it always return the value "1" for me. The query I'm trying to use is the following: for $x in collection('Teste500')/CURRICULO-VITAE/DADOS-GERAIS/ENDERECO/ENDERECO-PROFISSIONAL let $y := count(distinct-values($x/@UF)) return $y The desired result would be, in a collection of documents in which 5 people live in SP, 3 in DF and 9 in AM would be the following: SP: 5 DF: 3 AM:9 Can somebody please help me with that? I'm still struggling with xQuery.

2 1

Applicative Cache
by Marco Lettere 20 Nov '15

20 Nov '15

Hi all, I went though the emails talking about mainmemory databases and related but I've not been able to find an answer to this loud thinking ... Would it be possible to create an in memory database with a RESTXQ call and keep it accessible for other RESTXQ invocations as if it was a disk db throughout the lifecycle of a basexhttp server? Application level cacheing of (possibly distributed) dbs or management of transient volatile data items like tokens are the scenarios I have in mind. Just wondering whether this makes any sense. Whether it's feasible or whether someone already did this with other means. Thanks a lot! Marco.

3 6

Bash command
by meumapple 19 Nov '15

19 Nov '15

Hi all, I am using proc:system for a bash command but I cannot run it. It looks like opennlp postagger model.bin < file.txt. I suspect that the problem is the less-than sign, which is converted into < Is there any way to keep the less-than sign and pass it to the bash properly? Thanks. Joseph

4 8

How to improve performance of join query
by Chuck Bearden 18 Nov '15

18 Nov '15

Hi all, I'm joining elements from two sets of documents in a single database. There are many elements (six figures) in each set. The query doesn't finish after several minutes. My suspicion is that the indices aren't being used, except to limit the fingerprint 'content' elements to those with "Person" as the value of 'contentFamily'. Perhaps my data and query demand some form of optimization that hasn't been implemented yet, but perhaps there is something I could do to fix the query. I'm using BaseX 8.3.0. The query: ------------------------- xquery version "3.0"; declare namespace fingerprint="http://atira.dk/schemas/pure4/wsdl/template/fingerprint/current"; declare namespace concept="http://atira.dk/schemas/pure4/wsdl/template/concept/current"; declare namespace core="http://atira.dk/schemas/pure4/model/core/current"; declare namespace xsi="http://www.w3.org/2001/XMLSchema-instance"; declare namespace fincur="http://atira.dk/schemas/pure4/model/template/fingerprint/current"; declare namespace concur="http://atira.dk/schemas/pure4/model/template/concept/current"; declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:method "csv"; declare option output:csv "header=yes, separator=comma"; let $coll := collection('pure_20151109') let $concept_contents := $coll/concept:GetConceptResponse/core:result/core:content let $fingerprint_contents := $coll/fingerprint:GetFingerprintResponse/core:result/core:content for $fin_con in $fingerprint_contents[fincur:contentFamily/text()="Person"] /fincur:rankedConcepts/fincur:rankedConcept let $concept_uuid := $fin_con/fincur:conceptUuid let $rank := $fin_con/fincur:rank let $weighted_rank := $fin_con/fincur:weightedRank let $person_uuid := $fin_con/ancestor::core:content[1]/@uuid let $concept_name := $concept_contents[@uuid=$concept_uuid]/concur:name/core:localizedString return <csv> <record> <person_uuid>{data($person_uuid)}</person_uuid> <concept_uuid>{$concept_uuid/text()}</concept_uuid> <rank>{$rank/text()}</rank> <weighted_rank>{$weighted_rank/text()}</weighted_rank> <concept_name>{$concept_name/text()}</concept_name> </record> </csv> ------------------------- The query info from the query, which I stopped after 3 minutes: ------------------------- Error: Interrupted. Compiling: - pre-evaluating collection("pure_20151109") - inlining $coll_0 - inlining $fingerprint_contents_2 - applying text index for "Person" - inlining $rank_5 - inlining $weighted_rank_6 - inlining $person_uuid_7 - inlining $concept_name_8 Query: xquery version "3.0"; declare namespace fingerprint="http://atira.dk/schemas/pure4/wsdl/template/fingerprint/current"; declare namespace concept="http://atira.dk/schemas/pure4/wsdl/template/concept/current"; declare namespace core="http://atira.dk/schemas/pure4/model/core/current"; declare namespace xsi="http://www.w3.org/2001/XMLSchema-instance"; declare namespace fincur="http://atira.dk/schemas/pure4/model/template/fingerprint/current"; declare namespace concur="http://atira.dk/schemas/pure4/model/template/concept/current"; declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:method "csv"; declare option output:csv "header=yes, separator=comma"; let $coll := collection('pure_20151109') let $concept_contents := $coll/concept:GetConceptResponse/core:result/core:content let $fingerprint_contents := $coll/fingerprint:GetFingerprintResponse/core:result/core:content for $fin_con in $fingerprint_contents[fincur:contentFamily/text()="Person"] /fincur:rankedConcepts/fincur:rankedConcept let $concept_uuid := $fin_con/fincur:conceptUuid let $rank := $fin_con/fincur:rank let $weighted_rank := $fin_con/fincur:weightedRank let $person_uuid := $fin_con/ancestor::core:content[1]/@uuid let $concept_name := $concept_contents[@uuid=$concept_uuid]/concur:name/core:localizedString return <csv> <record> <person_uuid>{data($person_uuid)}</person_uuid> <concept_uuid>{$concept_uuid/text()}</concept_uuid> <rank>{$rank/text()}</rank> <weighted_rank>{$weighted_rank/text()}</weighted_rank> <concept_name>{$concept_name/text()}</concept_name> </record> </csv> Optimized Query: let $concept_contents_1 := (db:open-pre("pure_20151109",0), ...)/concept:GetConceptResponse/core:result/core:content for $fin_con_3 in db:text("pure_20151109", "Person")/parent::fincur:contentFamily/parent::core:content[parent::core:result/parent::fingerprint:GetFingerprintResponse/parent::document-node()]/fincur:rankedConcepts/fincur:rankedConcept let $concept_uuid_4 := $fin_con_3/fincur:conceptUuid return element csv { (element record { (element person_uuid { (data($fin_con_3/ancestor::core:content[position() = 1]/@uuid)) }, element concept_uuid { ($concept_uuid_4/text()) }, element rank { ($fin_con_3/fincur:rank/text()) }, element weighted_rank { ($fin_con_3/fincur:weightedRank/text()) }, element concept_name { (($concept_contents_1)[(@uuid = $concept_uuid_4)]/concur:name/core:localizedString/text()) }) }) } Query plan: <QueryPlan compiled="true"> <GFLWOR> <Let> <Var name="$concept_contents" id="1"/> <IterPath> <DBNodeSeq size="51261"> <DBNode name="pure_20151109" pre="0"/> <DBNode name="pure_20151109" pre="1603"/> <DBNode name="pure_20151109" pre="2781"/> <DBNode name="pure_20151109" pre="5227"/> <DBNode name="pure_20151109" pre="7212"/> </DBNodeSeq> <IterStep axis="child" test="concept:GetConceptResponse"/> <IterStep axis="child" test="core:result"/> <IterStep axis="child" test="core:content"/> </IterPath> </Let> <For> <Var name="$fin_con" id="3"/> <CachedPath> <ValueAccess data="pure_20151109" type="TEXT"> <Str value="Person" type="xs:string"/> </ValueAccess> <IterStep axis="parent" test="fincur:contentFamily"/> <IterStep axis="parent" test="core:content"> <CachedPath> <IterStep axis="parent" test="core:result"/> <IterStep axis="parent" test="fingerprint:GetFingerprintResponse"/> <IterStep axis="parent" test="document-node()"/> </CachedPath> </IterStep> <IterStep axis="child" test="fincur:rankedConcepts"/> <IterStep axis="child" test="fincur:rankedConcept"/> </CachedPath> </For> <Let> <Var name="$concept_uuid" id="4"/> <IterPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterStep axis="child" test="fincur:conceptUuid"/> </IterPath> </Let> <CElem> <QNm value="csv" type="xs:QName"/> <CElem> <QNm value="record" type="xs:QName"/> <CElem> <QNm value="person_uuid" type="xs:QName"/> <FnData name="data([items])"> <CachedPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterPosStep axis="ancestor" test="core:content"> <Pos min="1" max="1"/> </IterPosStep> <IterStep axis="attribute" test="uuid"/> </CachedPath> </FnData> </CElem> <CElem> <QNm value="concept_uuid" type="xs:QName"/> <CachedPath> <VarRef> <Var name="$concept_uuid" id="4"/> </VarRef> <IterStep axis="child" test="text()"/> </CachedPath> </CElem> <CElem> <QNm value="rank" type="xs:QName"/> <IterPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterStep axis="child" test="fincur:rank"/> <IterStep axis="child" test="text()"/> </IterPath> </CElem> <CElem> <QNm value="weighted_rank" type="xs:QName"/> <IterPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterStep axis="child" test="fincur:weightedRank"/> <IterStep axis="child" test="text()"/> </IterPath> </CElem> <CElem> <QNm value="concept_name" type="xs:QName"/> <CachedPath> <IterFilter> <VarRef> <Var name="$concept_contents" id="1"/> </VarRef> <CmpG op="="> <CachedPath> <IterStep axis="attribute" test="uuid"/> </CachedPath> <VarRef> <Var name="$concept_uuid" id="4"/> </VarRef> </CmpG> </IterFilter> <IterStep axis="child" test="concur:name"/> <IterStep axis="child" test="core:localizedString"/> <IterStep axis="child" test="text()"/> </CachedPath> </CElem> </CElem> </CElem> </GFLWOR> </QueryPlan> ------------------------- Thanks in advance for any advice! Chuck

2 2

BaseX request from Saxon XSL transformation
by cmarchand＠oxiane.com 18 Nov '15

18 Nov '15

Hello, I have to query a BaseX database from a XSL transformation. Does someone has ever done this ? I have no idea where to look in... I use SaxonEE, so I can write an extension function, if needed... Best regards, Christophe

3 3

Upcoming: XMLPrague 2016
by Christian Grün 18 Nov '15

18 Nov '15

Dear all, In around three months, it will be the 5th time that we'd like to organize user meeting in Prague. This time, the XML Prague conference takes place from Thursday to Saturday, Feb 11-13, and our meeting will be onThursday. As you all do so many exciting things with BaseX, we would be more than interested to have some of you as speakers! We are very thankful to those of you who have already talked on one of our previous meetings; it has been your contributions that made the past event so awesome! Please don't hesitate and tell us if you are interested in presenting your work to the members of the community. If you have presented before, you are of course invited as well. More to come, Christian

1 0

zip:update-entries - unexpected results
by Hondros, Constantine (ELS-AMS) 18 Nov '15

18 Nov '15

Hi all, I'm attempting to create a modified copy a zipfile using zip:update-entries, but my output is a zip structure with zero-byte files. Am I missing a step? I've followed the example in: http://docs.basex.org/wiki/ZIP_Module#zip:update-entries Code snippet as follows: declare function util:clean-zip($zip as xs:string, $out as xs:string) { copy $doc := zip:entries($zip) modify delete node $doc//zip:entry[ends-with(lower-case(@name), '.pdf')] return zip:update-entries($doc, $out) }; Thanks for any pointers ;-) C. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk