- BaseX-Talk - mailman.uni-konstanz.de

Embedding BaseX in Clojure web app, pointers needed
by Marc van Grootel 19 Jan '16

19 Jan '16

Hi, I'm considering to write a web layer for BaseX based in Clojure. It may be a somewhat longer term project but I would like to bring XML and BaseX closer to Clojure programming. Clojure web apps usually are able to run under various servers/containers (Jetty/Netty etc.) and I would like to be able to use Clojure libraries to handle things like request routing, security and authentication outside of BaseX/XQuery. Some questions that I have while I'm orienting myself. Some of it touches on integration areas that are quite new to me so I am happy to get some general pointers that I can use to dig further. For Clojure I found only one BaseX client library [1] which wraps the standard Java TCP client and it seems to work fine. But I have some broader questions such as - Choosing between using the client or much more intimately embedding BaseX as a library. The latter is probably much more complex but I'm figuring this is the only way to get a good integration as the TCP client is rather limited in functionality. But where to start? What layers of the existing servlet integration to peel off, which ones to keep. Is BaseXServer.java a good starting point? - Is the TCP client generally slower than via the Java API? A couple of queries via clj-basex didn't impress me much qua speed (compared to same query via the GUI). Any starting points or general considerations that could help me prune the (re)search tree are very much appreciated. --Marc [1] https://github.com/kouphax/clj-basex

2 2

Streaming file loads
by Christophe Marchand 19 Jan '16

19 Jan '16

Hello ! We have to load many files (>20.000), large size (>30Gb) into BaseX. Today, that's done vis a BXS script which accesses files thru a network share. I would like to optimize network transfert ; tar / compression at source, uncompress / untar at destination. But I would like to avoid to create temporary files (at source, on NAS server, and on destination server, BaseX host). So, is there an API which I could use to load a "file" thru a stream ? I think I can write an inputstream that redirects data to outpustreams, cutting input data in many output streams, one per file. But may I chain this outputstream to an inputstream usable by BaseX loader ? Best regards, Christophe

2 1

Wiki Edits
by Christian Grün 18 Jan '16

18 Jan '16

In-between: Thanks to James, Jens, Arve, Constantine, Marco, Amanda, Patrick, Alex, ... for your edits in our Wiki! You alle are helping to make it a more and more comprehensive source for everyone working with BaseX.

2 1

Any (hopefully representative) reference korpora of XML-ish documents?
by Albretch Mueller 16 Jan '16

16 Jan '16

OASIS keeps an a interoperability corpus of ODF test documents https://www.oasis-open.org/committees/oic/charter.php Do you use of know of any large XML/-ish reference korpora which could be used for testing purposes? In case, you don't could you suggest where or how could one find such a thing? lbrtchx basex-talk@mailman.uni-konstanz.de:Any (hopefully representative) reference korpora of XML-ish documents?

2 1

ft:search and using thesaurus
by Günter Dunz-Wolff 16 Jan '16

16 Jan '16

Hi all, hi Christian, for a flexible search I want to use this programatic approach: let $ft := map { 'wildcards': true() } let $terms := 'Pa.*' for $city in ft:search('factbook', $terms, $ft)/parent::name[ancestor::city] let $hits := ft:mark($city[ft:contains(text(), $terms, $ft)]) return let $name := $city/ancestor::country/name return ($hits, $name) How could I integrate 'using thesaurus at "thesaurus.xml"', unfortunately thesaurus is not part of the $options argument of ft:search. Cheers, Günter

2 1

Security
by Finney, Tim 15 Jan '16

15 Jan '16

Hi Everyone, Sorry if this is a dumb question. What is a good way to do security in BaseX? I found a stub here: http://docs.basex.org/wiki/Security:_Use_Cases What I would like is to be able to restrict who can do what with a database. Here are a few things I'd like to be able to do: 1. Grant create, read, update, and delete permissions on each document in a database, and have a default mask for a database document. 2. Say whether a user can or cannot execute a function or visit a URL (and get something besides a 404). 3. Allow the creation of roles which can be assigned to users. (Having a particular role allows all users with that role to do particular things, like update docs, or visit particular URLs.) 4. No doubt there are more desiderata. E.g. one might conceivably want to be able to grant permissions at the node level within a document. Any pointers? Best, Tim Finney

2 1

XQERY Help
by Mansi Sheth 14 Jan '16

14 Jan '16

Hello, I need help with hopefully a simple XQUERY. I want to extend below XQUERY to run not on all documents in all databases, but only on those documents which contains "input string X" in its db:path (i.e. its original file name). Any help appreciated. declare variable $n as xs:string external; (: command line query, to be entered as "n" variable :) declare option output:item-separator "
"; (: Each element would be in new line :) (: Run input query, on every XML document in every Database:) let $queryData := for $db in db:list() (: Assign dynamic variables to generate query, to be used in eval :) let $query := "declare variable $db external; " || "db:open($db)" || $n return xquery:eval($query,map { 'db': $db, 'query': $n }) return distinct-values($queryData) - Mansi

2 1

How to get the complete list of full-text-index
by kleist 13 Jan '16

13 Jan '16

Hi all, hi Christian is there any way to get the complete list of the full-text-index? With the GUI I only get the first part: - Names: - Size: 5 MB - Entries: 23401 und 22662x der 20595x .... Thanks in advance. Best regards, Günter

3 6

BaseX 8.4 beta contains with collation
by Andy Bunce 13 Jan '16

13 Jan '16

Hi, Query: contains("aaa","ab", ' http://www.w3.org/2005/xpath-functions/collation/html-ascii-case-insensitive ') Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.4 beta 1814d39 Java: Oracle Corporation, 1.8.0_45 OS: Windows 8.1, amd64 Stack Trace: java.lang.StringIndexOutOfBoundsException: String index out of range: 3 at java.lang.String.charAt(Unknown Source) at org.basex.query.util.collation.NoCaseCollation.indexOf(NoCaseCollation.java:35) at org.basex.query.util.collation.Collation.contains(Collation.java:123) at org.basex.query.func.fn.FnContains.item(FnContains.java:20) at org.basex.query.func.StandardFunc.optimize(StandardFunc.java:83) at org.basex.query.func.StandardFunc.compile(StandardFunc.java:76) at org.basex.query.MainModule.compile(MainModule.java:74) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:113) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:104) at org.basex.query.QueryContext.analyze(QueryContext.java:332) at org.basex.query.QueryContext.compile(QueryContext.java:318) at org.basex.query.QueryProcessor.compile(QueryProcessor.java:70) at org.basex.core.cmd.AQuery.query(AQuery.java:76) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.gui.GUI.exec(GUI.java:469) at org.basex.gui.GUI.access$4(GUI.java:422) at org.basex.gui.GUI$7.run(GUI.java:411)

2 1

Fulltext-Search: wildcards and thesaurus
by kleist 13 Jan '16

13 Jan '16

Hi all, hi Christian, is it possible to combine wildcards and thesaurus in a fulltext-search, for example: contains text "nachricht.*" using wildcards using thesaurus at "thesaurus.xml" Best regards, Günter

3 2