- BaseX-Talk - mailman.uni-konstanz.de

language binding for common lisp
by Andy Chambers 26 Apr '10

26 Apr '10

Hey All, I've recently discovered basex and it seems to be a pretty cool project. Thanks for making it open source. Here's a common lisp language binding to add to the mix. I developed it on sbcl against basex version 6.1 by transcribing the python version. Thanks again, Andy ;;; file: example.lisp ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;; (defpackage :basex-user (:use :cl :basex)) (in-package :basex-user) (time (let ((session (make-instance 'session))) (if (execute session "xquery 1 to 10") (print (result session)) (print (info session))) (close-session session))) ;;; file: basex-client.lisp ;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;;; (defpackage :basex (:use :cl :usocket) (:export :session :execute :close-session :info :result)) (in-package :basex) (defconstant +null+ (code-char 0)) (defclass session () ((host :initarg :host :initform "localhost") (port :initarg :port :initform 1984) (user :initarg :user :initform "admin") (pw :initarg :pw :initform "admin") (sock :initform nil) (result :initform nil :accessor result) (info :initform nil :accessor info))) (defmethod initialize-instance :after ((self session) &key) (with-slots (host port user pw sock) self (setf sock (socket-connect host port :element-type '(unsigned-byte 8))) (unless (hand-shake self) (error "Could not initiate connection")))) (defun hand-shake (session) (declare (optimize debug)) (labels ((md5 (str) (string-downcase (with-output-to-string (s) (loop for hex across (sb-md5:md5sum-string str) do (format s "~2,'0x" hex))))) (auth-token (pw timestamp) (md5 (format nil "~a~a" (md5 pw) timestamp)))) (with-slots (user pw sock) session (let* ((ts (read-null-terminated (socket-stream sock))) (auth (auth-token pw ts))) (write-null-terminated user (socket-stream sock)) (write-null-terminated auth (socket-stream sock)) (force-output (socket-stream sock)) (eq 0 (read-byte (socket-stream sock))))))) (defun read-null-terminated (in) (with-output-to-string (s) (loop for char = (code-char (read-byte in)) until (char= char +null+) do (write-char char s)))) (defun write-null-terminated (string out) (loop for char across string do (write-byte (char-code char) out)) (write-byte (char-code +null+) out)) (defmethod execute ((self session) query) (with-slots (sock) self (let ((stream (socket-stream sock))) (write-null-terminated query stream) (force-output stream) (setf (result self) (read-null-terminated stream) (info self) (read-null-terminated stream)) (eq 0 (read-byte (socket-stream sock)))))) (defmethod open-session ((self session)) (unwind-protect (unless (hand-shake self) (error "Could not open session")) (close-session self))) (defmethod close-session ((self session)) (with-slots (sock) self (write-null-terminated "exit" (socket-stream sock)) (socket-close sock))) -- ---- Andy Chambers Formedix Ltd

2 2

google app engine
by Travis Webb 25 Apr '10

25 Apr '10

Has anyone on this list successfully installed BaseX onto the Google App Engine hosting platform? -tjw

1 0

data import
by Jason Durham 22 Apr '10

22 Apr '10

Is there a way to import data from an existing base such as MS Excel or Access?

2 1

BlueChillies.com - Software submitted
by BlueChillies.com 19 Apr '10

19 Apr '10

Thank you for your submission "BaseX" Please allow few days to review and publish your software. Best Regards, BlueChillies Team http://www.bluechillies.com/ © BlueChillies, 2000-2007

1 0

Software Submitted - BaseX 6.1
by SoftList 19 Apr '10

19 Apr '10

Dear DBIS Group, University of Konstanz, Thank you for your submission - "BaseX 6.1" to SoftList. Please allow a few days until we review and place it on our site. Sincerely, SoftList.Net http://www.softlist.net � 2000-2008, SoftList.Net

1 0

flat collections
by Imsieke, Gerrit, le-tex 19 Apr '10

19 Apr '10

Dear BaseX Team, We are looking at BaseX to serve as the fulltext query engine for a customer's content store. The customer is a publishing company. They have organized their content in a directory structure like /works/ work1/ src/ chap1.xml chap2.xml ... /work2/ src/ chap1.xml chap2.xml ... ... If I import all content into a database (which seems to map to, or even is synonymous to, a collection in BaseX lingo), there's no way to restrict queries to just one specific work. I thought that looking for something below //root()[matches(document-uri(.), '/work2')] might help, only to discover that a) all documents in this collection are flat, i.e., 'work1' or 'work2' isn't part of any root node's document-uri() and b) this kind of query seems to be very inefficient. In qizx, I create a what they call library group, import all documents below a certain local directory into that library group and then query it by, e.g., for $d in collection('/works/work2')//*[. ftcontains 'foo' ] return <result base-uri="{document-uri(root($d))}">{$d}</result> Not only that I'm not able to restrict a query to a certain subdirectory, I cannot create links to search results in BaseX. The publisher's content resides in an svn repository. Update of the XML search engine's data pool is being triggered by an svn commit hook. The user should get a URL like http://svn.acme.com/viewsvn/?do=view&project=works&path=/work2/src/chap2.xml as a query result, in order to be able to browse the content. (Until versioning becomes part of a client/server, XQFT-enabled XML database that can also store arbitrary non-XML files, they will probably continue to use svn as their content repository.) In BaseX, we cannot generate links to work2/src/chap2.xml since chap2.xml's document uri is lacking the path parts. I was thinking about putting each work in a collection of its own. But then I don't see how I could possibly perform a full text search of the whole content (all collections). And if each project contains a substructure work2/ trunk/ src/ chap1.xml chap2.xml ... tags/ ed04/ src/ chap1.xml chap2.xml then the number of collection to create or query still grows. Can you recommend a BaseX way of dealing with these requirements? Maybe inserting path information as a processing instruction into each XML file (this could be performed by a commit hook, too)? Inserting the paths as content or as an attribute might not be possible because some of the schemas -- ranging from custom DTDs to public XHTML or DocBook schemas -- might not be altered, or rather: patching the files to accomodate for an XML database seems acceptable, while altering the schemas or creating custom derived schemas from public ones seems unacceptable. Searching PIs may be inefficient however. Any other ideas? Best regards, Gerrit

2 1

Release BaseX 6.1
by Christian Grün 18 Apr '10

18 Apr '10

Dear all, once more, we are delighted to announce a new release of BaseX. Version 6.1 comes with the following improvements: - a new REST API, based on the JAX-RX Interface, to communicate with BaseX via HTTP. - new bindings to use BaseX from other programming languages. - support for all XSLT/XQuery serialization parameters. - advanced query optimizations to apply index structures whenever appropriate. - enhanced conformance with XQuery Update/Full Text Recommendations. BaseX is open source. It is developed by the DBIS Group at University of Konstanz. Please find more information at http://basex.org/ All the best, Christian Grün BaseX Team ___________________________ Christian Gruen Universitaet Konstanz Department of Computer & Information Science D-78457 Konstanz, Germany Tel: +49 (0)7531/88-4449, Fax: +49 (0)7531/88-3577 http://www.inf.uni-konstanz.de/~gruen

1 0

Using XML catalogs in BASE-X, right flow of actions for working with !DOCTYPE or !ENTITY declarations
by Jiří Kadlec 15 Apr '10

15 Apr '10

Hi all, Is it possible to use XML catalogs for getting documents referenced in DTD's with BASE-X database? My second question is about right procedure for dealing with DOCTYPE declaration. I'm using BASE-X for modifications in lot of different files. Some of them has DOCTYPE declaration defined and I would like to preserve this definition when I finish changes on the file. Its possible to use export functions with specified properties doctype-system, doctype-public, but is there any way how to get original doctype for me to be able to pass it as export property at the end or this must be specified by user who is modifying the file? I'm having the same issue with declarations of !ENTITY when i finish changes all entities are gone. Any help appreciated Jiri

2 1

how can I get java bindings in basex working?
by Sandra Maria Silcot 15 Apr '10

15 Apr '10

Fellow basex users, First, I can report that the recent optimisation enhancements have solved the performance issue I had reported -- thanks to the basex team. Basex most definitely rocks. Second, I am trying to implement a java binding as described here: http://www.inf.uni-konstanz.de/dbis/basex/xquery Thanks to the recent extra instruction added by the kindly basex developers, I have been able to use maven (2.2.1) on a ubuntu 64bit server to successfully compile basex from source. Excellent. But I am now wanting to do this in a basex xquery: declare namespace sim = "java:smstest.b4asims"; let $sim := sim:b4asims(xs:string("smith"), xs:string("smyth")) where this is a little jar I built around the simmetrics similarity library, like this: jar -cvf smstest.jar smstest/b4asims.class This successfully runs from the command line, under the same user the basex server runs under, like so (with the jar in my $CLASSPATH): BaseX 6.0.8 [Server] Server was started. fas@devfas: ~ $ java smstest.b4asims smith smythe ..str1=smith first=m Soundex score 0.9222222:smith:smythe Levenshtein score 0.6666666:smith:smythe JaroWinkler score 0.8577778:smith:smythe - total [smythe]=2.4466667 == score=2.4466667 bestScore=2.4466667 bestMatch=[smythe] #### bestScore=2.4466667 bestMatch=[smythe] I have tried every possible variation of the namespace definition and invoking the function in basex but it always says; [XPST0017] Unknown function "sim:b4asims(...)" In the pom.xml for basex I have added this: <groupId>smstest.b4asims</groupId> <artifactId>b4asims</artifactId> <scope>system</scope> <version>1.0</version> <systemPath>/media/disk2/fasrepo/common-bin/java/smstest.jar</systemPath> </dependency> and it compiles successfully, and I can then do a mvn 'package', and deploy the jar to my basex home dir, and run it but I simply cannot get the java bindings to work. I also tried alot of variations here, but to no avail. Clearly there is something really basic I am missing? I have tried the examples given on the basex documentation (the Math and file writer egs) and get exactly the same results -- Unknown function. All of my other java stuff on this box seems to work fine. I'm guessing that there is something in maven or eclipse which supplies the magic which I'm missing. I'm just using maven on the server, not eclipse. Any suggestions for a non-java developer would be most gratefully received. Best wishes to all, Sandra.

2 1

Next BaseX release
by Christian Grün 13 Apr '10

13 Apr '10

Dear all, BaseX 6.1 will be released this weekend. We regard our current source code base to be stable and well-tested. If you think that there are some serious issues to be fixed, please don't hesitate to give us feedback just in time. Next, we would be _very_ thankful if you could give us a short & quick summary (min. one line, max. one paragraph) on your project, company, both industrial and adademic. If we get enough feedback, we will extend basex.org by a reference page, possibly linking to your homepage. Thanks to everyone for supporting the project! Christian ___________________________ Christian Gruen Universitaet Konstanz Department of Computer & Information Science D-78457 Konstanz, Germany Tel: +49 (0)7531/88-4449, Fax: +49 (0)7531/88-3577 http://www.inf.uni-konstanz.de/~gruen

1 0