BaseX-Talk

basex-talk@mailman.uni-konstanz.de

13 participants
5244 discussions

Start a nNew thread

Radiant like a star
by mltailor.com 04 Jul '12

04 Jul '12

1 0

FW: Empty Initial Document Inconsistencies
by Fabrice Etanchaud 03 Jul '12

03 Jul '12

Dear all at BaseX, Dear Christian, Does that mean that current databases will not work anymore with the next releases ? Best regards, Fabrice -----Original Message----- From: Christian Grün [mailto:christian.gruen@gmail.com] Sent: mardi 3 juillet 2012 02:13 To: Dave Glick Cc: BaseX Subject: Re: [basex-talk] Empty Initial Document Inconsistencies Hi Dave, here's finally some public feedback for your outstanding feature request: I've rewritten our internal database structures, such that an empty database will now really be empty (i.e., contain no dummy document node anymore). As a result, some convenience methods have disappeared from the Data class (Data.isEmpty(), Data.single()), as they were only offered to hide the former inconsistency. The changes have now been merged into the BaseX master branch. While I believe that we have tested the changes quite well, I am always glad for any feedback. Christian ___________________________ On Thu, Dec 29, 2011 at 4:36 PM, Dave Glick <dglick(a)dracorp.com> wrote: > Hello again, > > I've noticed some inconsistencies with regard to the initial document in an empty database. I understand that it is often treated as an indication that the database is "empty". I.e., if the database has only one node and it's a document at the first pre value, then Data.empty() returns true. The problem arises because the database isn't actually empty - it contains one empty document - and some commands/methods view it as an empty database while others treat it as a database with one empty document. Several examples: > > - The method Data.doc(name) will return -1 (indicating the document doesn't exist) while Data.docs() will return an array of size 1 with the first value a 0 (indicating there is one document at pre value 0). This is actually my own problem because the API I'm writing relies on these two methods being internally consistent - I can't have one telling me there is one document called "XYZ" but then have the other refuse to give me a pre value for the "XYZ" document I was just told exists. > - The GUI shows a single doc node in the tree view but issuing the command "list [database name]" shows the database as having no resources. > - I can evaluate the query "insert node 'text' into doc('[initial document name]')" and it executes. I can see the new text node under the initial document in the GUI tree view. Now when I issue the command "list [database name]" I see 1 resource. Having the list command report different numbers of resources before and after a XQuery insertion seems odd. > - If I issue the command "ADD TO newdoc <xyz/>", I can see the new doc("newdoc") node with the child <xyz> element in the GUI but the previously empty document is now gone. This also seems odd - I'm not sure how I feel about an ADD command removing data from the database (even if it was just intended to be a placeholder). > > In the end, I think BaseX should support the notion of a database with one empty document as being valid - there are probably cases where one might want to start their session in that state. I'm not sure what the solution is or should be (or if it's even something that is worth or needs solving). My own preference would be for the internal indication of an empty database to use a different node kind dedicated for that purpose so there is no confusion whether the single node at pre 0 is an empty initial document or an indication of an empty database. > > At the very least, I think the inconsistencies above should be corrected - if a single empty document node is intended to signify an empty database and is not actually intended to be part of the database, then you should not see it in the GUI, not be allowed to insert content to it, etc. > > Dave > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 1

REST service problems - 401-Header sent‏
by MyNew EMail 02 Jul '12

02 Jul '12

Hi again, > What do you exactly mean with "long XQuery request"? Could you provide > us with an example that demonstrates the problem (I didn't manage to > track it down locally)?I'm using PHP with cURL to call the REST service (with standard username and password [admin, admin] for testing). Furthermore I'm using the BaseX HTTP Server (basexhttp.bat).Here is some code summary (first example works well): <?php//... $query = 'let $x := <abc> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> </abc> return insert node $x as last into //test'; $fullQuery = '<query xmlns="http://basex.org/rest">'; $fullQuery .= '<text><![CDATA[ '.$query.']]></text>'; $fullQuery .= '</query>';//...//set authorization stuff//set Content-Type header to application/xml and send a POST request to http://localhost:8984/rest/MyDb/test.xml with $fullQuery in body.//This works. Example XML will be inserted.?> But if the XML part (let $x := ...) or the XQuery part is longer I get this response (and I'm authorized the same way as in the first example): HTTP/1.1 401 Unauthorized WWW-Authenticate: BasicContent-Length: 31 Server: Jetty(6.1.26) This example does'nt work:<?php $query = 'let $x := <abc> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <aaa>Test</aaa> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> <bb test="123"><a>test</a></bb> </abc> return insert node $x as last into //test'; $fullQuery = '<query xmlns="http://basex.org/rest">'; $fullQuery .= '<text><![CDATA[ '.$query.']]></text>'; $fullQuery .= '</query>'; //...?> Removing whitespaces makes it possible to send a request which is a bit longer, but not very much. Is there a solution to send requests like this, maybe in a different way? It is important to make bigger updates on my XML data with REST. Greetings @all

2 1

Sending DELETE request through HTTP Module
by Seenivasan Gunabalan 02 Jul '12

02 Jul '12

hi, My objective is to delete the collections/files through the DELETE request using HTTP module. The DELETE operation does fine, when I ran it from BasexGUI. But if i put the same query inside delete.xq and invoke it by http://localhost:8984/rest?run=delete.xq, The request never returns any response and possibly got hanged. I need to restart the database to make the database to function. I am enclosing the xq i used, import module namespace http='http://expath.org/ns/http-client'; declare function local:cleanlist() { ('sample/record1','sample/record2','sample/record3') }; declare function local:cleandb() { try { for $cl in local:cleanlist() return http:send-request(<http:request method="DELETE" href="http://localhost:8984/rest/{$cl}" status-only = "true" username = "admin" password = "admin" send-authorization="true"> </http:request>) } catch err { err:description } }; <cleandb>{ local:cleandb() }</cleandb>

2 1

normalize-unicode function
by Toshio HIRAI 02 Jul '12

02 Jul '12

Hi, I tried some Japanese letters in fn:normalize-unicode. FULLWIDTH DIGIT, FULLWIDTH LATIN CAPITAL LETTER: fn:normalize-unicode("１２３４５６７８９０ａｂｃｄｅｆｇ", "NFKC") returns 1234567890abcdefg FULLWIDTH EXCLAMATION MARK: fn:normalize-unicode("！", "NFKC") returns ! FULLWIDTH LESS-THAN SIGN, ?FULLWIDTH GREATER-THAN SIGN: fn:normalize-unicode("＜＞", "NFKC") returns <> FULLWIDTH AMPERSAND; fn:normalize-unicode("＆", "NFKC") returns?& These are normal. but, FULLWIDTH QUOTATION MARK, FULLWIDTH APOSTROPHE: fn:normalize-unicode("”’", "NFKC") returns ”’ In this case, I think that "' should be returned. Best regards, Toshio HIRAI

3 5

REST service problems - 401-Header sent
by MyNew EMail 01 Jul '12

01 Jul '12

Hi, I am using the REST service of BaseX. I'm using POST with the following body to send requests (XPath/XQuery): <query xmlns="http://basex.org/rest"> <text><![CDATA[ (//city/name)[position() <= 5] ]]></text></query> (it's the example from the documentation) Most of the time it works well, but when the XQuery request is to long I get a 401 status code (not authenticated) while I am authenticated. Is there any solution for this problem? Thanks @all

2 1

Full-text search and mixed content
by Michael Piotrowski 27 Jun '12

27 Jun '12

Hi, In "XQuery and XPath Full Text 1.0 Use Cases" [1] it says: Querying across element boundaries is similar to an XQuery and XPath character string function converting the sub-tree under an element into a string by removing all markup. However, I'm having trouble to get this to work in BaseX 7.2.1. For example, given this document: <doc> Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet Lorem ipsum dolor sit amet </doc> How do I query, for example, for p elements that contain the string "sit amet"? //p[. contains text 'sit amet'] returns only paragraphs 1 and 2. I've tried a number of variations, but I've been unable to come up with a query that returns all four p elements. Are my queries incorrect or is this a bug in BaseX? Thanks and best regards Footnotes: [1] <http://www.w3.org/TR/xpath-full-text-10-use-cases/> -- Dr.-Ing. Michael Piotrowski, M.A. <mxp(a)cl.uzh.ch> Institute of Computational Linguistics, University of Zurich Phone +41 44 63-54313 | OpenPGP public key ID 0x1614A044 * OUT NOW: Systems and Frameworks for Computational Morphology * <http://www.springeronline.com/978-3-642-23137-7>

5 27

how to formulate an excluding xquery?
by Cerstin Mahlow 27 Jun '12

27 Jun '12

Hi, in my project, users look for text nodes containing certain words. However, some of these queries result in a very large number of hits, with a lot of irrelevant ones. Is it possible to search with excluding xqueries? For example in this document A B C D E F A B D E F C A B D E F A B D F when looking for [text() contains contains text "A" ftand "B" ftand "E" ordered distance at most 3 words] I would like to make explicit, that "C" should not occur at all, to ensure to find only the third node, not the first nor second one -- i.e., "C" should not occur outside the sequence, nor inside the sequence. Is this possible at all? Can I also specify a query where "C" would be allowed to occur outside the sequence, like in the second node, but not inside like in the first node? Or the other way around? Best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Departement Sprach- und Literaturwissenschaften Fachbereich Deutsche Sprach- und Literaturwissenschaft Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 4

log files
by Cerstin Mahlow 27 Jun '12

27 Jun '12

Hi, where are the log files stored? I recently copied the basex/data directory to another computer via scp and I saw that files like "2012-05-04.log" have been copied, too. But I do not find them in the original directory and also not in the target directory. Best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Departement Sprach- und Literaturwissenschaften Fachbereich Deutsche Sprach- und Literaturwissenschaft Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 1

full text search collation
by alxarch 26 Jun '12

26 Jun '12

Hi I have a question relating to full text search. I am trying to use it with Greek texts and the default collation assumes that ά != α In short, accented vowels are treated as different letters. Is this something that has to do with the collation used not being Greek, or does it have something to do with the tokenizer? As a side question i noticed that the stemmers used from lucne are quite outdated. 3.6.0 also includes a Greek stemmer. I tried to include the 3.6.0 stemmers instead but language codes seem to be hardcoded in util/ft/Language.java Any chnce of that part of the code being updated to use the latest stemmers so more languages can be integrated? (i am not proficient in java myself unfortunately so i can't directly help) thanks, Alex

5 15

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk