BaseX-Talk

basex-talk@mailman.uni-konstanz.de

5 participants
5269 discussions

new to basex
by Bill Beck 30 Nov '12

30 Nov '12

Hi all, Here that the Massachusetts Historical Society we're exploring using BaseX for some new transcriptions of newspapers from around the American Revolution, as collected by a fellow named Harbottle Dorr. I'm having trouble figuring out how exactly to enable fulltext XQuery searches. We have it working, but quite a few keywords are not being indexed. From the command line tool, we do: >create database dorr_index >create index fulltext Then we have a PHP tool (using the class found on the BaseX site) that calls $session->execute to open the collection and $session->add to place the files. But when I then run >info db from the command line tool, it shows: Database Properties Name: dorr_index Size: 1390 KB Nodes: 32411 Resources: 24 Timestamp: 30.11.2012 08:00:11 Resource Properties Timestamp: 30.11.2012 08:03:21 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: false Path Summary: ON Text Index: OFF Attribute Index: OFF Full-Text Index: OFF if I then run the command >create index fulltext again, info db shows full-text index on, but up-to-date is still false, and our search results still have many missing hits. our XQuery is: for $i in collection(PATH)//item let $s := $i/mhs:sort where $i contains text ("QUERY" using stemming) return ... Are there any steps missing? Also, any tutorial out there to follow? Thanks very much in advance! -Bill B -- Bill Beck, Web Development Specialist Massachusetts Historical Society 1154 Boylston Street, Boston, MA 02215 Tel: 617-646-0505, Fax: 617-859-0074 www.masshist.org - America's Oldest Historical Society - Founded 1791 In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/.

3 3

using fuzzy in oxygen "invalid XQuery syntax, syntax does not pass static validation."
by Alex Muir 29 Nov '12

29 Nov '12

Hi, Just noticing that this using fuzzy example works in the basex gui however running in oxygen gives an error. It doesn't like the "using fuzzy" text. declare namespace db="http://basex.org/modules/db"; let $x := db:open('F-DDEX')//MessageHeader/MessageThreadId[text() contains text '893747' using fuzzy] return $x Oxygen Error System ID: /mnt/basex_volume/i4Base-Basex7.5/xquery/indevelopment/basex-connectiing.xq Scenario: all XQuery file: /mnt/basex_volume/i4Base-Basex7.5/xquery/indevelopment/basex-connectiing.xq Engine name: Basex-23.23.82.41 Severity: error Description: Invalid XQuery syntax, syntax does not pass static validation. Would that be an xqj issue? -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 1

Time query takes looking for element with text() ID
by Alex Muir 29 Nov '12

29 Nov '12

Hi, Sorry for all the questions of late first of all... I've been using basex for a while now and wrote some nice xquery that gather metrics from datasets ~7000 files querying the whole corpus to create statistics and it quite fast at that but were thinking this query below feels slow at 34 seconds so we thought we should ask for you thoughts on it's duration. Query: let $content := db:open('F-DDEX')//MessageHeader/MessageThreadId[text() eq '8937478'] return $content Content: So every file has a message header with a MessageThreadId. <MessageHeader xmlns:ern="http://ddex.net/xml/2011/ern-main/33" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance"> <MessageThreadId>8937478</MessageThreadId> <MessageId>C2C977FDFDHF98DHF9D8FHEURYX</MessageId> <MessageSender> <PartyId>PA47F93H54HU93HJSFDINF</PartyId> <PartyName> <FullName>Warner Music Group</FullName> </PartyName> </MessageSender> <MessageRecipient> <PartyId>3G3E</PartyId> <PartyName> <FullName>3G3E-YADS</FullName> </PartyName> </MessageRecipient> <MessageCreatedDateTime>2012-06-18T05:35:54Z</MessageCreatedDateTime> </MessageHeader> Given the following database with text, attribute and fulltext indexes on. Database Properties Name: F-DDEX Size: 5251 MB Nodes: 239945615 Documents: 7954 Specs Server: $ cat /proc/meminfo | grep MemTotal MemTotal: 7633876 kB $ cat /proc/cpuinfo | grep name model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 2

BXS - indexes - specifying the index and database location
by Alex Muir 29 Nov '12

29 Nov '12

Hi, I've created this bxs script which creates a db, however some things are not as expected. <?xml version="1.0" encoding="UTF-8"?> <commands> <drop-db name="S-1997"/> <create-db name="S-1997"/> <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/">/mnt/basex_volume/i4Base-Basex7.3/sample-data/1997/</add> <create-index type="fulltext"/> <optimize-all/> <info-db/> <info-index type="fulltext"/> <close/> </commands> I've written a script to call the bxs and create the database which it does however in this case it is not creating the indexes for fulltext as specified in the bxs and rather it is creating the text and attribute index. Why is that? [ec2-user@soda scripts]$ ./load-data-basex-locally.sh ../configuration/load-data-basex-locally.cfg Database Properties Name: S-1997 Size: 1718 KB Nodes: 51846 Documents: 4 Binaries: 0 Timestamp: 28.11.2012 15:23:26 Resource Properties Timestamp: 28.11.2012 15:23:25 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON * Full-Text Index: OFF* Full-Text Index - Not available I run the script from the dir /mnt/basex_volume/i4Base-Basex7.3/scripts and I end up getting a directory structure created in the scripts folder as follows starting with fulltext. /mnt/basex_volume/i4Base-Basex7.3/scripts/*fulltext* /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997 I would like to store the database and indexes in /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/ however I'm not clear on how to do this. I thought the <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/"> would specify this Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 3

Re: [basex-talk] java hosting provider with BaseX
by Colin McEnearney 29 Nov '12

29 Nov '12

Hi Marco, Alex, I have run basex on dreamhost vps http://dreamhost.com/servers/vps/ using nginx (starts at $15/month 300MB ram, unlimited storage + bandwidth) but these look really interesting - will consider these for the future. Thanks! Date: Wed, 28 Nov 2012 23:02:10 +0100 Subject: Re: [basex-talk] java hosting provider with BaseX Hi Marco, i could setup BaseX on ? http://www.jvmhost.com/ ? https://openshift.redhat.com/app/ ? http://jelastic.com/ All the best, Alex On 28.11.2012, at 10:31, marco fregonese wrote: > Hi there, > I was wondering if there is any java web hosting provider supporting BaseX. > I couldn't find any so far. > Thanks. > Bye.

1 0

java hosting provider with BaseX
by marco fregonese 28 Nov '12

28 Nov '12

Hi there, I was wondering if there is any java web hosting provider supporting BaseX. I couldn't find any so far. Thanks. Bye.

2 1

Namespace prefix not accepted
by Buddy Butterfly 28 Nov '12

28 Nov '12

Hi, I just discovered the impressive basex via ubuntu packages store. First tests went OK until I used an XML with mixed namespaces. Some of the outer and the root node use the default namespace. Some inner namespace have a UML prefix. XPath selection selects and shows the results OK till the path comes to the prefix. Query info then shows prefix unknown. Is there a solution to it or is it a bug? Best regards, Matt

2 1

EXPath File Module within xqueries in oxygen?
by Alex Muir 27 Nov '12

27 Nov '12

Hi, So having the oxygen integration setup now, the next question that comes up which I'm not finding an answer for is can one use the EXPath File Module within xqueries in oxygen? I'm googling around,, I gather only basex that has implemented it from the website. http://expath.org/modules/file/implems I see that though that oxygen has a method to import modules but not sure where to get the module if that's the case. http://www.oxygenxml.com/xml_editor/xquery_editor.html I suppose it's not that important for use in oxygen but thought I would ask.. Regards -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 2

Re: [basex-talk] Database corruption
by Antoni Mylka 26 Nov '12

26 Nov '12

Hi Christian, Let's return with this discussion to the mailing list as I think this might be interesting for everybody. Summary: I had stability problems. In my tests, once BaseX reached certain size It would start throwing exceptions with stacktraces reaching deep into the low-level classes that shuffle the bits and bytes on disk. I now started a test run of our system with PARALLEL=1 and UPDINDEX=false. The system has been running without any exceptions for 17 hours. Starting with an empty data there have been almost 200K queries and commands. This is a record. Now, what exactly are the consequences of UPDINDEX being false. Can I do queries? What kind of queries I can't do? What kind of queries will be slower? Will the database rebuild the index automatically? When? What is the command to trigger an index rebuild manually. Is the index rebuild kind of a "stop-the-world" operation, so that BaseX will become unresponsive or will it be done in parallel. What are the benefits of the indices, can I live without them? -- Antoni Myłka Software Engineer basis06 AG, Birkenweg 61, CH-3013 Bern - Fon +41 31 311 32 22 http://www.basis06.ch - source of smart business ----- Ursprüngliche Mail ----- Von: "Christian Grün" <christian.gruen(a)gmail.com> An: "Antoni Mylka" <amy(a)basis06.ch> Gesendet: Dienstag, 20. November 2012 16:46:30 Betreff: Re: [basex-talk] Database corruption Hi Antoni, > I'll also try to run an experiment without UPDINDEX. yes, this would be interesting. I did some more testing with the given queries, but couldn’t encounter something noteworthy so far.. Thanks, Christian

2 3

HTTP module - authorization
by Hans-Juergen Rennau 23 Nov '12

23 Nov '12

Hello, I have a question about the HTTP module and authorization. Is digest authorization supported, or is it only possible to provide basic access authorization? Thank you, Hans-Juergen

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk