BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5245 discussions

python client, issue with adding xml files
by LE MEUR Laurent 09 Dec '12

09 Dec '12

Hi, The python samples pass an simple xml string to create or add: session = BaseXClient.Session('localhost', 1984, 'admin', 'admin') session.create("database", "<x>Hello World!</x>") but how can I request the server to open a file or a directory? Basically session.create("database", "c:/tmp/myfile.xml") returns the following error message: "database.xml" (Line 1): No text allowed before root element. Thanks in advance for tips Laurent Le Meur

2 1

Re: [basex-talk] Use of try/catch in updating function
by Arto Viitanen 07 Dec '12

07 Dec '12

7.12.2012 13:40, Christian Grün kirjoitti: > Hi Arto, > > it’s generally allowed to use try/catch along with updating functions… > As long as both the try and the catch branch contain updating > statements. See the following self-contained, albeit useless, example: > > try { > delete node <a/> > } catch * { > delete node <b/> > } > > How did your query look like? > Christian > > > Thank for your information. My query (I cannot show it, because if is for a customer and it is ~600 lines long) has two parts: check if the parameter (or actually POST -message) is right, i.e. syntax is right and do the update. Since I was not even certain where the problem was, I thought to add try/catch around the whole code to see where it stops. I found that file-module is your friend: add file:append calls around the code and see how the query evaluates. -- Arto Viitanen Microteam Oy Finland

1 0

Re: [basex-talk] xquery JSON support
by Sateesh 04 Dec '12

04 Dec '12

Dear Basex, Could you please update us on the below query. Thanks & Regards Sateesh.A From: Sateesh [mailto:sateesh@intense.in] Sent: Monday, December 03, 2012 8:40 PM To: 'basex-talk(a)mailman.uni-konstanz.de' Subject: xquery JSON support Dear Basex, Iam trying to create collection from json file,While creating the collection for 650 mb json file it is consuming more than 3gb of memory and getting out of memory exception.In case if I split the 650 mb json file into 10mb files and adding those files to collection it is adding but the time required to create the collection is around 6-7 mins.Could you please suggest how to create collection with less memory consumption and with high speed. Also after creating collection tried writing query on collection which contains around 17lakh records the time for query execution is around 3 mins.Attached r the query and sample data.Please suggest is there anything wrong in my query to improve the performance. Thanks & Regards Sateesh.A

1 0

Nova CPE Krazer Sky Station 5GHz N - CPE Antena Integrada de 18dBi e Com Saída para Antena Externa
by Vendas Krazer Technologies 03 Dec '12

03 Dec '12

Lançamento CPE Krazer Sky Station 5GHz N Você cliente pediu que a Krazer fizesse uma nova CPE num formato mais estiloso, pequena, de menor tamanho e que tivesse novas funcionabilidade, mais especificamente acesso fácil ao botão de reset, proteção contra queima e a tão desejada SAÍDA PARA ANTENA EXTERNA!!! R$ 179.90 Antena Integrada de 18dBi 60º Duas Portas de Rede Lan e Wan PA Real de 630mW e LNA Ultra Ganho PoE Passivo com Proteção Dupla de 12 a 24V Fonte Chaveada 12V Full Range 110 a 220V Exclusiva Saída para Antena Externa Homologação Anatel 0269-11-5280 Instalação Rápida e Simples. Software Amigavel e em Português! Suporte a PPPoE Wisp Cliente! Controle de Banda! Excelente sinal de recepção! Longa Distância! Faça um teste em sua rede e compare com os concorrentes, muito mais sinal que UBNT, muito mais dados, transmissão de quase 90Mbps TCP/IP continuamente! Latência de rede de 1 a 5 ms com carga completa! Contate-nos Val Campos // Carla Maria // Eder Roberto Email / MSN: vendas(a)allearth.com.br Vendas / SAC (19) 3256-5557 (19) 3245-0708 www.krazer.com.br Envio de Email não autorizado é crime, não seja o vilão da história! Email é protegido sobre sigilo fiscal e federal. Lei Federal Brasil.

1 0

xquery JSON support
by Sateesh 03 Dec '12

03 Dec '12

Dear Basex, Iam trying to create collection from json file,While creating the collection for 650 mb json file it is consuming more than 3gb of memory and getting out of memory exception.In case if I split the 650 mb json file into 10mb files and adding those files to collection it is adding but the time required to create the collection is around 6-7 mins.Could you please suggest how to create collection with less memory consumption and with high speed. Also after creating collection tried writing query on collection which contains around 17lakh records the time for query execution is around 3 mins.Attached r the query and sample data.Please suggest is there anything wrong in my query to improve the performance. Thanks & Regards Sateesh.A

1 0

Re: [basex-talk] new to basex
by Christian Grün 30 Nov '12

30 Nov '12

Hi Bill (cc to the list), the current fulltext global indexing options (specified via SET) are applied and stored in the target database whenever an index is created via CREATE INDEX. If OPTIMIZE is used, these database options will be used for recreating the index. Both the database options and index structures should not get lost if you restart your server. The following (non-server) example may help to demonstrate that fulltext options such as stemming will be stored along with the database: basex -c "set stemming on;set ftindex on; create db db <a>A</a>; optimize; close; set stemming off; open db;info index fulltext" Btw, which BaseX version do you use? It would be interesting to see what happens with our latest stable snapshot [1]; the final version is long overdue, but it will finally be released in December. Christian [1] http://files.basex.org/releases/latest/ ___________________________ > HI Christian, > > Thanks for the fast reply. > > I tried your steps, with no change. I am curious about a couple of things I notice: > > Using these command I enabled fulltext with stemming: > >>set stemming true >>create index fulltext > > And info index shows these to be true. But if I stop the server and restart, these are all off, and the fulltext index is gone (the collection and it's files are still there). And yet, the same flawed search still works. > > So my questions are: > Do we need to reset globals and reindex each time the server is restart? It our implimentation it seems so (running standalone mode). > > Thanks. > > -bb > > > On Nov 30, 2012, at 8:50 AM, Christian Grün wrote: > >> Hi Bill, >> >>> I'm having trouble figuring out how exactly to enable fulltext XQuery searches. We have it working, but quite a few keywords are not being indexed. [...] >> >> as you already indicated, the fulltext index gets lost when performing >> updates. If you set FTNDEX to TRUE before creating your database, your >> fulltext index will always be recreated when calling OPTIMIZE: >> >> set ftindex true >> create db dorr_index >> add ... >> optimize >> >>> for $i in collection(PATH)//item >>> let $s := $i/mhs:sort >>> where $i contains text ("QUERY" using stemming) >>> return ... >> >> I know too less about your xml structure, so it's difficult to tell >> what/if sth. goes wrong. Does the behavior change when following the >> steps suggested above? >> >> Cheers, >> Christian >> ___________________________ >> >>> for $i in collection(PATH)//item >>> let $s := $i/mhs:sort >>> where $i contains text ("QUERY" using stemming) >>> return ... >>> >>> Are there any steps missing? Also, any tutorial out there to follow? >>> >>> Thanks very much in advance! >>> >>> -Bill B >>> -- >>> Bill Beck, Web Development Specialist >>> Massachusetts Historical Society >>> 1154 Boylston Street, Boston, MA 02215 >>> Tel: 617-646-0505, Fax: 617-859-0074 >>> www.masshist.org - America's Oldest Historical Society - Founded 1791 >>> >>> >>> In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/. >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > -- > Bill Beck, Web Development Specialist > Massachusetts Historical Society > 1154 Boylston Street, Boston, MA 02215 > Tel: 617-646-0505, Fax: 617-859-0074 > www.masshist.org - America's Oldest Historical Society - Founded 1791 > > > In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/.

1 0

new to basex
by Bill Beck 30 Nov '12

30 Nov '12

Hi all, Here that the Massachusetts Historical Society we're exploring using BaseX for some new transcriptions of newspapers from around the American Revolution, as collected by a fellow named Harbottle Dorr. I'm having trouble figuring out how exactly to enable fulltext XQuery searches. We have it working, but quite a few keywords are not being indexed. From the command line tool, we do: >create database dorr_index >create index fulltext Then we have a PHP tool (using the class found on the BaseX site) that calls $session->execute to open the collection and $session->add to place the files. But when I then run >info db from the command line tool, it shows: Database Properties Name: dorr_index Size: 1390 KB Nodes: 32411 Resources: 24 Timestamp: 30.11.2012 08:00:11 Resource Properties Timestamp: 30.11.2012 08:03:21 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: false Path Summary: ON Text Index: OFF Attribute Index: OFF Full-Text Index: OFF if I then run the command >create index fulltext again, info db shows full-text index on, but up-to-date is still false, and our search results still have many missing hits. our XQuery is: for $i in collection(PATH)//item let $s := $i/mhs:sort where $i contains text ("QUERY" using stemming) return ... Are there any steps missing? Also, any tutorial out there to follow? Thanks very much in advance! -Bill B -- Bill Beck, Web Development Specialist Massachusetts Historical Society 1154 Boylston Street, Boston, MA 02215 Tel: 617-646-0505, Fax: 617-859-0074 www.masshist.org - America's Oldest Historical Society - Founded 1791 In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/.

3 3

using fuzzy in oxygen "invalid XQuery syntax, syntax does not pass static validation."
by Alex Muir 29 Nov '12

29 Nov '12

Hi, Just noticing that this using fuzzy example works in the basex gui however running in oxygen gives an error. It doesn't like the "using fuzzy" text. declare namespace db="http://basex.org/modules/db"; let $x := db:open('F-DDEX')//MessageHeader/MessageThreadId[text() contains text '893747' using fuzzy] return $x Oxygen Error System ID: /mnt/basex_volume/i4Base-Basex7.5/xquery/indevelopment/basex-connectiing.xq Scenario: all XQuery file: /mnt/basex_volume/i4Base-Basex7.5/xquery/indevelopment/basex-connectiing.xq Engine name: Basex-23.23.82.41 Severity: error Description: Invalid XQuery syntax, syntax does not pass static validation. Would that be an xqj issue? -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 1

Time query takes looking for element with text() ID
by Alex Muir 29 Nov '12

29 Nov '12

Hi, Sorry for all the questions of late first of all... I've been using basex for a while now and wrote some nice xquery that gather metrics from datasets ~7000 files querying the whole corpus to create statistics and it quite fast at that but were thinking this query below feels slow at 34 seconds so we thought we should ask for you thoughts on it's duration. Query: let $content := db:open('F-DDEX')//MessageHeader/MessageThreadId[text() eq '8937478'] return $content Content: So every file has a message header with a MessageThreadId. <MessageHeader xmlns:ern="http://ddex.net/xml/2011/ern-main/33" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance"> <MessageThreadId>8937478</MessageThreadId> <MessageId>C2C977FDFDHF98DHF9D8FHEURYX</MessageId> <MessageSender> <PartyId>PA47F93H54HU93HJSFDINF</PartyId> <PartyName> <FullName>Warner Music Group</FullName> </PartyName> </MessageSender> <MessageRecipient> <PartyId>3G3E</PartyId> <PartyName> <FullName>3G3E-YADS</FullName> </PartyName> </MessageRecipient> <MessageCreatedDateTime>2012-06-18T05:35:54Z</MessageCreatedDateTime> </MessageHeader> Given the following database with text, attribute and fulltext indexes on. Database Properties Name: F-DDEX Size: 5251 MB Nodes: 239945615 Documents: 7954 Specs Server: $ cat /proc/meminfo | grep MemTotal MemTotal: 7633876 kB $ cat /proc/cpuinfo | grep name model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 2

BXS - indexes - specifying the index and database location
by Alex Muir 29 Nov '12

29 Nov '12

Hi, I've created this bxs script which creates a db, however some things are not as expected. <?xml version="1.0" encoding="UTF-8"?> <commands> <drop-db name="S-1997"/> <create-db name="S-1997"/> <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/">/mnt/basex_volume/i4Base-Basex7.3/sample-data/1997/</add> <create-index type="fulltext"/> <optimize-all/> <info-db/> <info-index type="fulltext"/> <close/> </commands> I've written a script to call the bxs and create the database which it does however in this case it is not creating the indexes for fulltext as specified in the bxs and rather it is creating the text and attribute index. Why is that? [ec2-user@soda scripts]$ ./load-data-basex-locally.sh ../configuration/load-data-basex-locally.cfg Database Properties Name: S-1997 Size: 1718 KB Nodes: 51846 Documents: 4 Binaries: 0 Timestamp: 28.11.2012 15:23:26 Resource Properties Timestamp: 28.11.2012 15:23:25 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON * Full-Text Index: OFF* Full-Text Index - Not available I run the script from the dir /mnt/basex_volume/i4Base-Basex7.3/scripts and I end up getting a directory structure created in the scripts folder as follows starting with fulltext. /mnt/basex_volume/i4Base-Basex7.3/scripts/*fulltext* /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997 I would like to store the database and indexes in /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/ however I'm not clear on how to do this. I thought the <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/"> would specify this Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk