- BaseX-Talk - mailman.uni-konstanz.de

Are command scripts optimized before execution? / Optimization of my query
by Ben Companjen 10 Dec '12

10 Dec '12

Hi all, I was wondering whether command scripts are optimized before they are executed. I would think so, because when I had made an error in the, say, sixth command in my script, it was caught before the first command was executed. But more importantly for my application: it seems that combinations of "CLOSE; OPEN <same DB as just closed>" are skipped. I created an XQuery to copy 680000 records from my XML DB to MySQL. These records are MODS, found inside record elements at XPath /file/record. The database is about 2.5 GB and eats even more of my main memory when I try to copy all records in one run. I found out that doing subsequences of 50000 to 10000 records speeds up the process significantly and the server uses a lot less memory. For instance, when I start processing records from 400001, BaseX apparently doesn't keep the first 400000 in memory. But just doing 50000 records in a row, shifting the begin parameter of the subsequence and going on, eventually slows the process from tens to more than 100 records per second to less than one per second, probably because memory consumption goes up to all available memory (I assigned 3 GB to the JVM at startup of the server). Therefore I tried to free some memory by closing the database, re-opening it and then resume processing. But I don't see the memory usage reduction that I hoped for. >From my XQuery mods2sql5.xq: <namespace declarations> declare variable $begin as xs:integer external := 1; declare variable $length as xs:integer external := 50000; <function declarations: prepare statement return sql:execute-prepared(...)> (: main process :) for $record at $rodb in subsequence(/file/record[mods:mods][@id != ""], $begin, $length) <call functions to process records> return <functions' output as sequence> >From my command script mods2sql.bxs: SET QUERYINFO true OPEN monly2 SET BINDINGS $begin=1,$length=50000 RUN /Users/ben/Documents/xquery/metadata_only/mods2sql5.xq SET BINDINGS $begin=50001 RUN /Users/ben/Documents/xquery/metadata_only/mods2sql5.xq CLOSE OPEN monly2 SET BINDINGS $begin=100001 RUN /Users/ben/Documents/xquery/metadata_only/mods2sql5.xq SET BINDINGS $begin=150001 RUN /Users/ben/Documents/xquery/metadata_only/mods2sql5.xq SET BINDINGS $begin=200001 RUN /Users/ben/Documents/xquery/metadata_only/mods2sql5.xq CLOSE OPEN monly2 ... Are my observations about optimizations of command scripts correct? Is there any way to speed up my process? Thanks for any advice! Regards, Ben

2 1

UPDINDEX fails; command basexserver does not work
by Mahlow Cerstin 10 Dec '12

10 Dec '12

Hi, I just encountered two problems: I'm using a collection created wit UPDINDEX TRUE using BaseX75-20121114. When I tested it, everything worked fine, the index was recreated each time I stored or deleted something. However, today one of the users really worked with the whole webapplication and after half an hour (searching two collections, storing some new nodes and updating some nodes), she got a server time out. In the GUI I could see, that the value of INDEX for "up-to-date" was "false". Which obviously caused the time out. But what could be the reason the index wasn't up to date anymore? How can I make sure the option is working as intended? Anyway, I decided to get the latest snapshot BaseX75-20121204 and re-create the collection with again setting UPDINDEX TRUE. For the webapplication I have a Linux server: Linux version 2.6.18-274.el5 (mockbuild(a)builder10.centos.org) (gcc version 4.1.2 20080704 (Red Hat 4.1.2-50)) #1 SMP Fri Jul 22 04:43:29 EDT 2011 with java version "1.6.0_07" Java(TM) SE Runtime Environment (build 1.6.0_07-b06) Java HotSpot(TM) 64-Bit Server VM (build 10.0-b23, mixed mode) For development, I use a Mac with OSX 10.6.8. with java version "1.6.0_37" Java(TM) SE Runtime Environment (build 1.6.0_37-b06-434-10M3909) Java HotSpot(TM) 64-Bit Server VM (build 20.12-b01-434, mixed mode) So I installed the latest snapshot on both and then tried to stop and restart the server. Which worked as usually fine on the Mac, but on the Linux server, when calling basexserver stop nothing happens. It looks like the script is waiting for some input -- the process does not stop. The old BaseX server seems to be running somehow; I cannot start the server either. Is this a known issue with the latest version? How can I force basexserver to stop and then restart it again? Best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Deutsches Seminar Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net

3 5

Re: [basex-talk] suggestions for visualisations etc
by pw＠themail.co.uk 09 Dec '12

09 Dec '12

HI Johannes I was wondering if there were any libraries that would consume JSON-ML and to which I could feed the output from the parameterised RESTXQ API. Do you know of any? Cheers Peter > > > >---- Original Message ---- >From: Johannes.Lichtenberger(a)uni-konstanz.de >To: basex-talk(a)mailman.uni-konstanz.de >Subject: Re: [basex-talk] suggestions for visualisations etc >Date: Sun, 09 Dec 2012 21:22:19 +0100 > >>On 12/09/2012 08:47 PM, pw(a)themail.co.uk wrote: >>> Hello List >>> >>> I am testing the use of BaseX to deliver modest amounts of XML >data >>> through the RESTXQ API. See http://www.semantechs.co.uk for the >>> illustration. >>> >>> I am looking for suggestions for client side graphics packages >that >>> can consume the json-ml provide by BaseX >>> >>> I am also interested in any other suggestions for improving >>> utility/performance >> >>Hello, >> >>what you probably need is a shared presentation model. I wouldn't >use >>any human readable presentation, but a binary protocol to exchange >data, >>for instance the needed node pages to draw the treemap or any other >>visualization. >> >>The "real" model resides on the server, but the presentation model >is >>shared, thus for instance the server knows immediately when you push >a >>button or change any other GUI component state and the server reacts >and >>sends a response. Thus the visualizations are located at the client, >but >>for instance queries are executed on the server and only the results >are >>sent to the client. But as suggested you probably need the Java >POJOs >>(for instance I think ANode and so on). >> >>At least that's something on my radar (for another project, but >should >>be pretty much the same for each Swing/JavaFX Application) and >that's >>how I would do it. >> >>kind regards >>Johannes >> >>_______________________________________________ >>BaseX-Talk mailing list >>BaseX-Talk(a)mailman.uni-konstanz.de >>https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>

2 1

suggestions for visualisations etc
by pw＠themail.co.uk 09 Dec '12

09 Dec '12

Hello List I am testing the use of BaseX to deliver modest amounts of XML data through the RESTXQ API. See http://www.semantechs.co.uk for the illustration. I am looking for suggestions for client side graphics packages that can consume the json-ml provide by BaseX I am also interested in any other suggestions for improving utility/performance Thanks Peter

2 1

BaseX and citygml (GML3)
by maalaoui hiba 09 Dec '12

09 Dec '12

hi, I have CityGML file (GML3) I want to save it in a database is that I can save this file BaseX, if yes, then querying the database provides is it possible? thank you for any help Hiba Maalaoui

1 0

python client, issue with adding xml files
by LE MEUR Laurent 09 Dec '12

09 Dec '12

Hi, The python samples pass an simple xml string to create or add: session = BaseXClient.Session('localhost', 1984, 'admin', 'admin') session.create("database", "<x>Hello World!</x>") but how can I request the server to open a file or a directory? Basically session.create("database", "c:/tmp/myfile.xml") returns the following error message: "database.xml" (Line 1): No text allowed before root element. Thanks in advance for tips Laurent Le Meur

2 1

Re: [basex-talk] Use of try/catch in updating function
by Arto Viitanen 07 Dec '12

07 Dec '12

7.12.2012 13:40, Christian Grün kirjoitti: > Hi Arto, > > it’s generally allowed to use try/catch along with updating functions… > As long as both the try and the catch branch contain updating > statements. See the following self-contained, albeit useless, example: > > try { > delete node <a/> > } catch * { > delete node <b/> > } > > How did your query look like? > Christian > > > Thank for your information. My query (I cannot show it, because if is for a customer and it is ~600 lines long) has two parts: check if the parameter (or actually POST -message) is right, i.e. syntax is right and do the update. Since I was not even certain where the problem was, I thought to add try/catch around the whole code to see where it stops. I found that file-module is your friend: add file:append calls around the code and see how the query evaluates. -- Arto Viitanen Microteam Oy Finland

1 0

Re: [basex-talk] xquery JSON support
by Sateesh 04 Dec '12

04 Dec '12

Dear Basex, Could you please update us on the below query. Thanks & Regards Sateesh.A From: Sateesh [mailto:sateesh@intense.in] Sent: Monday, December 03, 2012 8:40 PM To: 'basex-talk(a)mailman.uni-konstanz.de' Subject: xquery JSON support Dear Basex, Iam trying to create collection from json file,While creating the collection for 650 mb json file it is consuming more than 3gb of memory and getting out of memory exception.In case if I split the 650 mb json file into 10mb files and adding those files to collection it is adding but the time required to create the collection is around 6-7 mins.Could you please suggest how to create collection with less memory consumption and with high speed. Also after creating collection tried writing query on collection which contains around 17lakh records the time for query execution is around 3 mins.Attached r the query and sample data.Please suggest is there anything wrong in my query to improve the performance. Thanks & Regards Sateesh.A

1 0

Nova CPE Krazer Sky Station 5GHz N - CPE Antena Integrada de 18dBi e Com Saída para Antena Externa
by Vendas Krazer Technologies 03 Dec '12

03 Dec '12

Lançamento CPE Krazer Sky Station 5GHz N Você cliente pediu que a Krazer fizesse uma nova CPE num formato mais estiloso, pequena, de menor tamanho e que tivesse novas funcionabilidade, mais especificamente acesso fácil ao botão de reset, proteção contra queima e a tão desejada SAÍDA PARA ANTENA EXTERNA!!! R$ 179.90 Antena Integrada de 18dBi 60º Duas Portas de Rede Lan e Wan PA Real de 630mW e LNA Ultra Ganho PoE Passivo com Proteção Dupla de 12 a 24V Fonte Chaveada 12V Full Range 110 a 220V Exclusiva Saída para Antena Externa Homologação Anatel 0269-11-5280 Instalação Rápida e Simples. Software Amigavel e em Português! Suporte a PPPoE Wisp Cliente! Controle de Banda! Excelente sinal de recepção! Longa Distância! Faça um teste em sua rede e compare com os concorrentes, muito mais sinal que UBNT, muito mais dados, transmissão de quase 90Mbps TCP/IP continuamente! Latência de rede de 1 a 5 ms com carga completa! Contate-nos Val Campos // Carla Maria // Eder Roberto Email / MSN: vendas(a)allearth.com.br Vendas / SAC (19) 3256-5557 (19) 3245-0708 www.krazer.com.br Envio de Email não autorizado é crime, não seja o vilão da história! Email é protegido sobre sigilo fiscal e federal. Lei Federal Brasil.

1 0

xquery JSON support
by Sateesh 03 Dec '12

03 Dec '12

Dear Basex, Iam trying to create collection from json file,While creating the collection for 650 mb json file it is consuming more than 3gb of memory and getting out of memory exception.In case if I split the 650 mb json file into 10mb files and adding those files to collection it is adding but the time required to create the collection is around 6-7 mins.Could you please suggest how to create collection with less memory consumption and with high speed. Also after creating collection tried writing query on collection which contains around 17lakh records the time for query execution is around 3 mins.Attached r the query and sample data.Please suggest is there anything wrong in my query to improve the performance. Thanks & Regards Sateesh.A

1 0

Re: [basex-talk] new to basex
by Christian Grün 30 Nov '12

30 Nov '12

Hi Bill (cc to the list), the current fulltext global indexing options (specified via SET) are applied and stored in the target database whenever an index is created via CREATE INDEX. If OPTIMIZE is used, these database options will be used for recreating the index. Both the database options and index structures should not get lost if you restart your server. The following (non-server) example may help to demonstrate that fulltext options such as stemming will be stored along with the database: basex -c "set stemming on;set ftindex on; create db db <a>A</a>; optimize; close; set stemming off; open db;info index fulltext" Btw, which BaseX version do you use? It would be interesting to see what happens with our latest stable snapshot [1]; the final version is long overdue, but it will finally be released in December. Christian [1] http://files.basex.org/releases/latest/ ___________________________ > HI Christian, > > Thanks for the fast reply. > > I tried your steps, with no change. I am curious about a couple of things I notice: > > Using these command I enabled fulltext with stemming: > >>set stemming true >>create index fulltext > > And info index shows these to be true. But if I stop the server and restart, these are all off, and the fulltext index is gone (the collection and it's files are still there). And yet, the same flawed search still works. > > So my questions are: > Do we need to reset globals and reindex each time the server is restart? It our implimentation it seems so (running standalone mode). > > Thanks. > > -bb > > > On Nov 30, 2012, at 8:50 AM, Christian Grün wrote: > >> Hi Bill, >> >>> I'm having trouble figuring out how exactly to enable fulltext XQuery searches. We have it working, but quite a few keywords are not being indexed. [...] >> >> as you already indicated, the fulltext index gets lost when performing >> updates. If you set FTNDEX to TRUE before creating your database, your >> fulltext index will always be recreated when calling OPTIMIZE: >> >> set ftindex true >> create db dorr_index >> add ... >> optimize >> >>> for $i in collection(PATH)//item >>> let $s := $i/mhs:sort >>> where $i contains text ("QUERY" using stemming) >>> return ... >> >> I know too less about your xml structure, so it's difficult to tell >> what/if sth. goes wrong. Does the behavior change when following the >> steps suggested above? >> >> Cheers, >> Christian >> ___________________________ >> >>> for $i in collection(PATH)//item >>> let $s := $i/mhs:sort >>> where $i contains text ("QUERY" using stemming) >>> return ... >>> >>> Are there any steps missing? Also, any tutorial out there to follow? >>> >>> Thanks very much in advance! >>> >>> -Bill B >>> -- >>> Bill Beck, Web Development Specialist >>> Massachusetts Historical Society >>> 1154 Boylston Street, Boston, MA 02215 >>> Tel: 617-646-0505, Fax: 617-859-0074 >>> www.masshist.org - America's Oldest Historical Society - Founded 1791 >>> >>> >>> In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/. >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > -- > Bill Beck, Web Development Specialist > Massachusetts Historical Society > 1154 Boylston Street, Boston, MA 02215 > Tel: 617-646-0505, Fax: 617-859-0074 > www.masshist.org - America's Oldest Historical Society - Founded 1791 > > > In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/.

1 0

new to basex
by Bill Beck 30 Nov '12

30 Nov '12

Hi all, Here that the Massachusetts Historical Society we're exploring using BaseX for some new transcriptions of newspapers from around the American Revolution, as collected by a fellow named Harbottle Dorr. I'm having trouble figuring out how exactly to enable fulltext XQuery searches. We have it working, but quite a few keywords are not being indexed. From the command line tool, we do: >create database dorr_index >create index fulltext Then we have a PHP tool (using the class found on the BaseX site) that calls $session->execute to open the collection and $session->add to place the files. But when I then run >info db from the command line tool, it shows: Database Properties Name: dorr_index Size: 1390 KB Nodes: 32411 Resources: 24 Timestamp: 30.11.2012 08:00:11 Resource Properties Timestamp: 30.11.2012 08:03:21 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: false Path Summary: ON Text Index: OFF Attribute Index: OFF Full-Text Index: OFF if I then run the command >create index fulltext again, info db shows full-text index on, but up-to-date is still false, and our search results still have many missing hits. our XQuery is: for $i in collection(PATH)//item let $s := $i/mhs:sort where $i contains text ("QUERY" using stemming) return ... Are there any steps missing? Also, any tutorial out there to follow? Thanks very much in advance! -Bill B -- Bill Beck, Web Development Specialist Massachusetts Historical Society 1154 Boylston Street, Boston, MA 02215 Tel: 617-646-0505, Fax: 617-859-0074 www.masshist.org - America's Oldest Historical Society - Founded 1791 In Death Lamented: The Tradition of Anglo-American Mourning Jewelry opens on 28 September 2012 and runs through 31 January 2013. The exhibition will be on display Monday through Saturday from 10 AM to 4 PM. More information is available at www.masshist.org/events/.

3 3

using fuzzy in oxygen "invalid XQuery syntax, syntax does not pass static validation."
by Alex Muir 29 Nov '12

29 Nov '12

Hi, Just noticing that this using fuzzy example works in the basex gui however running in oxygen gives an error. It doesn't like the "using fuzzy" text. declare namespace db="http://basex.org/modules/db"; let $x := db:open('F-DDEX')//MessageHeader/MessageThreadId[text() contains text '893747' using fuzzy] return $x Oxygen Error System ID: /mnt/basex_volume/i4Base-Basex7.5/xquery/indevelopment/basex-connectiing.xq Scenario: all XQuery file: /mnt/basex_volume/i4Base-Basex7.5/xquery/indevelopment/basex-connectiing.xq Engine name: Basex-23.23.82.41 Severity: error Description: Invalid XQuery syntax, syntax does not pass static validation. Would that be an xqj issue? -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 1

Time query takes looking for element with text() ID
by Alex Muir 29 Nov '12

29 Nov '12

Hi, Sorry for all the questions of late first of all... I've been using basex for a while now and wrote some nice xquery that gather metrics from datasets ~7000 files querying the whole corpus to create statistics and it quite fast at that but were thinking this query below feels slow at 34 seconds so we thought we should ask for you thoughts on it's duration. Query: let $content := db:open('F-DDEX')//MessageHeader/MessageThreadId[text() eq '8937478'] return $content Content: So every file has a message header with a MessageThreadId. <MessageHeader xmlns:ern="http://ddex.net/xml/2011/ern-main/33" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance"> <MessageThreadId>8937478</MessageThreadId> <MessageId>C2C977FDFDHF98DHF9D8FHEURYX</MessageId> <MessageSender> <PartyId>PA47F93H54HU93HJSFDINF</PartyId> <PartyName> <FullName>Warner Music Group</FullName> </PartyName> </MessageSender> <MessageRecipient> <PartyId>3G3E</PartyId> <PartyName> <FullName>3G3E-YADS</FullName> </PartyName> </MessageRecipient> <MessageCreatedDateTime>2012-06-18T05:35:54Z</MessageCreatedDateTime> </MessageHeader> Given the following database with text, attribute and fulltext indexes on. Database Properties Name: F-DDEX Size: 5251 MB Nodes: 239945615 Documents: 7954 Specs Server: $ cat /proc/meminfo | grep MemTotal MemTotal: 7633876 kB $ cat /proc/cpuinfo | grep name model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz model name : Intel(R) Xeon(R) CPU E5430 @ 2.66GHz Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 2

BXS - indexes - specifying the index and database location
by Alex Muir 29 Nov '12

29 Nov '12

Hi, I've created this bxs script which creates a db, however some things are not as expected. <?xml version="1.0" encoding="UTF-8"?> <commands> <drop-db name="S-1997"/> <create-db name="S-1997"/> <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/">/mnt/basex_volume/i4Base-Basex7.3/sample-data/1997/</add> <create-index type="fulltext"/> <optimize-all/> <info-db/> <info-index type="fulltext"/> <close/> </commands> I've written a script to call the bxs and create the database which it does however in this case it is not creating the indexes for fulltext as specified in the bxs and rather it is creating the text and attribute index. Why is that? [ec2-user@soda scripts]$ ./load-data-basex-locally.sh ../configuration/load-data-basex-locally.cfg Database Properties Name: S-1997 Size: 1718 KB Nodes: 51846 Documents: 4 Binaries: 0 Timestamp: 28.11.2012 15:23:26 Resource Properties Timestamp: 28.11.2012 15:23:25 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON * Full-Text Index: OFF* Full-Text Index - Not available I run the script from the dir /mnt/basex_volume/i4Base-Basex7.3/scripts and I end up getting a directory structure created in the scripts folder as follows starting with fulltext. /mnt/basex_volume/i4Base-Basex7.3/scripts/*fulltext* /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997 I would like to store the database and indexes in /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/ however I'm not clear on how to do this. I thought the <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/"> would specify this Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 3

Re: [basex-talk] java hosting provider with BaseX
by Colin McEnearney 29 Nov '12

29 Nov '12

Hi Marco, Alex, I have run basex on dreamhost vps http://dreamhost.com/servers/vps/ using nginx (starts at $15/month 300MB ram, unlimited storage + bandwidth) but these look really interesting - will consider these for the future. Thanks! Date: Wed, 28 Nov 2012 23:02:10 +0100 Subject: Re: [basex-talk] java hosting provider with BaseX Hi Marco, i could setup BaseX on ? http://www.jvmhost.com/ ? https://openshift.redhat.com/app/ ? http://jelastic.com/ All the best, Alex On 28.11.2012, at 10:31, marco fregonese wrote: > Hi there, > I was wondering if there is any java web hosting provider supporting BaseX. > I couldn't find any so far. > Thanks. > Bye.

1 0

java hosting provider with BaseX
by marco fregonese 28 Nov '12

28 Nov '12

Hi there, I was wondering if there is any java web hosting provider supporting BaseX. I couldn't find any so far. Thanks. Bye.

2 1

Namespace prefix not accepted
by Buddy Butterfly 28 Nov '12

28 Nov '12

Hi, I just discovered the impressive basex via ubuntu packages store. First tests went OK until I used an XML with mixed namespaces. Some of the outer and the root node use the default namespace. Some inner namespace have a UML prefix. XPath selection selects and shows the results OK till the path comes to the prefix. Query info then shows prefix unknown. Is there a solution to it or is it a bug? Best regards, Matt

2 1

EXPath File Module within xqueries in oxygen?
by Alex Muir 27 Nov '12

27 Nov '12

Hi, So having the oxygen integration setup now, the next question that comes up which I'm not finding an answer for is can one use the EXPath File Module within xqueries in oxygen? I'm googling around,, I gather only basex that has implemented it from the website. http://expath.org/modules/file/implems I see that though that oxygen has a method to import modules but not sure where to get the module if that's the case. http://www.oxygenxml.com/xml_editor/xquery_editor.html I suppose it's not that important for use in oxygen but thought I would ask.. Regards -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 2

Re: [basex-talk] Database corruption
by Antoni Mylka 26 Nov '12

26 Nov '12

Hi Christian, Let's return with this discussion to the mailing list as I think this might be interesting for everybody. Summary: I had stability problems. In my tests, once BaseX reached certain size It would start throwing exceptions with stacktraces reaching deep into the low-level classes that shuffle the bits and bytes on disk. I now started a test run of our system with PARALLEL=1 and UPDINDEX=false. The system has been running without any exceptions for 17 hours. Starting with an empty data there have been almost 200K queries and commands. This is a record. Now, what exactly are the consequences of UPDINDEX being false. Can I do queries? What kind of queries I can't do? What kind of queries will be slower? Will the database rebuild the index automatically? When? What is the command to trigger an index rebuild manually. Is the index rebuild kind of a "stop-the-world" operation, so that BaseX will become unresponsive or will it be done in parallel. What are the benefits of the indices, can I live without them? -- Antoni Myłka Software Engineer basis06 AG, Birkenweg 61, CH-3013 Bern - Fon +41 31 311 32 22 http://www.basis06.ch - source of smart business ----- Ursprüngliche Mail ----- Von: "Christian Grün" <christian.gruen(a)gmail.com> An: "Antoni Mylka" <amy(a)basis06.ch> Gesendet: Dienstag, 20. November 2012 16:46:30 Betreff: Re: [basex-talk] Database corruption Hi Antoni, > I'll also try to run an experiment without UPDINDEX. yes, this would be interesting. I did some more testing with the given queries, but couldn’t encounter something noteworthy so far.. Thanks, Christian

2 3

HTTP module - authorization
by Hans-Juergen Rennau 23 Nov '12

23 Nov '12

Hello, I have a question about the HTTP module and authorization. Is digest authorization supported, or is it only possible to provide basic access authorization? Thank you, Hans-Juergen

2 1

Re: [basex-talk] Unable to integrate with oxygen to run xquery
by Charles Foster 23 Nov '12

23 Nov '12

Hi Alex, Have you tried using BaseX XQJ 1.2.3 [1]? I suggest downloading the zip file on the xqj.net site and giving Oxygen all of the jars contained within the zip. The XQDataSource class you will need to use within Oxygen is "net.xqj.basex.BaseXXQDataSource", if you have further problems, please let me know. Regards, Charles [1] http://xqj.net/basex > Hi Michael, > > I'm seeing that I was doing things in a way that probably was not > recommended. > > I had: > > 1. installed jetty sudo yum install jetty > 2. downloaded the war file to /usr/share/jetty/webapps/BaseX73.war > 3. Create context xml here /usr/share/jetty/contexts/contexts/BaseX73.xml > 4. started the server cd /usr/share/jetty/ and java -jar start.jar > > This gave me access through at 8080 and I've been loading data using curl > calls without issue. I had been using the jar file standalone and so I > thought using the war file in a similar way would be fine. I suppose it > might but I could not connect using oxygen this way. > > I've since changed my approach to using the complete basex distribution > although I've run into a few other issues. I suppose the first was that > oxygen was asking for woodstox-core jars so I downloaded those and added > them to the lib directory. Secondly the complete distribution doesn't come > with the basex-xqj-0.9.2.jar so I've put that into the lib with the other > jars, it makes me wonder though if the instructions "Add the following JAR > files above with the *Add* Button: xqj-api-1.0.jar, xqj2-0.0.1.jar and > basex-xqj-0.9.2.jar (the version names of the JAR file may differ) " are > accurate give only the first 2 files are included in the zip. > > Finally now I'm getting an error "Description: Could not initialize class > net.xqj.basex.bin.m" I'm not sure how to resolve this one although I > assume I'm missing something. > > I've started the server using the gui, loaded files into a db and used the > gui server administration interface to start the server. > > Thoughts? > > Thanks Much > Alex

2 2

try catch with return?
by bryan rasmussen 23 Nov '12

23 Nov '12

Hi, I'm getting the following: Error: Stopped at line 1, column 73: [XPST0003] Expecting 'where', 'order' or 'return' expression. Query: for $doc in db:open('dk') let $dates := $doc//DATO for $date in $dates try{ return <gooddate>{xs:date($date)}</gooddate> } catch *{ return <baddate docid="{$doc/*/@ID}">{$date}</baddate>} I wanted to basically to return all DATO elements with document ids that were not valid xs dates, and figured a try catch with returns in it were the best option. Is that not allowed or have I made some basic error? If it's not allowed how would you handle it? Note it is not really realistic to do something like catch these errors in validation since they've already been past the validation process, first I'd have to do a lot of work to write a schema that handled the document structure since there are a lot of mixed content possibilities (or add new validation language etc.), second I'd have to have it in my validation pipeline and the several hundred thousand large documents would have to be run through the pipeline again just to find a few thousand malformed dates that anyway are currently not used for anything important (but of course if we make them valid date then they can start being used for stuff) at any rate handling it with XQuery seems the best solution. Thanks, Bryan Rasmussen

2 1

FLWOR window clause
by Hans-Juergen Rennau 23 Nov '12

23 Nov '12

Hello, are there already any plans for implementing the XQuery 3.0 feature "window clause in FLWOR expressions"? It seems to me so interesting as it allows the creation and evaluation of "self describing item streams", that is, streams of XDM items with interspersed control items which define and annotate sub units (windows) of the stream total, thus effectively translate the stream of items into a stream of larger units, in analogy to XML tags which translate a stream of characters into a stream of information items... Thank you, Hans-Juergen

2 1

ASSALAMUALAIKUM
by Surina Binti Abdul Majid 22 Nov '12

22 Nov '12

Salam, Saya Surina Binti Abdul Majid dan sekarang bekerja di London sebagai Pegawai Pemasaran (Marketing Officer) di sebuah syarikat pemprosesan batu permata di London.Untuk pengetahuan anda terdapat peluang perniagaan yang hendak saya perkenalkan dan keuntungannya akan diperolehi daripada kerjasama dan bantuan segera yang saya perlukan daripada anda. Saya menghubungi anda kerana saya tidak mahu lepaskan peluang yang ada di dalam syarikat kami buat masa ini dan juga pada masa hadapan. Saya perlukan anda sebagai pembekal (supplier/agent) kepada syarikat kami supaya kita boleh sama-sama merebut peluang perniagaan yang terbuka sekarang ini. Syarikat kami memerlukan produk bernama (TATALITE SUPPLE). Produk Tatalite Supple ini merupakan bahan cecair kimia saintifik yang baru dan merupakan pelincir yang digunakan di dalam makmal permata (gemological laboratory) untuk rawatan penulenan berlian (purification of diamonds clarity treatment). Pelincir yang digunakan semasa rawatan tersebut akan menembusi jauh ke dalam berlian dan semua kotoran hitam kecil di dalam berlian dan batu permata akan meruap keluar. Pembekal utama produk ini berada di Malaysia tetapi pembekal produk terus kepada syarikat kami telah mengalami kemalangan dan meninggal dunia di UK, beliau merupakan Pengurus Pemasaran (Marketing Manager) dan semenjak kemalangan tersebut, monopoli perniagaan telah terputus. Sesiapapun boleh membekalkan produk dan bergabung untuk membuat perkongsian dengan syarikat kami dan ini adalah sebabnya saya menulis email kepada anda untuk meminta bantuan, di mana saya memerlukan anda untuk bertindak sebagai ejen perantara yang akan mengisi kekosongan di antara pembekal utama dan pembeli iaitu syarikat kami. Ini adalah perniagaan yang besar dan akan memberikan dividen yang baik kepada kita berdua. Saya hanya memerlukan kerjasama anda untuk menjadikan perniagaan ini berjaya. Maklumat lanjut akan saya berikan sekiranya anda sanggup menjadi ejen yang membekalkan produk ini kepada syarikat kami. Pertama, saya akan mendapatkan satu perjanjian bekalan kontrak untuk anda sebagai pembekal kepada syarikat di mana saya bekerja. Berdasarkan peratusan, harga belian produk daripada syarikat adalah 4,000.00 USD per karton, manakala di Malaysia harga jualan produk adalah 2,100 USD. Jumlah yang diperlukan oleh syarikat adalah tidak kurang daripada 200 karton. Tujuan mengapa saya mahu anda untuk menjadi ejen kami adalah untuk menjadi pautan yang menghubungkan penjual tempatan di Malaysia secara langsung kepada syarikat yang membeli. Maka margin keuntungan akan dikongsi oleh kita berdua 60% untuk anda manakala 40% untuk saya. Bantuan utama yang diperlukan daripada anda adalah supaya anda memberitahu kepada pengurus saya bahawa anda boleh membekalkan produk ini kepada syarikat kami dan juga untuk mendalami butiran tentang harga dan cara bayaran. Kemudian, kami akan ambil langkah selanjutnya daripada situ. Hubungi saya setelah terima emel ini supaya saya boleh berikan nama dan butiran pembekal utama di Malaysia. Setelah menerima butiran pembekal utama ini, anda perlu menghubungi pembekal tersebut untuk bertanya samada, sekarang ada stok atau tidak untuk bekalan segera kepada kamu, sebelum saya maklumkan kepada Pengarah Syarikat (Company Director) kami tentang anda. Seterusnya Pengarah Syarikat akan hubungi anda dan membuat persediaan kepada Pengurus Pembelian (Purchasing Manager) terbang ke Malaysia. Purchasing Manager ini akan membeli produk daripada anda dan bayaran adalah secara tunai melalui bank di Malaysia. Harap boleh balas dengan segera. Sekian Surina

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk