BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5269 discussions

Hierarchy of databases
by Vincent Vandeghinste 30 Sep '14

30 Sep '14

We have set up a system in which we have about 17 million BaseX databases, but my operating system does not allow 17 million subdirectories in one directory ( the one set in the .basex file). In order to resolve this, we had to set up four (4) BaseX servers on four different machines so we could resolve this. Depending on the name of the BaseX database, we know on which BaseX server we have to look. As this is a work around, it would be nice to have either the possibility to have a hierarchy of databases, so we can store them into more manageable directories, or to allow to run more than one BaseX server onto a single machine (for instance, listening on different ports). For more info on the reasons why we did this: Vandeghinste and Augustinus (2014). Making Large Treebanks Searchable. The SONAR case. In Marc Kupietz, Hanno Biber, Harald Lüngen, Piotr Bański, Evelyn Breiteneder, Karlheinz Mörth, Andreas Witt, Jani Takhsha (eds.), Proceedings of the 2nd workshop on Challenges in the management of large corpora (CMLC-2) at the Ninth International Conference on Language Resources and Evaluation (LREC). Reykjavik, Iceland. pp. 15-20. Is there another way to solve this? thanks, v.

2 1

Changing the C# BasexClient.cs
by Nilanjan Dutta 30 Sep '14

30 Sep '14

Hi All, I want to change/overload the implementation private void Send (Stream s) method in the BaseXClient.cs file. [ basex <https://github.com/BaseXdb/basex> / basex-api <https://github.com/BaseXdb/basex/tree/master/basex-api> / src <https://github.com/BaseXdb/basex/tree/master/basex-api/src> / main <https://github.com/BaseXdb/basex/tree/master/basex-api/src/main> / c# <https://github.com/BaseXdb/basex/tree/master/basex-api/src/main/c%23> / *BaseXClient.cs*] *Existing implementation:* private void Send(Stream s) { while (true) { int t = s.ReadByte(); if (t == -1) break; if (t == 0x00 || t == 0xFF) stream.WriteByte(Convert.ToByte(0xFF )); stream.WriteByte(Convert.ToByte(t)); } stream.WriteByte(0); info = Receive(); if(!Ok()) { throw new IOException(info); } } *What I want it to be:* [image: Inline image 1] This one is faster for my use case. Please do let me know how can this be done? Regards, N.D.

4 9

strange webdav behaviour...
by Maud Ingarao 29 Sep '14

29 Sep '14

Hello, We upgrated recently to 7.9 and are experiencing some problems : we get lots of time out and 502 errors when launching heavy queries which used to complete before. then BaseX is totally unavailable and the restart is difficult, some files get corrupted etc. And we discovered a few strange things : - webdav locks seem never to unlock - we had to increase the number of authorized webdav threads and put a restart cron every night otherwise the whole BaseX is becoming unavailable after a few days. - the webdav log file webdav/txt.basex's size quickly increases to an incoherent 4go... It seems that nobody else reported webdav problems, so we really wonder what's wrong with us... All the best :) Maud -- /« Ne travaillez jamais »/ *Maud Ingarao* IHPC (UMR 5037) Institut d’histoire de la pensée classique, de l’Humanisme aux Lumières Ecole Normale Supérieure de Lyon - Site Descartes - Bureau R322 15 Parvis René Descartes - BP7000 - 69342 Lyon CEDEX 07 +33 4 37 37 65 79 - maud.ingarao(a)ens-lyon.fr /Je suis absente le jeudi | Out of office on Thursdays/ http://pensee-classique.ens-lyon.fr http://institutdesanti.ens-lyon.fr http://ahn.ens-lyon.fr http://www.mutec-shs.fr http://cahier.hypotheses.org

2 4

Beginner having trouble starting the HTTP server
by spaelti 29 Sep '14

29 Sep '14

I have tried installing BaseX (both 7.9 and 8 beta) on two machines (both macs) and the GUI works fine. I have now tried following the instructions in “BaseX for dummies” and am having difficulties, when I try to run the HTTP server. On one machine I get the following message: /usr/local/bin/basexhttp: line 11: cd: /usr/local/Cellar/basex/7.9/libexec/../basex: No such file or directory BaseX 7.9 [Server] Server was started (port: 1984) HTTP Server was started (port: 8984) The server seems to be running, but the browser gives me a 404 with this message: HTTP ERROR 404 Problem accessing /. Reason: No function found that matches the request. Powered by Jetty:// “BaseX for dummies” writes: “ … move all the files in the BaseX folder that you modified after installing BaseX … to another location and try again” What does that mean? Where should I move these files to? I didn’t modify any files after installing BaseX. On the other machine, I simply get the message: “command not found” in response to the command “basexhttp”, even though I am in the bin folder and the basexhttp script is present and executable. Any suggestions about what I could try next would be welcome. best Philip Spaelti spaelti(a)mac.com

1 1

Text Index just over some elements
by Oscar Herrera 29 Sep '14

29 Sep '14

Hi, I'm trying to tune my BaseX with a text index only over certain elements, is that possible?, what I have found so far is to create a text index, but I have plenty of nodes on my documents that don't need to be indexed since is very unlikely that a search over that value will occur. So, is there any way in which I can create a text index only over certain elements and not all of them?, if not, is this planned on a near future? Thank you, Oscar H

3 5

Portable database files
by Nilanjan Dutta 26 Sep '14

26 Sep '14

Hello Team, In our project we are planning to use BaseX as XML DB. My main concern is, we don't want to create DB again and again to different machines with same XML file as input and would like to reuse the DB that we'd generate in a server. I see in the "data" directory of my BaseX installation these files are generated when I create a DB by importing an XML: [image: Inline image 1] Would like to know if these can be zipped and ported into different machines and can be used to recreate the DB. Please do let me know how this can be done . Regards, N ilanjan Dutta

3 15

Multi threaded application
by Bondeson, Carl 25 Sep '14

25 Sep '14

I have using BaseX in a canonical manner to handle the many translations used in ELR systems. I won't get into specifics but it has been working well. I started looking into the use of a singleton database object in place of the many ClientSession objects created in the constructor of the associated classes. In a single thread the performance varied between a 2x and 5x decrease. That would be expected since the amount of i/o required to load the XML would be replaced by simply executing queries against the database. The application that is utilizing BaseX is multithreaded. Once I deployed the application in JBoss I continue to receive exceptions: Exception: Unknown Query ID: These class methods are "synchronized" and are being invoked via Xalan callouts from XSLT. I am currently using version 7.9 from the Maven repository. Is BaseX thread safe in this manner? Carl R Bondeson Systems Developer Department of Public Health Data Processing 410 Capitol Ave Hartford, CT 06134 Phone: 860-509-7434 carl.bondeson(a)ct.gov<mailto:carl.bondeson@ct.gov> [cid:image001.jpg@01CFD286.0424E090]<http://www.ct.gov/dph>

2 7

Re: [basex-talk] Ways of Connecting to basex
by Dirk Kirsten 24 Sep '14

24 Sep '14

Hello Furqan, please keep in mind to always include the mailing list in the list of recipients, as others might also benefit from your questions. Also, other people might have much better answers than I can give you. Sure you can use a network sniffer to listen to the traffic to/from a BaseX server. It is a standard TCP connection, so this is certainly possible. Just give it a try. The same holds for using a proxy: It is a very conventional TCP connection, so using a proxy shouldn't be a problem. Nginx should works as well, I guess (although I am by no means an expert in nginx). We have used it quite some times for projects using RestXQ to load-balance requests. How to actually achieve that heavily depends on the proxy you decide to use, so you might have to read up there how to do it in detail. Cheers, Dirk On 23/09/14 13:13, Furqan Khan wrote: > Derk,just a little quick question > if the using tcp/ip,so assuming my web server is on same machine port 8000 > and the basex server is also on same machine port 1984, > then will it be possible to use a packet sniffer such as wire shark to see > all incoming packets to the baseX-db port 1984... > Further more,is it possible for me to use a reverse proxy in front of basex > server (a web proxy such as nginx may not work)..,so that i may evaluate > incoming packets and trigger my script(java or lua) just as mysql has come > up with mysql proxy as a db-proxy(wh invokes lua scripts),is their any such > option available with basex or any such third party tool that could be > used...i further need to invoke a script,so its not only for analysis > purpose.... > thanks and regards > Furqan > > > On Tue, Sep 23, 2014 at 1:50 PM, Furqan Khan <furqankhan08(a)gmail.com> wrote: > >> thanks for the reply >> cheers >> furqan >> >> On Tue, Sep 23, 2014 at 1:16 PM, Dirk Kirsten <dk(a)basex.org> wrote: >> >>> Hello Furqan, >>> >>> welcome to the wonderful world of XML databases ;) >>> >>> Right now, BaseX only supports TCP/IP for client connect. So by >>> definition it will always be used as default. >>> The details of our server protocol can be found at >>> https://docs.basex.org/wiki/Server_Protocol >>> >>> Cheers, >>> Dirk >>> >>> On 23/09/14 07:27, Furqan Khan wrote: >>>> Hi >>>> i m a little new to xml-db environment. >>>> i need to know what are the possible ways to connect to baseX from >>> client >>>> api's. >>>> just like in sql the clients could connect to db using : >>>> 1)named pipes >>>> 2)shared memory >>>> 3)tcp and etc... >>>> >>>> Does basex offer all the functionalists... >>>> and by default whats the way a client connects,if the tcp connection is >>> not >>>> explicitly specified... >>>> >>>> regards >>>> Furqan >>>> >>> >>> -- >>> Dirk Kirsten, BaseX GmbH, http://basex.org >>> |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz >>> |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: >>> | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle >>> `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 >>> >> >> > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

2 3

Adding documents slows over time
by Gerald de Jong 24 Sep '14

24 Sep '14

I'm finding that adding documents to a database starts at about 1ms, but gradually gets slower (5ms after about 700,000). I'm doing this with autoflush off, and I've tried periodic flush an optimize commands but they have no effect. Is this expected behavior? Is there any way to keep it speedy? -- Delving BV, Vasteland 8, Rotterdam http://www.delving.eu http://twitter.com/fluxe skype: beautifulcode +31629339805

4 25

Getting some double files
by France Baril 23 Sep '14

23 Sep '14

Hi, We are editing files from Oxygen using a webDAV connection. For an unknown reason, we sometimes get a double update (or an update with an add?). The result is that we get a physical file with a double xml document (double root). The content in the 2 root nodes is always the same, and always has the correct/latest corrections made by content editors. Ex. <root id="doc1"><content>Our latest changes</content></root> <root id="doc1"><content>Our latest changes</content></root> Do you have any clue as to why this is happening? Any idea to prevent the behavior? Note that this is not a new issue, we have just always worked around it with a quick repair function. We though we would find the cause at some point and be able to fix it ourselves, but the issue is sticking around. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk