BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Connection refused
by Mh Djamila 03 May '15

03 May '15

Hi I have created in BaseX 8.1 a huge database named 'dblp'(~1,5 Go) and I am trying to communicate with it from Java (Eclipse IDE). I have used the Example.java and BaseXClient.java classes provided in BaseX documentation (basex-examples) in order to connect to the BaseX server try { // initialize timer final long time = System.nanoTime(); // create session final BaseXClient session = new BaseXClient("localhost", 1984, "admin", "admin"); // version 1: perform command and print returned string System.out.println(session.execute("info")); // version 2 (faster): perform command and pass on result to output stream final OutputStream out = System.out; session.execute("xquery 1 to 10", out); // close session session.close(); // print time needed final double ms = (System.nanoTime() - time) / 1000000d; System.out.println("\n\n" + ms + " ms"); } catch(final IOException ex) { // print exception ex.printStackTrace(); } But the connection is always refused. The console shows this error java.net.ConnectException: Connection refused: connect at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method) at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source) at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source) at java.net.AbstractPlainSocketImpl.connect(Unknown Source) at java.net.PlainSocketImpl.connect(Unknown Source) at java.net.SocksSocketImpl.connect(Unknown Source) at java.net.Socket.connect(Unknown Source) at dblp.BaseXClient.<init>(BaseXClient.java:47) at dblp.Example.main(Example.java:24) So could you please show me where is the problem? Thank you in advance

2 1

BaseX trace() output
by cmarchand＠oxiane.com 30 Apr '15

30 Apr '15

in basexGui, running trace((),'foo') displays this in Info panel : Evaluating: - fooempty-sequence() Query: trace((),'foo') Result: - Hit(s): 0 Items - Updated: 0 Items - Printed: 0 Bytes - Read Locking: none - Write Locking: none Timing: - Parsing: 0.75 ms - Compiling: 0.05 ms - Evaluating: 0.35 ms - Printing: 0.27 ms - Total Time: 1.43 ms Query plan: <QueryPlan> <FNInfo name="trace(value,label)"> <Empty size="0"/> <Str value="foo" type="xs:string"/> </FNInfo> </QueryPlan> There is no output, but in the query plan. Is this what is expected ? Le 2015-04-30 12:00, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk [1] > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > Today's Topics: > > 1. Re: Database files across multiple directories > (julia.jacobson(a)arcor.de) > 2. Re: Database files across multiple directories (Christian Gr?n) > 3. Re: Where are the debugging infos emit by trace(...) > (Christian Gr?n) > 4. Re: Database files across multiple directories (Goetz Heller) > 5. Running commands on BaseX on Tomcat (Kristian Kankainen) > 6. Re: Running commands on BaseX on Tomcat (Christian Gr?n) > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 29 Apr 2015 17:59:53 +0200 (CEST) > From: julia.jacobson(a)arcor.de > To: basex-talk(a)mailman.uni-konstanz.de > Cc: heller(a)hellerim.de > Subject: Re: [basex-talk] Database files across multiple directories > Message-ID: > <1680192231.162639.1430323193071.JavaMail.ngmail(a)webmail22.arcor-online.net> > > Content-Type: text/plain; charset=ISO-8859-1 > > Thanks a lot for your answers so far. What I was thinking of as a use case are many small xml-Documents in many different (sub)directories that should be used together as one database, like for example one xml file for one address and address arranged into folders according to towns so one would have 9 xml files in a folder named "berlin" and 5 ones in another folder named "munich" and so on. > Does BaseX create an index of these files so that I could for example query for example for persons with the same name? If I want to change something in these files, will the changes be also made in the xml documents? > > Kind regards, > Julia > > ------------------------------ > > Message: 2 > Date: Wed, 29 Apr 2015 18:14:56 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: julia.jacobson(a)arcor.de > Cc: Goetz Heller <heller(a)hellerim.de>, BaseX > <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Database files across multiple directories > Message-ID: > <CAP94bnMhv9j1CNP0x-ovEh-jAH-6gT=Xydk48mtU+mynLQQZoQ(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi Julia, > >> Does BaseX create an index of these files so that I could for example query for example > for persons with the same name? > > BaseX will create a database from these files. This can e.g. be done > by starting the GUI, choosing "Database" ? "New?", selecting your XML > directory, and pressing OK. > > All documents will then be stored, and the textual contents will be > indexed. Next, you can use XQuery, which is not only a query language, > but a powerful programming language, to do all kinds of things with > the data. See e.g. [1 [2]] or [2 [3]] for some examples. You probably don't > want to do that by yourself, but XQuery can be used to write full web > applications. > >> If I want to change something in these files, will the changes be also made in the xml documents? > > Currently, there is no automatic synchronisation between databases and > local file directories, so you'll either have to export the database > after updates, or create a new database after files have been changed. > > Cheers, > Christian > > [1] http://docs.basex.org/wiki/XQuery_3.0 [4] > [2] http://www.w3schools.com/xquery/ [3] > > If I want to change something in these files, will the changes be > also made in the xml documents? > >> Kind regards, >> Julia > > ------------------------------ > > Message: 3 > Date: Wed, 29 Apr 2015 18:25:21 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: cmarchand <cmarchand(a)oxiane.com> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Where are the debugging infos emit by > trace(...) > Message-ID: > <CAP94bnMnA7Sb6LbRHpi0fLp-ODpqr-XmR0munVVN8Jqh8z2G4w(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi Christophe, > >> I'm looking for the trace() output in gui and server mode... I've checked >> System.out / System.err, but nothing. > > In the client/server mode, trace output will be redirected to the > client (try -V on command-line, or use SET QUERYINFO ON and > query.info() when using one of the bindings). In the GUI, the output > wil be visible in the Info panel. > > Hope this helps, > C. > > ------------------------------ > > Message: 4 > Date: Wed, 29 Apr 2015 19:37:47 +0200 > From: "Goetz Heller" <heller(a)hellerim.de> > To: <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Database files across multiple directories > Message-ID: <00ec01d082a3$35b09730$a111c590$(a)hellerim.de> > Content-Type: text/plain; charset="iso-8859-1" > > Hi Julia, > this looks to me as if you had hybrid data - some relational (tabular) data > (addresses etc.) and other semi-structured data. If so, then think about > storing the tabular data in a relational database management system (RDBMS) > like Maria SQL or MS SQL Server and accessing it from within your xQueries. > This is something which can be achieved very easily since the BaseX > implementation accommodates adding Java code to your queries simply by > dropping your jar files into the lib directory and adding a namespace > declaration to the prolog of your query - it's just a snap. You can do > anything you want with the relational data - insert, update, delete, and, of > course, select, you can run stored procedures, and still access your XML > data as easily, combine results from both sources, create great reports, and > so on. > > Think of xQuery as a domain-specific language (DSL) for querying XML data, > just as SQL is a DSL for dealing with relational data, which you can enhance > according to your needs. > > If you need to modify only the relational part of the data, you can do this > easily via the RDBMS since this is standard, and BaseX still remains the > perfect choice for handling the XML part of your data. Although many RDBMSs > offer also some XML and even xQuery functionality, compared to a system like > BaseX this is only rudimentary. E.g. Oracle and SQL Server implement only > xQuery 1.0, and even this only partially. > > I did something similar with BaseX and SQL Server, and - just as a proof of > concept - also with Oracle. E.g., you can create SQL code with xQuery on the > fly so it incorporates current context data, and pass it to some generic > database access function. With JDBC, you've got the glue to connect to a > wide range of database servers. > > I did not figure out whether you can make a database server and BaseX > participate in the same distributed transaction because I had no necessity > to do so; maybe Christian can tell you something more about it. > > Kind regards, > > Goetz > > -----Urspr?ngliche Nachricht----- > Von: julia.jacobson(a)arcor.de [mailto:julia.jacobson@arcor.de] > Gesendet: Mittwoch, 29. April 2015 18:00 > An: basex-talk(a)mailman.uni-konstanz.de > Cc: heller(a)hellerim.de > Betreff: Re: [basex-talk] Database files across multiple directories > > Thanks a lot for your answers so far. What I was thinking of as a use case > are many small xml-Documents in many different (sub)directories that should > be used together as one database, like for example one xml file for one > address and address arranged into folders according to towns so one would > have 9 xml files in a folder named "berlin" and 5 ones in another folder > named "munich" and so on. > Does BaseX create an index of these files so that I could for example query > for example for persons with the same name? If I want to change something in > these files, will the changes be also made in the xml documents? > > Kind regards, > Julia > > ------------------------------ > > Message: 5 > Date: Thu, 30 Apr 2015 10:12:23 +0300 > From: Kristian Kankainen <kristian(a)keeleleek.ee> > To: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] Running commands on BaseX on Tomcat > Message-ID: <5541D5D7.5000301(a)keeleleek.ee> > Content-Type: text/plain; charset=utf-8; format=flowed > > Hello! > > I have BaseX 8.11 running on Tomcat and need to execute some commands or > XQuery for deploying xml files from elsewhere. I allready have a XQuery > function for this and can do it on my local setup using for example the > basexclient. > > My problem is that the Tomcat is available only through HTTP and I > wouldn't like to open up the function for the outside world using > RESTXQ. Is there a way to "talk" with the BaseX in the Tomcat? I have > full access to the machine via SSH. Another way I thought of would be to > just upload the data folder from my local setup, but it doesn't feel the > right way to do it. > > Best regards > Kristian K > > ------------------------------ > > Message: 6 > Date: Thu, 30 Apr 2015 10:47:23 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: Kristian Kankainen <kristian(a)keeleleek.ee> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Running commands on BaseX on Tomcat > Message-ID: > <CAP94bnNjxDFGo8ttNeE0c4v7FfYgCoDtHc=K-fDgZo=RNC65Lw(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi Kristian, > >> My problem is that the Tomcat is available only through HTTP and I wouldn't >> like to open up the function for the outside world using RESTXQ. Is there a >> way to "talk" with the BaseX in the Tomcat? > > Have you already thought about adding the DBA interface [1 [2]]? It might > be extended with new functionality to store and invoke server-side > code, and you can already use it to run arbitrary XQuery expressions. > > Another choice is our classical REST interface, which can also be used > to run server-side queries or command scripts. > > Just remember that these interfaces can potentially be accessed by > other people as well, even those who are not supposed to access it, so > you should e.g. change the default admin password, etc. > > Best, > Christian > > [1] http://docs.basex.org/wiki/DBA [2] > > I have full access to the > >> machine via SSH. Another way I thought of would be to just upload the data >> folder from my local setup, but it doesn't feel the right way to do it. >> >> Best regards >> Kristian K > > End of BaseX-Talk Digest, Vol 64, Issue 58 > ****************************************** Links: ------ [1] https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk [2] http://docs.basex.org/wiki/DBA [3] http://www.w3schools.com/xquery/ [4] http://docs.basex.org/wiki/XQuery_3.0

2 1

Re: [basex-talk] Database files across multiple directories
by Goetz Heller 29 Apr '15

29 Apr '15

Small correction; I should have said "reference each database with doc()" instead of "open each database". My apologies. Kind regards, Goetz

3 3

Where are the debugging infos emit by trace(...)
by cmarchand＠oxiane.com 29 Apr '15

29 Apr '15

!hi ! I'm looking for the trace() output in gui and server mode... I've checked System.out / System.err, but nothing. Any idea ? Christophe

2 1

] Database files across multiple directories
by Goetz Heller 29 Apr '15

29 Apr '15

Small correction; I should have said "reference each database with doc()" instead of "open each database". My apologies. Kind regards, Goetz

1 0

Re: [basex-talk] Database files across multiple directories
by Goetz Heller 29 Apr '15

29 Apr '15

Hi Julia, the Xml files I'm using are also in different directories, one for each day. I create one database on each of these directories, each containing between several hundred and up to 6000 documents. Usually, queries need to take in account only one day, so the search space is considerably smaller than for one large database. If access to documents of more than one day is required, you can create the range of database identifiers (supposing there is an algorithm to do so) and then open each database in a for loop, thus getting a sequence of top nodes. Also, for more complicated queries, I can choose to (re)create some the databases in-memory in order to improve performance. Since creating a database of this size takes just a couple of seconds, this is an approach which would possibly not be feasible if all the documents were in one huge database. Kind regards, Goetz

1 0

Reg : Map Reduce Frame Work
by Chandrasekhar 29 Apr '15

29 Apr '15

Dear Team, Information required about map reduce framework for xquery performence.Suggest us to best practice documents on this. Thanks&Regards ChandraSekhar The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.

2 1

Database files across multiple directories
by julia.jacobson＠arcor.de 28 Apr '15

28 Apr '15

Hello everybody out there using BaseX, Is there a possibility to have xml files in multiple subdirectories? I would like to sort binary files according to date into different directories and write the corresponding metadata next to them in an xml file. Alternative solutions are also appreciated. Kind regards, Julia

2 1

XLink and XPointer
by Eckey, Florian 27 Apr '15

27 Apr '15

Hello, i am actually writing my master thesis using basex for xml processing. I need to create consistency links between two xml documents, especially basex databases and its content. So I am certainly looking for xlink and xpointer implementations in basex. Are there any examples to do this with basex or if not, has anyone implemented an xquery version to execute it? I recoginzed that there are capabilities with xinclude. But I does not find any references of xinclude in basex, unless this: http://docs.basex.org/wiki/Options#XINCLUDE So has anyone ideas or experiences using xlink and especially xpointer with basex or xquery? Regards, Florian ------------------------------------------------------- >>> business. people. technology. <<< ------------------------------------------------------- adesso AG mit Sitz in Dortmund Vorstand: Michael Kenfenheuer (Co-Vors.), Dr. Rüdiger Striemer (Co-Vors.), Christoph Junge, Andreas Prenneis Vorsitzender des Aufsichtsrates: Prof. Dr. Volker Gruhn Amtsgericht Dortmund HRB 20663

2 6

Large memory basex instances
by cmarchand＠oxiane.com 25 Apr '15

25 Apr '15

Hi ! in J2EE servers, it is a performance fault to make instances with more than 2Gb Xmx, because of the GC pauses. In baseX, uge xqueries on uge databases need a lot of memory. But looking at memory consumption (Runtime.freeMemory), it appears that a lot of GC are run during a query. GC pauses are time-lost, and I'm looking for a way to accelerate queries. Does someone has experience on giving large quantities of memory (above 8Gb) to a basex server ? Does someone has experience on using no-GC-pauses JVM (like Azul Zing) with baseX ? Best regards, Christophe

3 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk