BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5250 discussions

basex client can't connect: Can't communicate with the server.
by Paul Collins 18 Jun '13

18 Jun '13

Hi, I use basex on Debian wheezy with Oracle Java version 1.6.0_43. Whenever I try to connect to the basex server the client tells me "Can't communicate with the server." If I enable a netcat server on port 2000 for test reasons and run wireshark in order to capture the traffic I get no traffic on port 2000, not even the TCP three way handshake by running this command: java -cp BaseX77.jar org.basex.BaseXClient -p2000 -n localhost -d Do you have any suggestions why as far as I can see the basex client doesn't even try to connect to port 2000 on localhost but just prints that it can't communicate with the server? Best regards, Paul

3 7

bug in processing XPATH with this simple regular expression?
by Imbuter Imb 17 Jun '13

17 Jun '13

Take this input: <div id="ps-content">foobar</div> and apply this XPATH 2+: //div[matches(@id,"^s-content$")] In BaseX command-line it matched! despite the fact that "^" in regex language means "the start of the string". With Saxon and Xidel command-line it correctly doesn't match. Why does it match in BaseX?

2 1

An inconvenient truth . . ?
by Christopher.R.Ball 15 Jun '13

15 Jun '13

Am I correct in assuming I have hit a dreaded limit of BaseX when I see the output below? Which I presume may be the node limit (2,147,483,648) . . ? As I am dealing with 689,701 Files in 814,855 Folders which amounts to 5.32 GB on disk. (I am running BaseX 7.7) If so, then are then any automated ways of having BaseX automatically start feeding to a second instance? It would be nice to NOT have to manually partition the content in advance. Thoughts? ..................................;...................................;...............................;................. .......;.......;......;.......;.............;.................org.basex.build.BuildException: "825646564637.xml" (Line 3 5100): Input is too large for a single database. at org.basex.build.Builder.limit(Builder.java:327) at org.basex.build.Builder.addElem(Builder.java:315) at org.basex.build.Builder.openElem(Builder.java:111) at org.basex.build.xml.XMLParser.parseTag(XMLParser.java:176) at org.basex.build.xml.XMLParser.parse(XMLParser.java:88) at org.basex.build.SingleParser.parse(SingleParser.java:33) at org.basex.build.DirParser.parseResource(DirParser.java:180) at org.basex.build.DirParser.parse(DirParser.java:110) at org.basex.build.DirParser.parse(DirParser.java:90) at org.basex.build.DirParser.parse(DirParser.java:90) at org.basex.build.DirParser.parse(DirParser.java:90) at org.basex.build.DirParser.parse(DirParser.java:90) at org.basex.build.DirParser.parse(DirParser.java:90) at org.basex.build.DirParser.parse(DirParser.java:79) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.DiskBuilder.build(DiskBuilder.java:90) at org.basex.build.DiskBuilder.build(DiskBuilder.java:1) at org.basex.core.cmd.Add.run(Add.java:103) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.server.LocalSession.execute(LocalSession.java:122) at org.basex.server.Session.execute(Session.java:37) at org.basex.core.Main.execute(Main.java:146) at org.basex.core.Main.execute(Main.java:130) at org.basex.core.Main.execute(Main.java:117) at org.basex.BaseX.<init>(BaseX.java:79) at org.basex.BaseX.main(BaseX.java:39)

2 1

Doubtful question on xquery:eval ...
by Marco Lettere 14 Jun '13

14 Jun '13

Hello all, I just would like to know if this wanted or not ... When I run the following query in the GUI with all databases closed for $rvs at $pos in collection('examples/valuesets/resolved') return $rvs it returns the correct dataset. The same query put into an xquery:eval xquery:eval("for $rvs at $pos in collection('examples/valuesets/resolved') return $rvs") gives a result if the database "examples" has been opened. With no open database I get an error message "Improper use or potential bug ...." and the console the GUI is running in return the following stacktrace: java.io.IOException: Stream Closed java.io.RandomAccessFile.seek(Native Method) org.basex.io.random.DataAccess.cursor(DataAccess.java:229) org.basex.io.random.DataAccess.readToken(DataAccess.java:168) org.basex.data.DiskData.txt(DiskData.java:267) org.basex.data.DiskData.text(DiskData.java:235) org.basex.io.serial.Serializer.node(Serializer.java:389) org.basex.io.serial.Serializer.serialize(Serializer.java:99) org.basex.io.serial.Serializer.serialize(Serializer.java:84) org.basex.query.iter.ValueBuilder.serialize(ValueBuilder.java:80) org.basex.query.iter.ValueBuilder.serialize(ValueBuilder.java:75) org.basex.core.cmd.AQuery.query(AQuery.java:80) org.basex.core.cmd.XQuery.run(XQuery.java:22) org.basex.core.Command.run(Command.java:342) org.basex.core.Command.exec(Command.java:321) org.basex.core.Command.execute(Command.java:78) org.basex.gui.GUI.exec(GUI.java:397) org.basex.gui.GUI$7.run(GUI.java:349)

2 6

XQuery to insert nodes in XML File
by John Best 14 Jun '13

14 Jun '13

Dear Team, I am trying to insert few nodes in a XML File. But in reality the nodes are not inserting in the XML File!! Below is my query for $x in doc('C:\sample.xml')//CInfos return insert node <Info><Name>James Stuart</Name><Key>7709422869</Key></Info> as last into $x I tried with another query - insert node <Info> <Name>James Stuart</Name> <Key>7709422869</Key> </Info> as last into doc('C:\sample.xml')//CInfos This too not working If I create a XML DB and then it works... What am I missing? -- Have a nice day JBest

3 2

Re: [basex-talk] Java DOM Interface and updating XQueries
by Ingo Dengler 13 Jun '13

13 Jun '13

Hi Christian, the problem also exists with DBNode, isn't it? DBNode internally stores the pre of the node at time of instantiation of the object. After an update of DB the internally stored pre points to a wrong node. Of course one could use the ID of DBNode and use db:open-id(id) to get a new DBNode with correct pre. But this approach doesn't work with DOM API. My question is, is there a possible solution that allows me to use DOM interface (We need DOM, because we want to use BaseX to replace an old DOM based parser class without reimplementing everything) and updating expressions? Best regards, Ingo > Hi Ingo, > > as you correctly observed, we are using 'pre' values to organize nodes > in our database, which will change after updates (see [1] for further > details on pre and id values and the id/pre mapping). It is generally > possible to use our DOM interface, but I’m inclined to recommend you > the database functions db:open-pre() and db:node-pre(). If you perform > updates, db:open-id() and db:node-id() and the UPDINDEX option will > help you [2]. You could also work with the DBNode instances, which are > returned by the query processor, as this will be much faster than > using the DOM wrapper, but it may take more time to get acquainted > with the internal node interface. > > Regards, > Christian > > [1] http://docs.basex.org/wiki/Node_Storage#PRE_Value > [2] http://docs.basex.org/wiki/Database_Module#db:open-pre[http://docs.basex.or…

2 1

BaseX Script memory leak . . ?
by Christopher.R.Ball 12 Jun '13

12 Jun '13

I have a BaseX script (.bxs) I am running that does queries in batches (sets of 5k documents), but as it progresses it bogs down in speed, does not release memory between sets even if I force it to close and reopen the db between queries, and eventually runs out of memory. But, if I break the same BaseX script into separate files still doing the same exact batches it is extremely fast and memory efficient. Very suggestive of a memory leak . . . I am running on BaseX 7.6.1 Beta. Any thoughts? Is there a way to force the script to do garbage collection?

5 7

Java DOM Interface and updating XQueries
by Ingo Dengler 12 Jun '13

12 Jun '13

2 1

Loading Large xml file in DB taking long time
by Pushpendra Singh Sengar 12 Jun '13

12 Jun '13

Hi, I am loading 5GB xml in DB it takes around 10-12 minutes. I need to load about 20-30 document of same size (5Gb) , So i created thread to loading these document in DB but its taking too much time ,I wait till 4 hrs after that I stop process to load document . Pls tell me the best solution to loading large document. my program is following : package org.basex.examples.query; import java.io.*; import javax.xml.namespace.*; import org.basex.build.*; import org.basex.core.*; import org.basex.core.cmd.*; import org.xml.sax.Parser; /** * This class demonstrates collection relevant queries. * It shows how to find and query specific documents. * * @author BaseX Team 2005-12, BSD License */ public final class QueryCollection implements Runnable{ Context context = new Context(); String dbName = null; public QueryCollection(String string) { dbName = string; } /** * Runs the example code. * @param args (ignored) command-line arguments * @throws BaseXException if a database command fails * @throws XQException */ public static void main(final String[] args) throws BaseXException { /** Database context. */ Context context = new Context(); System.out.println("=== QueryCollection ==="); // ------------------------------------------------------------------------ // Create a collection from all XML documents in the specified directory System.out.println("\n* Create a collection."); System.out.println(System.currentTimeMillis()/1000); Thread thread = new Thread(new QueryCollection("Collection1")); Thread thread1 = new Thread(new QueryCollection("Collection2")); Thread thread2 = new Thread(new QueryCollection("Collection3")); Thread thread3 = new Thread(new QueryCollection("Collection4")); Thread thread4 = new Thread(new QueryCollection("Collection5")); thread.start(); thread1.start(); thread2.start(); thread3.start(); thread4.start(); OutputStream outputStream =null; try { outputStream = new FileOutputStream(new File("result.xml")); } catch(FileNotFoundException e) { // TODO Auto-generated catch block e.printStackTrace(); } // ------------------------------------------------------------------------ // Evaluate a query on a single document System.out.println(System.currentTimeMillis()/1000); // new DropDB("Collection").execute(context); // ------------------------------------------------------------------------ // Close the database context context.close(); } public void createDB(String dbName){ // TODO Auto-generated constructor stub new CreateDB(dbName, "E:/downloads/temp/test.xml").run(context); } @Override public void run() { // TODO Auto-generated method stub System.out.println(dbName+" start time : "+System.currentTimeMillis()/1000); createDB(dbName); System.out.println(dbName+" end time : "+System.currentTimeMillis()/1000); } } -- Thanks & Regards , Pushpendra Singh

2 1

Binding variables in scripts (bxs)
by Wendell Piez 12 Jun '13

12 Jun '13

Hi, I'm sure you will forgive me if this is as dumb as I'm afraid it might be ... trying to cover all possibilities here. We recently upgraded (now on 7.7beta) and external scripts stopped working as expected -- variable bindings of the form SET BINDINGS $db=my-db,$start=20001,$count=10000 no longer had any effect. Instead, the logic fell back to use values declared for the variables in the XQuery, which had: declare variable $db := 'your-db'; declare variable $start := 1; declare variable $count := 1000; etc. When we removed the declarations from the XQuery, things started working again. (Note that my assumption of a causal relation here could be wrong.) Should I never have put those declarations in to begin with (even as defaults, a la XSLT parameter declarations)? Is this a BaseX question or an XQuery question? I would like to become enlightened. Thanks as ever, Wendell -- Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^

3 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk