BaseX-Talk October 2012

basex-talk@mailman.uni-konstanz.de

40 participants
47 discussions

Need help on Xquery create Collection using java
by riyaz 18 Oct '12

18 Oct '12

Dear Team, This is Riyaz from Hyderabad , India. I have been using X query since one and half year. I need help on the following query. When I add xmls of 199 MB to create collection using " new Add(xmlfilepath).execute(context)" (JAVA), it is taking 440 MB on hard disk and 3 mins to complete the process. Is there any other way to reduce the size and time? Thanks a ton in advance and would appreciate the earliest response. Please help me on this. -- Thanks & Regards, Riyaz Shaik, In10^s Technologies Ltd. /"What you risk reveals what you value."/

2 2

running xquery scripts in REST server
by pw＠themail.co.uk 16 Oct '12

16 Oct '12

Hello List this is a noob question: I have BaseX 7.3 set up using httpserver. I can add a script to HTTPPATH and run it using http://{server:port}/rest?run=myScript.xq However, if I add myScript.xq to a database and try to run it then [http://{server:port}/rest/DB/myScript.xq ] then all I get returned is the XQuery script itself as a text file, the query doesn't run. >From the examples e.g. http://docs.basex.org/wiki/REST#GET_Requests_2 I thought that I am doing the same type of call, e,g, http://localhost:8984/rest/DB/mult.xq?a=21&b=2 What should I be doing? Many thanks Peter

1 0

Clusters
by Raymond Meester 16 Oct '12

16 Oct '12

Is it possible to set up a BaseX server as a clustered database (where data is synchronized over the servers by BaseX)? For example on two servers where a client session can be set up with "host1,host2". If one of the hosts fails then there is immediate fault tolerant failover to the second host (url). If this is possible is there an example available (couldn't find anything in this direction on GitHub)?

2 1

Add files to the database
by Raymond Meester 16 Oct '12

16 Oct '12

Charles, thanks for the examples. I first thought using the core API, like "new Add(doc).execute(context); ", but to get working you need conversions and ToString methods and loose the direct manipulation options. I needed a concurrent set up anyway. What I also didn't get from the core library; when using multiple instances I got a FileLockException in the stack trace (as expected), but then the general message "org.basex.core.BaseXException: Improper use? Potential bug?" was shown. Maybe an error message about the filelock and concurrency would be clearer as its not a bug. There are some databases like SQLite that support concurrency (to some extend) while directly using a OS file system, but that lead often to unexpected results (locking on network shares for example).

1 0

Upload a file to baseX server
by nestor vb 16 Oct '12

16 Oct '12

Hi everyone: I have a question, is there a way to upload a file to a baseX server? I have a c# application and I would like to upload a whole xml file to the server, is this possible? any pinpoints or recommendations? Thanks Regasts, Nestor

2 1

Replication
by David Sargeant 11 Oct '12

11 Oct '12

Does BaseX have any replication features? This would be really nice. David

2 1

Re: [basex-talk] Add files to the database
by Charles Foster 11 Oct '12

11 Oct '12

Hi Raymond, Here are some examples using the BaseX XQJ API if that helps. // ---------------------------------------------------- // Inserting a DOM Document item // ---------------------------------------------------- import javax.xml.xquery.*; import javax.xml.namespace.QName; import net.xqj.basex.BaseXXQDataSource; import javax.xml.parsers.*; import org.w3c.dom.*; import org.xml.sax.*; import java.io.*; import com.xqj2.*; public class Test { public static final Document getDocument() throws Exception { return DocumentBuilderFactory.newInstance().newDocumentBuilder(). parse(new InputSource(new StringReader("<e>Hello World</e>"))); }; public static void main(String[] args) throws Exception { XQDataSource xqs = new BaseXXQDataSource(); xqs.setProperty("serverName", "localhost"); xqs.setProperty("port", "1984"); xqs.setProperty("databaseName", "TEST"); // DATABASE NAME: TEST XQConnection2 conn = (XQConnection2)xqs.getConnection("admin", "admin"); Document doc = getDocument(); conn.insertItem( "my-document-uri.xml", conn.createItemFromNode(doc, null), null ); XQPreparedExpression px = // have to state DATEBASE NAME, in URI: conn.prepareExpression("fn:doc('TEST/my-document-uri.xml')"); XQResultSequence rs = px.executeQuery(); System.out.println(rs.getSequenceAsString(null)); conn.close(); } } // ---------------------------------------------------- // ---------------------------------------------------- // Inserting an XML Document from a File object // ---------------------------------------------------- import javax.xml.xquery.*; import javax.xml.namespace.QName; import net.xqj.basex.BaseXXQDataSource; import java.io.*; import com.xqj2.*; public class Test { public static void main(String[] args) throws Exception { XQDataSource xqs = new BaseXXQDataSource(); xqs.setProperty("serverName", "localhost"); xqs.setProperty("port", "1984"); xqs.setProperty("databaseName", "TEST"); // DATABASE NAME: TEST XQConnection2 conn = (XQConnection2)xqs.getConnection("admin", "admin"); conn.insertItem( "test.xml", conn.createItemFromDocument( new FileInputStream(new File("test.xml")), null, null ), null ); XQPreparedExpression px = // have to state DATEBASE NAME, in URI: conn.prepareExpression("fn:doc('TEST/test.xml')"); XQResultSequence rs = px.executeQuery(); System.out.println(rs.getSequenceAsString(null)); conn.close(); } } // ---------------------------------------------------- > Is it possible to add Document objects (org.w3c.dom) directly to the > database without using TransformerFactory to convert it first to > string? > > And what if you have a File object? >

1 0

update database with insert and db:open-id
by Tim Belschner 10 Oct '12

10 Oct '12

[BaseX 7.3 with the internal editor] Hello, as a part of a query, I need to update more than ten thousand database entries with an additional attribute. For this, I thought about getting the node IDs with db:node-id(), storing them in an element sequence as attributes and use them afterwards as an identifier for the "update insert". Unfortunately, it takes around 22 seconds to update all database entries. After some testing I got two bottlenecks: 1. the "insert node ." command and 2. the "db:open-id()" command Both of them cause a processing time of around 10 seconds each. Is there a way to increase the update performance significantly? Maybe by setting some options of BaseX or using a different approach? Best regards Tim Here is an example code (no practical sense just to demonstrate the current code for the updates): ----------------------------------CODE-------------------------------------- ------- (: create a list with the node IDs:) declare function local:GetDBIDs ($seq as element()+) as element()+ { for $element in $seq let $DBID := db:node-id($element) return ( element {'Doublet'} { attribute{'DBNodeID'}{$DBID} } ) }; (: ##### MAIN PART ##### :) declare variable $dbname := 'db_enum_test'; let $elements := DBSection let $doubletIDs := element{'Doublets'}{local:GetDBIDs($elements/DatabaseEntry)} for $element at $pos in $doubletIDs/child::* return ( insert node (attribute {'DB_ID'}{xs:string(xs:integer('100000') + $pos)} ) into db:open-id( $dbname, xs:integer(data($element/@DBNodeID)) ) ) ----------------------------------CODE-------------------------------------- ------- and a query to create an example database: ----------------------------------DB---------------------------------------- ----- let $entries := for $i in (1 to 10000) return ( element {'DatabaseEntry'}{attribute {'id'}{xs:string($i)}, attribute {'word'}{concat('Scheduler_',xs:string($i*$i))}, attribute{'type'}{'INT32'}} ) let $entries2 := element {'DBSection'}{$entries} return ( db:add("db_enum_test", document { $entries2 }, "DB") ) ----------------------------------DB---------------------------------------- -----

2 4

Add files to the database
by Raymond Meester 10 Oct '12

10 Oct '12

Is it possible to add Document objects (org.w3c.dom) directly to the database without using TransformerFactory to convert it first to string? And what if you have a File object?

1 0

db creation mini tool
by Hans-Juergen Rennau 08 Oct '12

08 Oct '12

Hello, a little question. I would like to write a mini "tool" which loads an XML file into a database, creating the db if it does not yet exist and overwriting the current content if it does already exist. This script achieves the goal: <commands> <drop-db name="mydb"/> <create-db name="mydb">myxmlfile.xml</create-db> <list/> </commands> But as the script interface does not (yet?) support input parameters, I have to edit the script for each use. Using an XQuery script, on the other hand, is not possible as there is no function for creating a database, if I have not overlooked it in the documentation. My question: is there an alternative which allows to specifiy db name and file name as command line parameters, or is that presently not possible? Many thanks for any information, Hans-Juergen Rennau PS: I would not mind the editing myself, but a tool with call parameters is helpful when spreading the word "BaseX" among the colleagues: providing some useful tools to them using BaseX, one has to instruct them first how to load their data into BaseX, and of course it would be nice to give them a simple call, rather than an instruction how to edit a sample and then call it.

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk October 2012