BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5245 discussions

256 namespaces limit
by Imsieke, Gerrit, le-tex 15 Jan '13

15 Jan '13

Dear Team, Do you plan on increasing the 256 namespaces limit any time soon? I know that there is the STRIPNS option, but this does not fit my use case (which is to index all my XSLT and XProc files) too well. Gerrit

3 2

unzip
by Jason Harrop 14 Jan '13

14 Jan '13

Hello eXist and MarkLogic both have mechanisms for unzipping a resource when it is loaded into the database. In eXist, you can use a trigger and its unzip module. For MarkLogic, you can use its Office OpenXML Extract pipeline. See http://robotbeerbash.wordpress.com/2009/08/31/getting-started-with-open-xml… What's the easiest way to do this sort of thing in basex? thanks .. Jason

4 7

Re: [basex-talk] best way to partition large data sets among collections
by pw＠themail.co.uk 14 Jan '13

14 Jan '13

Hi Christian Thank you for directing me to the profiling module, I think that is just what I need Cheers Peter > > > >---- Original Message ---- >From: christian.gruen(a)gmail.com >To: pw(a)themail.co.uk >Subject: Re: [basex-talk] best way to partition large data sets among >collections >Date: Mon, 14 Jan 2013 19:13:12 +0100 > >>Hi Peter, >> >>> Do you have any information to guide me here; what sorts of XQuery >>> expressions should I match with large numbers of collections, and >>> which with small numbers of collections? >> >>hmm, there is no answer I get in mind that could give you general >>guidance here, as XQuery provides just too many possibilities for >>writing slow and fast queries. Its similar to the question how to >>write efficient Java, Perl of whatever.. To do get more information >on >>why your queries are not as fast as they ideally should be, you >could >>e.g... >> >> check in the InfoView/query info if the relevant index structures >are used >> use functions of the Profiling Module [1] to track down >bottlenecks >> use -Xmx get do low level profiling >> >>Next, you may pass us on snippets of your code that may, in your >>opinion, be subject to being optimized. >>Christian >> >>[1] http://docs.basex.org/wiki/Profiling_Module >> >> >>> If I am using data-rich XML there is a high ration of nodes to >>> content. What are the rules of thumb for this type of content? >>> >>> Are there any recommendations specifically for GML? >>> >>> Many thanks >>> >>> Peter >>> >>>> >>>> >>>> >>>>---- Original Message ---- >>>>From: christian.gruen(a)gmail.com >>>>To: pw(a)themail.co.uk >>>>Subject: Re: [basex-talk] best way to partition large data sets >among >>>>collections >>>>Date: Mon, 14 Jan 2013 13:05:00 +0100 >>>> >>>>>Hi Peter, >>>>> >>>>>thanks for the link. Theres no general answer for your question, >as >>>>>an application may both run flawlessly with a single or hundreds >of >>>>>databases, depending on how your XQuery expressions look like. If >>>>you >>>>>do regular updates, I suggest to split your data into fixed >>>>instances >>>>>that will never change, and use all indexes, and updating >instances >>>>>that may eventually be merged with the fixed instances if no more >>>>>changes are expected. >>>>> >>>>>Christian >>>>>___________________________ >>>>> >>>>>On Sun, Jan 13, 2013 at 1:09 AM, <pw(a)themail.co.uk> wrote: >>>>>> Hello List >>>>>> >>>>>> I am experimenting with statistical data ( >>>>>> http://www.semantechs.co.uk/ ) and found that organising 2.5Gb >of >>>>xml >>>>>> data into 12 unevenly sized collections ranging from 40 to >400Mb >>>>>> performs much more slowly than 36 collections each containing >>>>>> approximately 75Mb of data. >>>>>> >>>>>> What rules of thumb are there to guide me in designing the most >>>>>> performant database? >>>>>> >>>>>> Many thanks >>>>>> >>>>>> Peter >>>>>> >>>>>> _______________________________________________ >>>>>> BaseX-Talk mailing list >>>>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>>>> >>> >>> >>

1 0

Re: [basex-talk] best way to partition large data sets among collections
by pw＠themail.co.uk 14 Jan '13

14 Jan '13

Hi Christian Do you have any information to guide me here; what sorts of XQuery expressions should I match with large numbers of collections, and which with small numbers of collections? If I am using data-rich XML there is a high ration of nodes to content. What are the rules of thumb for this type of content? Are there any recommendations specifically for GML? Many thanks Peter > > > >---- Original Message ---- >From: christian.gruen(a)gmail.com >To: pw(a)themail.co.uk >Subject: Re: [basex-talk] best way to partition large data sets among >collections >Date: Mon, 14 Jan 2013 13:05:00 +0100 > >>Hi Peter, >> >>thanks for the link. Theres no general answer for your question, as >>an application may both run flawlessly with a single or hundreds of >>databases, depending on how your XQuery expressions look like. If >you >>do regular updates, I suggest to split your data into fixed >instances >>that will never change, and use all indexes, and updating instances >>that may eventually be merged with the fixed instances if no more >>changes are expected. >> >>Christian >>___________________________ >> >>On Sun, Jan 13, 2013 at 1:09 AM, <pw(a)themail.co.uk> wrote: >>> Hello List >>> >>> I am experimenting with statistical data ( >>> http://www.semantechs.co.uk/ ) and found that organising 2.5Gb of >xml >>> data into 12 unevenly sized collections ranging from 40 to 400Mb >>> performs much more slowly than 36 collections each containing >>> approximately 75Mb of data. >>> >>> What rules of thumb are there to guide me in designing the most >>> performant database? >>> >>> Many thanks >>> >>> Peter >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>

2 1

7.5.1 beta XMLDB api issues
by Jason Harrop 14 Jan '13

14 Jan '13

https://github.com/BaseXdb/basex-examples/blob/master/src/main/java/org/bas… is not working for me. I'm using source code from github (7.5.1 beta). Is it just me? Also, any update on the status of March 2011 regarding the questions: Is it possible to create child Collections within a database through the XMLDB API? And is it possible to insert XMLResources in a child Collection through the XMLDB API? thanks .. Jason XMLDBInsert returns: === XMLDBInsert === * Get collection. * Create new resource. Exception in thread "main" java.lang.NullPointerException at com.plutext.basex.samples.XMLDBInsert.main(XMLDBInsert.java:52) ============== [basex-talk] xmldb api and child collections Andreas Weiler andreas.weiler at uni-konstanz.de Sun Mar 27 14:10:31 CEST 2011 Previous message: [basex-talk] xmldb api and child collections Next message: [basex-talk] BaseX 6.6 Update - Soft-Files.com Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] Sorry, it seems that this is not supported right now. We will have a look into this. In the meantime, you could use our own API for your scenario. Kind regards, Andreas Am 26.03.2011 um 17:59 schrieb frans at planet: > Is it possible to create child Collections within a database through the XMLDB API? And is it possible to insert XMLResources in a child Collection through the XMLDB API? > > Regards, > Frans > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 1

best way to partition large data sets among collections
by pw＠themail.co.uk 14 Jan '13

14 Jan '13

Hello List I am experimenting with statistical data ( http://www.semantechs.co.uk/ ) and found that organising 2.5Gb of xml data into 12 unevenly sized collections ranging from 40 to 400Mb performs much more slowly than 36 collections each containing approximately 75Mb of data. What rules of thumb are there to guide me in designing the most performant database? Many thanks Peter

2 1

[BXSQ0002] calling sql:execute() in BaseX 7.5.1 snapshot
by Charles Duffy 14 Jan '13

14 Jan '13

Howdy -- I have the following code, which worked perfectly with BaseX 7.3: declare function sqlimport:load-sql-source-raw($config as element(config), $sql_source as element(sql-source)) { let $handle := sql:connect( concat($sql_source/@uri, "/", $sql_source/@schema/string()), $sql_source/@username, $sql_source/@password) let $all_column_names := sql:execute( sql:prepare( $handle, "SELECT COLUMN_NAME FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_SCHEMA=? AND TABLE_NAME=?"), <sql:parameters> <sql:parameter type='string'>{$sql_source/@schema/string()}</sql:parameter> <sql:parameter type='string'>{$sql_source/@table/string()}</sql:parameter> </sql:parameters> )/sql:column[@name="COLUMN_NAME"] let $column_names := $all_column_names/text()[not(.=$sql_source/ignore-column/text())] return sql:execute($handle, concat("SELECT ", string-join($column_names, ", "), " FROM ", $sql_source/@table/string())) }; With BaseX 7.5 and current snapshots of 7.5.1, however, it yields the following error: [BXSQ0002] No opened connection with id 1 ...positioned at the sql:execute() call. I would understand sql:connect() failing -- but having the connection appear to take place without errors, followed by a failure with the execution, is surprising. Guidance?

2 1

BaseX Users Meetup, XMLPrague
by Christian Grün 14 Jan '13

14 Jan '13

Dear all, we've now assigned two slots for our Friday's Users Meetup in Prague. The pre-conference schedule is online: http://www.xmlprague.cz/pre-conference-friday/ We are still interested in your presentations, live demos, etc.. Give us a note! Next, you can still register for the conference, which is really budget-friendly, compared to other events of that kind. See you soon, Christian BaseX Team 2013

1 0

BaseX 7.5 Update - Soft-Files.com
by Soft-Files Team 14 Jan '13

14 Jan '13

Dear Developer, Your product BaseX 7.5 has been updated. Your product review page is located at: http://www.soft-files.com/basex_72311.html. Sincerely, The Soft-Files Team

1 0

Re: [basex-talk] data visualisation from BaseX
by pw＠themail.co.uk 12 Jan '13

12 Jan '13

Following my last posting I have rebuilt the database using 36 rather than 12 collections and it seems to perform better. I hope you now have a better chance of accessing the datasets. Peter Hello List http://www.semantechs.co.uk/ has so much data in a BaseX database (of course). How best to visualise? Any ideas of which libraries would be the best fit to develop a restxq front end to this dataset? [the server isn't very performant, so apologies if its slow/stopped. I'd appreciate your suggestions nonetheless] Cheers Peter

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk