Dear all at BaseX,
Once again, thank you for your job !
A Database creation fails after some time, With the message 'Input is too large for a single database'. It seems to be related with the LIMITRANGE error message. Could you please give us a few explanations, And a way to import the data (about 81 Go) anyway ?
Best regards, Fabrice Etanchaud Questel-Orbit
Dear Fabrice,
your input document is indeed too large for a single database, as it seems to exceed 2 billion (2^31) nodes. you'll have to split up the document manually, and save it in multiple databases, which can then be accessed by a single XQuery. We have some plans for BaseX 8 to support up to 2^63 (i.e., 8 Quintillion) nodes in a single database, but the release date is still nebulous.
For all those who are waiting for 7.5 (we're getting frequent requests): the release will be further postponed, as we still need to document all new features, and implement some remaining ones. After all, you are all invited to switch to the latest 7.5 snapshot, which has been proven to be very stable and, in many ways, more robust than the current 7.3 release.
Hope this helps, Christian ___________________________
On Thu, Nov 1, 2012 at 10:31 PM, Fabrice Etanchaud fetanchaud@questel.com wrote:
Dear all at BaseX,
Once again, thank you for your job !
A Database creation fails after some time,
With the message ‘Input is too large for a single database’.
It seems to be related with the LIMITRANGE error message.
Could you please give us a few explanations,
And a way to import the data (about 81 Go) anyway ?
Best regards,
Fabrice Etanchaud
Questel-Orbit
BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Thank you Christian for your reply at that time of the day (or the night...) ! I am happy to hear that BaseX can in the future handle very large xml collections.
For me, this feature is at the top of the list. Hy everybody, are there other BaseX users interested with this feature ?
Best regards, And good night.
Fabrice
-----Message d'origine----- De : Christian Grün [mailto:christian.gruen@gmail.com] Envoyé : jeudi 1 novembre 2012 23:04 À : Fabrice Etanchaud Cc : basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Create DB fails with 'Input is too large for a single database'
Dear Fabrice,
your input document is indeed too large for a single database, as it seems to exceed 2 billion (2^31) nodes. you'll have to split up the document manually, and save it in multiple databases, which can then be accessed by a single XQuery. We have some plans for BaseX 8 to support up to 2^63 (i.e., 8 Quintillion) nodes in a single database, but the release date is still nebulous.
For all those who are waiting for 7.5 (we're getting frequent requests): the release will be further postponed, as we still need to document all new features, and implement some remaining ones. After all, you are all invited to switch to the latest 7.5 snapshot, which has been proven to be very stable and, in many ways, more robust than the current 7.3 release.
Hope this helps, Christian ___________________________
On Thu, Nov 1, 2012 at 10:31 PM, Fabrice Etanchaud fetanchaud@questel.com wrote:
Dear all at BaseX,
Once again, thank you for your job !
A Database creation fails after some time,
With the message 'Input is too large for a single database'.
It seems to be related with the LIMITRANGE error message.
Could you please give us a few explanations,
And a way to import the data (about 81 Go) anyway ?
Best regards,
Fabrice Etanchaud
Questel-Orbit
BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Hi Fabrice,
emphatically agree! The ability to handle extremely large documents would be a feature of major significance, expanding the scope of BaseX's applicability. Even if performance would be very low, for the time being - the mere possibility of evaluating and analyzing such data sets makes a great difference.
Adding a thought: streamability is a major goal of XSLT 3.0 - but what it achieves is (though not restricted to, but at least) related to what one enjoys right from the start when working with an XML database capable of storing very large documents.
Kind regards, Hans-Juergen
________________________________ Von: Fabrice Etanchaud fetanchaud@questel.com An: Christian Grün christian.gruen@gmail.com CC: "basex-talk@mailman.uni-konstanz.de" basex-talk@mailman.uni-konstanz.de Gesendet: 23:20 Donnerstag, 1.November 2012 Betreff: Re: [basex-talk] Create DB fails with 'Input is too large for a single database'
Thank you Christian for your reply at that time of the day (or the night...) ! I am happy to hear that BaseX can in the future handle very large xml collections.
For me, this feature is at the top of the list. Hy everybody, are there other BaseX users interested with this feature ?
Best regards, And good night.
Fabrice
basex-talk@mailman.uni-konstanz.de