Hi all,
with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1].
Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well.
All the best, Christian
We have been using BaseX 7.6 in a multithreaded Java/JBoss application for over 4 years. We were unable to move to version 8 due to performance issues. Have any performance metrics been done between the various version to get a handle on whether a move to 9 is warranted?
BTW .. great product!
Carl R Bondeson IT Analyst 3 Department of Public Health Operation & Support Services Information Technology Phone: 860-509-7434 Carl.Bondeson@ct.gov
-----Original Message----- From: basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of Christian Grün Sent: Thursday, February 01, 2018 3:29 AM To: BaseX basex-talk@mailman.uni-konstanz.de; BaseX basex-announce@mailman.uni-konstanz.de Subject: [basex-talk] BaseX 9.0 (still to come): Improved text compression
Hi all,
with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1].
Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well.
All the best, Christian
Hi Carl,
Our main focus has always been on performance. In general, new versions of BaseX will always be faster than older ones.
Could you give us more details on the experiences you made with version 7 and 8? Was it a particular feature of BaseX that had negative influence on the performance of your application?
Best, Christian
Am 01.02.2018 1:48 nachm. schrieb "Bondeson, Carl" Carl.Bondeson@ct.gov:
We have been using BaseX 7.6 in a multithreaded Java/JBoss application for over 4 years. We were unable to move to version 8 due to performance issues. Have any performance metrics been done between the various version to get a handle on whether a move to 9 is warranted?
BTW .. great product!
Carl R Bondeson IT Analyst 3 Department of Public Health Operation & Support Services Information Technology Phone: 860-509-7434 Carl.Bondeson@ct.gov
-----Original Message----- From: basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@ mailman.uni-konstanz.de] On Behalf Of Christian Grün Sent: Thursday, February 01, 2018 3:29 AM To: BaseX basex-talk@mailman.uni-konstanz.de; BaseX < basex-announce@mailman.uni-konstanz.de> Subject: [basex-talk] BaseX 9.0 (still to come): Improved text compression
Hi all,
with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1].
Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well.
All the best, Christian
This application utilizes a BaseX client/server architecture to perform queries against a set of XML databases. These databases are created and initialized during war file deployment and allow upwards of 1000s of threads to perform queries asynchronously. I chose BaseX for its ability to work well with a XML hierarchy without having to rely on another external database server where network performance can be problematic. I made the switch to 8 but noticed issues with performance. I understand that most people are using BaseX in a typical single threaded web application where these performance issues would not be as noticeable. I can easily try out 9 and see if these performance issues are still relevant. I was only wondering whether someone had ever created a set of standard metrics, based on a simple set of X-Query operations, to offer a general understanding of performance across the various versions of your product.
Carl R Bondeson IT Analyst 3 Department of Public Health Operation & Support Services Information Technology Phone: 860-509-7434 Carl.Bondeson@ct.govmailto:Carl.Bondeson@ct.gov
[cid:image001.jpg@01D16B2F.0AD71DC0][http://www.phaboard.org/wp-content/uploads/PHAB-SEAL-COLOR.jpg]
From: Christian Grün [mailto:christian.gruen@gmail.com] Sent: Thursday, February 01, 2018 8:12 AM To: Bondeson, Carl Carl.Bondeson@ct.gov Cc: BaseX Support basex-talk@mailman.uni-konstanz.de Subject: RE: [basex-talk] BaseX 9.0 (still to come): Improved text compression
Hi Carl,
Our main focus has always been on performance. In general, new versions of BaseX will always be faster than older ones.
Could you give us more details on the experiences you made with version 7 and 8? Was it a particular feature of BaseX that had negative influence on the performance of your application?
Best, Christian
Am 01.02.2018 1:48 nachm. schrieb "Bondeson, Carl" <Carl.Bondeson@ct.govmailto:Carl.Bondeson@ct.gov>: We have been using BaseX 7.6 in a multithreaded Java/JBoss application for over 4 years. We were unable to move to version 8 due to performance issues. Have any performance metrics been done between the various version to get a handle on whether a move to 9 is warranted?
BTW .. great product!
Carl R Bondeson IT Analyst 3 Department of Public Health Operation & Support Services Information Technology Phone: 860-509-7434 Carl.Bondeson@ct.govmailto:Carl.Bondeson@ct.gov
-----Original Message----- From: basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of Christian Grün Sent: Thursday, February 01, 2018 3:29 AM To: BaseX <basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de>; BaseX <basex-announce@mailman.uni-konstanz.demailto:basex-announce@mailman.uni-konstanz.de> Subject: [basex-talk] BaseX 9.0 (still to come): Improved text compression
Hi all,
with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1].
Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well.
All the best, Christian
You may want to have look at the traditional XML benchmarks (XMark, XMach et al.), which we run against BaseX now and then. Apart from that, I would claim that the range of applications in which BaseX is used is so diverse that it’s difficult to define metrics that do justice to all requirements. Use cases exist in which neither XML is touched nor databases are created. In other use cases, BaseX is used as a plain XML document store, and all the intricacies of our XQuery processor are completely irrelevant.
Feedback from other users of BaseX is welcome, though!
And if it happens that you find out more about why performance degraded with 8.x, we are looking forward to your report.
Am 01.02.2018 14:30 schrieb "Bondeson, Carl" Carl.Bondeson@ct.gov:
This application utilizes a BaseX client/server architecture to perform queries against a set of XML databases. These databases are created and initialized during war file deployment and allow upwards of 1000s of threads to perform queries asynchronously. I chose BaseX for its ability to work well with a XML hierarchy without having to rely on another external database server where network performance can be problematic. I made the switch to 8 but noticed issues with performance. I understand that most people are using BaseX in a typical single threaded web application where these performance issues would not be as noticeable. I can easily try out 9 and see if these performance issues are still relevant. I was only wondering whether someone had ever created a set of standard metrics, based on a simple set of X-Query operations, to offer a general understanding of performance across the various versions of your product.
Carl R Bondeson
IT Analyst 3
Department of Public Health
Operation & Support Services
Information Technology
Phone: 860-509-7434
Carl.Bondeson@ct.gov
[image: cid:image001.jpg@01D16B2F.0AD71DC0][image: http://www.phaboard.org/wp-content/uploads/PHAB-SEAL-COLOR.jpg]
*From:* Christian Grün [mailto:christian.gruen@gmail.com] *Sent:* Thursday, February 01, 2018 8:12 AM *To:* Bondeson, Carl Carl.Bondeson@ct.gov *Cc:* BaseX Support basex-talk@mailman.uni-konstanz.de *Subject:* RE: [basex-talk] BaseX 9.0 (still to come): Improved text compression
Hi Carl,
Our main focus has always been on performance. In general, new versions of BaseX will always be faster than older ones.
Could you give us more details on the experiences you made with version 7 and 8? Was it a particular feature of BaseX that had negative influence on the performance of your application?
Best,
Christian
Am 01.02.2018 1:48 nachm. schrieb "Bondeson, Carl" Carl.Bondeson@ct.gov:
We have been using BaseX 7.6 in a multithreaded Java/JBoss application for over 4 years. We were unable to move to version 8 due to performance issues. Have any performance metrics been done between the various version to get a handle on whether a move to 9 is warranted?
BTW .. great product!
Carl R Bondeson IT Analyst 3 Department of Public Health Operation & Support Services Information Technology Phone: 860-509-7434 Carl.Bondeson@ct.gov
-----Original Message----- From: basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@ mailman.uni-konstanz.de] On Behalf Of Christian Grün Sent: Thursday, February 01, 2018 3:29 AM To: BaseX basex-talk@mailman.uni-konstanz.de; BaseX < basex-announce@mailman.uni-konstanz.de> Subject: [basex-talk] BaseX 9.0 (still to come): Improved text compression
Hi all,
with version 9.0 of BaseX, texts will be better compressed than before. Short strings and whitespace text nodes will be inlined in our main storage, instead of being stored in an extra heap file as before. This will particularly be helpful when perfoming mass updates on short strings (replace 'yes' to 'no', etc.), and your future BaseX database will get even smaller [1].
Obviously, BaseX 9.0 databases cannot opened anymore with older versions. However, BaseX will be 100% backward compatible, so there will be no need to export and recreate your existing database instances. Instead, all future updates you perform will use the new compression feature; and if you run a complete optimize, all existing texts will be reduced as well.
All the best, Christian
basex-talk@mailman.uni-konstanz.de
-
Bondeson, Carl -
Christian Grün