Pruned, optimized DB shows same document count, db size

List overview All Threads
Download

newer

older

try catch mechanisms and inlining

fn:nilled() not working

Hondros, Constantine (ELS-AMS)

12 Jan 2015 12 Jan '15

8:28 a.m.

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Attachments:

attachment.html (text/html — 1.8 KB)

Show replies by date

Fabrice Etanchaud

12 Jan 12 Jan

10:14 a.m.

New subject: Pruned, optimized DB shows same document count, db size

Dear Constantine,

...

From what I know, optimize only rebuilt indexes and metadata.

Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

De : basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 14:29 À : basex-talk@mailman.uni-konstanz.de Objet : [basex-talk] Pruned, optimized DB shows same document count, db size

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Hondros, Constantine (ELS-AMS)

10:32 a.m.

New subject: Pruned, optimized DB shows same document count, db size

Aha, of course, the all boolean. I did not try that, and will.

DB metadata I get via the GUI menu : Database -> Open and Manage

Cheers, C.

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 16:14 To: Hondros, Constantine (ELS-AMS); basex-talk@mailman.uni-konstanz.de Subject: RE: Pruned, optimized DB shows same document count, db size

Dear Constantine,

...

From what I know, optimize only rebuilt indexes and metadata.

Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 14:29 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : [basex-talk] Pruned, optimized DB shows same document count, db size

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Fabrice Etanchaud

11 a.m.

Constantine,

Did you mean db :delete or delete nodes ?

I'm using 8.0 769b53b and after db:delete, even without optimize, I get correct documents' count in the GUI window.

Best, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 16:32 À : basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Aha, of course, the all boolean. I did not try that, and will.

DB metadata I get via the GUI menu : Database -> Open and Manage

Cheers, C.

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 16:14 To: Hondros, Constantine (ELS-AMS); basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Subject: RE: Pruned, optimized DB shows same document count, db size

Dear Constantine,

...

From what I know, optimize only rebuilt indexes and metadata.

Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Hondros, Constantine (ELS-AMS)

11:09 a.m.

Hi Fabrice,

I used the Xquery delete node command, rather than the (document-oriented) db:delete.

I guess that explains the difference.

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 17:01 To: Hondros, Constantine (ELS-AMS); basex-talk@mailman.uni-konstanz.de Subject: RE: [basex-talk] Pruned, optimized DB shows same document count, db size

Constantine,

Did you mean db :delete or delete nodes ?

I'm using 8.0 769b53b and after db:delete, even without optimize, I get correct documents' count in the GUI window.

Best, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 16:32 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Aha, of course, the all boolean. I did not try that, and will.

DB metadata I get via the GUI menu : Database -> Open and Manage

Cheers, C.

Dear Constantine,

...

From what I know, optimize only rebuilt indexes and metadata.

Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Fabrice Etanchaud

11:23 a.m.

Constantine,

It seems Questel and Elsevier are competitors... But using the same great piece of software !

Best regards, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 17:10 À : basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Hi Fabrice,

I used the Xquery delete node command, rather than the (document-oriented) db:delete.

I guess that explains the difference.

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 17:01 To: Hondros, Constantine (ELS-AMS); basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Subject: RE: [basex-talk] Pruned, optimized DB shows same document count, db size

Constantine,

Did you mean db :delete or delete nodes ?

I'm using 8.0 769b53b and after db:delete, even without optimize, I get correct documents' count in the GUI window.

Best, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 16:32 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Aha, of course, the all boolean. I did not try that, and will.

DB metadata I get via the GUI menu : Database -> Open and Manage

Cheers, C.

Dear Constantine,

...

From what I know, optimize only rebuilt indexes and metadata.

Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Hondros, Constantine (ELS-AMS)

16 Jan 16 Jan

3:45 a.m.

Yup - and for the record, BaseX simply rocks. Great work, guys!

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 17:24 To: Hondros, Constantine (ELS-AMS) Cc: basex-talk@mailman.uni-konstanz.de Subject: RE: [basex-talk] Pruned, optimized DB shows same document count, db size

Constantine,

It seems Questel and Elsevier are competitors... But using the same great piece of software !

Best regards, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 17:10 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Hi Fabrice,

I used the Xquery delete node command, rather than the (document-oriented) db:delete.

I guess that explains the difference.

Constantine,

Did you mean db :delete or delete nodes ?

I'm using 8.0 769b53b and after db:delete, even without optimize, I get correct documents' count in the GUI window.

Best, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 16:32 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Aha, of course, the all boolean. I did not try that, and will.

DB metadata I get via the GUI menu : Database -> Open and Manage

Cheers, C.

Dear Constantine,

...

From what I know, optimize only rebuilt indexes and metadata.

Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

________________________________

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Dirk Kirsten

4:09 a.m.

I vote that we have this statement ("BaseX simply rocks. Great work, guys!") eternalized in broad, golden letters in our office. Thanks for the nice feedback, it is appreciated :-) On 01/16/2015 09:45 AM, Hondros, Constantine (ELS-AMS) wrote:

...

Yup - and for the record, BaseX simply rocks. Great work, guys!

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 17:24 To: Hondros, Constantine (ELS-AMS) Cc: basex-talk@mailman.uni-konstanz.de Subject: RE: [basex-talk] Pruned, optimized DB shows same document count, db size

Constantine,

It seems Questel and Elsevier are competitors... But using the same great piece of software !

Best regards, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 17:10 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Hi Fabrice,

I used the Xquery delete node command, rather than the (document-oriented) db:delete.

I guess that explains the difference.

C.

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 17:01 To: Hondros, Constantine (ELS-AMS); basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Subject: RE: [basex-talk] Pruned, optimized DB shows same document count, db size

Constantine,

Did you mean db :delete or delete nodes ?

I'm using 8.0 769b53b and after db:delete, even without optimize, I get correct documents' count in the GUI window.

Best, Fabrice

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 16:32 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : Re: [basex-talk] Pruned, optimized DB shows same document count, db size

Aha, of course, the all boolean. I did not try that, and will.

DB metadata I get via the GUI menu : Database -> Open and Manage

Cheers, C.

From: Fabrice Etanchaud [mailto:fetanchaud@questel.com] Sent: 12 January 2015 16:14 To: Hondros, Constantine (ELS-AMS); basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Subject: RE: Pruned, optimized DB shows same document count, db size

Dear Constantine,

From what I know, optimize only rebuilt indexes and metadata. Did you try "optimize all" to compact db files ?

But documents' number should be updated. How do you get metadata information ?

Best regards,

Fabrice Etanchaud Questel/Orbit

http://docs.basex.org/wiki/Database_Module#db:optimize

De : basex-talk-bounces@mailman.uni-konstanz.demailto:basex-talk-bounces@mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Hondros, Constantine (ELS-AMS) Envoyé : lundi 12 janvier 2015 14:29 À : basex-talk@mailman.uni-konstanz.demailto:basex-talk@mailman.uni-konstanz.de Objet : [basex-talk] Pruned, optimized DB shows same document count, db size

Hello all,

I've pruned about half the documents of a +-5GB database using XQuery delete. I then optimised the database using db:optimize.

The database metadata still shows the original number of documents, and the overall db filesize remains roughly the same.

I was sort of hoping this pruning would improve performance, but if there's any difference it's negligable. Am I missing something obvious?

Thanks in advance,

Constantine Hondros

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

-- Dirk Kirsten, BaseX GmbH, http://basexgmbh.de |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

3836

Age (days ago)

3840

Last active (days ago)

basex-talk@mailman.uni-konstanz.de

7 comments

3 participants

tags (0)

participants (3)

Dirk Kirsten
Fabrice Etanchaud
Hondros, Constantine (ELS-AMS)