Hello Christian,
I would indeed suggest to use the total times for benchmarking, and to minimize the time for printing the result. You could e.g. move all output to /dev/null, or to a temporary file on disk, which is ok with the performance of today's hard disk. To play fair with the competition, you could omit the -z flag for BaseX.
This is fine. We will run some query examples based on Xmark. We will compare the results of several queries with eXist. It will be similar to here (unfortunately smaller scale): http://monetdb.cwi.nl/XQuery/Benchmark/XMark/
I am thinking to run it on three different sizes of Xmark generated database: 1.1MB, 11MB, 110MB. Any hints/suggestions/requests here? Note that both systems are running on client/server mode.
So far our mini-report-paper structure will have the following structure:
. small summary of how BaseX works (based on first couple research papers): 2-3 pages incl some intro . Small summary of how to benchmark XML DBs (based on XMark relative papers): 1-2 pages . Results of mini-benchmark and comparison with eXist: 1-2 pages _____________________________Total: 4-7 p
Any hints/suggestions/requests here?
thanks again, Antonis