Hello dear BaseX Team,
I would like to load a big number of small documents in Basex.
What I do is to use a little Java program:
Context ctx = new Context();
new CreateDB("basex1").execute(ctx);
new CreateIndex("fulltext").execute(ctx);
System.err.println("\n* Show database information:");
System.err.print(new InfoDB().execute(ctx));
for( ... ) {
new Add(somedata, miname, collection).execute(ctx);
}
I dont know if it is correct , efficient ?
Do you have a notion of transaction, like begin/commit ?
( I did not see something like that)
My concern is that it seems not to behave well when
the number of documents goes big:
(each doc is about 2500 bytes)
10000 => 54 seconds ; 5.4 millis / document
20000 => 202 s ; 10 ms
50000 => 862 s ; 17.2 ms
And in fact I want to store more than 1 million!
Actually is there a limit in size ? Is 1 million x 2.5Kb OK?
Thank you very much
Tomaso