Have been trying to look at connection pooling due to requests of documents taking 1 second to pull - when I have 36000 documents to pull down for processing this is too slow. Some examples mention BaseXConnectionPoolXQDataSource with XQJ Connection Pool, however that seems to been in beta, last updated 02/2014 and the jar file is corrupt. Whilst this isn't under the control of BaseX is there any advice of a newer version, or recommendations for handling connection pools.
I have a java service which is running 10 threads which pull from a queue of "request jobs" which involve pulling a document from a BaseX database, then loading into an in memory instance for further querying. This way I am able to pass around sections of the document as I drill down into it (iterating over nodes for processing) which is too slow to carry out through a server instance. Initially I attempted to create one connection to BaseX per thread, however this seemed even slower.
Any advice welcome
The information contained in the email and any files transmitted with it is confidential and intended for the addressee only. If you have received this email in error please accept our apologies and notify the originator. Any disclosure, copying, distribution or any other use of this communication is strictly prohibited and may be unlawful. We reserve the right to monitor and intercept communications for lawful business purposes.
Wireless Innovation Ltd , Unit D2, Churcham Business Park, Churcham, Gloucestershire, GL2 8AX, Great Britain.
Company Registration Number 5240202, Place of Registration Companies House Cardiff.