Hi all, I start from the following condition:
- 2 dbs (let's say A and B) with around 200K documents each - every document in B refers to exactly one document in A (many to one is possible)
- I have to apply a filter on every document of A and depending on the boolean outcome "move" the document to anoter db A'. - According to this the correlated documents of B need to be "moved" to a database B'. - The solution should be made automatic in the mid term
What is the best design pattern and tool (I use the GUI by now) for this finding the right compromise for limiting "Out of memory (huge PUL)", "too much time", "complexity introduced by chunking" and "absence of a _db:move-document_ operation for moving one document in one single operation?
Every suggestion is more then warmly welcome!
Thanks and best regards, Marco