BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

BaseX http running single threaded?
by Joe Templeman 30 Sep '13

30 Sep '13

Hi all, I'm having trouble with the running a restxq API, set up as either a stand alone app (using basexhttp) or running the servlet in jetty. When I make a request, the server will lazily load in the requested content using a small java library that I've built which can take quite a while, and unfortunately it completely blocks waiting for this request to complete. This means that if I make a request for content which is already loaded, which should return in a couple of milliseconds, it instead waits for the downloading of the first request to complete before returning. I'm sure it's something simple that I'm missing in the config somewhere, but I have the threadpool parameters set up in my jetty.xml config file but it doesn't seem to make any difference. Is this expected behavior? I can't imagine any HTTP server would ever be designed to be single threaded... Any help is welcome, I've been trying to figure this out for days now. Thanks, Joe

3 5

Keep index in main memory-performance
by Aravanis, G. 30 Sep '13

30 Sep '13

Hi community, I have created a DB of around 7 GB documents in BaseX (100 first records of Medline) with full text index option enabled (index size 1 GB). I test it locally on my laptop. The problem is that I observe great variations in the free text query times from 8s up to couple of minutes. Main memory is underused (allocated 2 GB) and the processor has quite low utilization. I observe high usage of the hard disk. I have read that the whole db could be loaded in the main memory, but this is not an option for an 100 GB db collection that I would like to have. My question is if there is a possibility to load only the index in the main memory in order to accelerate the process of searching. Any other performance tips are very welcome. Thank you, George Aravanis

2 4

Re: [basex-talk] Set Operator Examples
by Arto Viitanen 26 Sep '13

26 Sep '13

Question was about set operations in BaseX. I had to calculate set difference on a sequence of values. XQuery has operator except, but it works only on nodes. I guess normal code for this is using distinct-values: declare function local:difference-pred($a, $b) { distinct-values($a[not(.=$b)]) }; I used it on big (thousands of values) sets, and it was slow. Then I tried on maps using BaseX map-module : declare function local:difference-map($a, $b) { let $m1 := map:new(for $i in $a return map:entry($i, true())) let $m2 := map:new(for $i in $b return map:entry($i, false())) let $m3 := map:new(($m1, $m2)) return for $i in map:keys($m3) return if ($m3($i)) then $i else () }; Then we found another solution, with only one map: declare function local:difference-map-2($a, $b) { let $m2 := map:new(for $i in $b return map:entry($i, true())) return for $i in $a return if($m2($i)) then () else $i }; When trying them at same sequences: let $a :=for $i in (1 to 100000) return if (random:double() < 0.01) then () else string($i) let $b := for $i in $a return if (random:double() < 0.45) then () else $i return (count($a), count($b), count(prof:time( local:difference-pred($a, $b), true(), 'pred ')), count(prof:time( local:difference-map($a, $b), true(), 'map ')), count(prof:time( local:difference-map($a, $b), true(), 'map2 '))) This gives times (on BaseX 7.6 running on OpenSUSE on VMWare virtual machine on a PC). pred: 80468.68ms map: 261.23 ms map2: 253.77 ms That is: map2 is 317 times faster than distinct-values version. I did not measure memory usage. Also on different size sequences, each one of the functions can be fastest! -- Arto Viitanen Finland

4 7

Issue with linebreak using REST since 7.7.1
by Yoann Maingon 25 Sep '13

25 Sep '13

Hi, I've got a simple node move PHP script (sorry for my terrible code, I'm an electronician!) 1. // get the node 2. $xquery = "XQUERY //noteitem[@id='$movedID']"; 3. $saveNode = $session->execute($xquery); 4. 5. // delete the node 6. $xquery = "XQUERY delete node //noteitem[@id='$movedID']"; 7. $content = $session->execute($xquery); 8. // insert the node 9. if ($nextID == 'last') { 10. $xquery = "XQUERY insert node ($saveNode) as last into //meeting[@id='$meetingID']/items " ; 11. $content = $session->execute($xquery); 12. } else { 13. echo $saveNode; 14. $xquery = "XQUERY insert node ($saveNode) before //meeting[@id='$meetingID']/items/noteitem[@id='$nextID'] " ; 15. $content = $session->execute($xquery); 16. } 17. $contentFull = "<MN>$content</MN>"; 18. echo $contentFull; If I look into the content that is saved, deleted and inserted I have the following: <noteitem status="new" commentsCounter="0" created_on="Tue, 24 Sep 13 12:09:29 +0000" modified_on="Tue, 24 Sep 13 12:09:29 +0000" id="MnNo524180f9587c1" genid="MnNo524180f9587c1" owner="1" type="question"> <notecontent>...</notecontent> </noteitem> It worked fine until the latest update. Where apparently the query breaks with the line break. It creates an error saying that the closing </noteitem> tag is missing. Just got back to 7.6 and it works well. any idea? Yoann Maingon CEO - mydatalinx +33664324966

2 1

feature request -- GUI database creation overall progress
by Graydon Saunders 25 Sep '13

25 Sep '13

Hi! Right now, creating a database in the GUI gives a per-file progress, which is accurate but not informative. Any chance of getting, in addition to the per-file progress, the overall progress of creating the database? Thanks! Graydon

2 1

empty tags
by Lars Johnsen 24 Sep '13

24 Sep '13

Hello BaseX developers! When using BaseX scripting to generate HTML, I got a problem with the representation of empty nodes. For example, my code has something like this in it <div> { ... some code...} </div> if ...some code... returns nothing, the div is empty as is labelled <div/>. This causes trouble in HTML, since <div/> is treated as if it was the start tag <div>, and will therefore nest over following divs. Is there a way for BaseX to output <div></div> instead? There is an ad hoc solution which checks if ...some code... is empty and inserts a blank in those cases, preventing the div from collapsing into one tag, but was hoping for a more general solution. All the best, Lars G Johnsen National Library of Norway

2 1

Caching RestXQ responses
by Wendell Piez 24 Sep '13

24 Sep '13

Hi, I'm in over my head on this one, but I have questions about running BaseX behind restXQ, specifically on whether I can have query responses cached. Does this happen already? (How can I determine this?) Does caching responses to queries under restXQ fall outside of BaseX's responsibilities? Is it a Jetty thing? Any advice in general, or links I can go to learn about this? Thanks, Wendell Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^

2 1

Set Operator Examples
by John Best 24 Sep '13

24 Sep '13

Hi all, Where can I find examples using set operators... wrt BaseX. -- Have a nice day JBest

2 1

Snapshoting in baseX
by Simon Görke 23 Sep '13

23 Sep '13

Hi everybody, this is rather a general question than a concrete issue or a bug report: Does baseX provide any snapshoting-alike functionality, i.e. the possibility to automatically save (potentially) affected elements *before* an updating transaction is performed? We have a (existing) GUI which is used to edit data stored in a baseX database. For this GUI, we want to add undo/redo functionality for the user. Snapshoting would be a straightforward approach, but any other hints or ideas are also welcome (maybe using events?). Thanks in advance, Simon

2 1

Uninstall Removes Repo directory!
by James Wright 20 Sep '13

20 Sep '13

AH! Well its my fault. Several weeks of work lost because I uninstalled 7.7 and it removed the repo directory with all my modules! Just wanted to give the fair warning.. Time to get a drink... I was going to put that in Drop Box last week and never got to it!! - James

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk