- BaseX-Talk - mailman.uni-konstanz.de

Memory mode in BaseX Gui
by France Baril 01 Jul '19

01 Jul '19

Hi, When we create a new DB and try to run a .xq script that adds new files to the DB we get an issue that says that we can't perform the operation in memory mode. We have to restart the server to be able to run our script. Can you tell why this is happening and if there is an easier way to get out of said memory mode without a server restart? Thanks -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 3

GUI not counting all updates?
by France Baril 26 Jun '19

26 Jun '19

Hi, I am running this query on my DB in BasexGui. The updates are performed, but the info window shows hit=0 and update=0. ( for $i in db:open('en-us')//p/node()[1] return if ($i instance of text() and normalize-space($i) = '') then replace node $i with '' else (), for $i in db:open('en-us')//p/node()[last()] return if ($i instance of text() and normalize-space($i) = '') then replace node $i with '' else () ) The DB has items like this one: <td id="j1359186"> <q id="j1213306">Turn off projector</q> <q id="j1158327">Switch off projector</q> <q id="j11037">Projector off</q> <q id="j147181">Turn projector off</q> <q id="j1277">Deactivate projector</q> <q id="j122584">Disable projector</q> </td> -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Query Optimization Question
by Bridger Dyson-Smith 25 Jun '19

25 Jun '19

Hi all - An interesting XQuery question came up on reddit[1] over the weekend, and I'm curious about a couple of aspects of the problem. To recreate, the sample data is at timecenters[2] in the employeeTemporalDataset.zip download (specifically, the `departments.xml` and the three compressed directories of XML in `employees.tar.gz`). I created a database from employees.tar.gz (thanks for letting us parse XML in archives!), added the `departments.xml`, and then `Optimized All`. The initial query was ``` for $emp in /employees/employee[@tend = '9999-01-01'] let $curdept := $emp/deptno[@tend = '9999-01-01'] return $emp/lastname || " " || $curdept || " " || /departments/department[deptno = $curdept]/deptname ``` and it is slow (~100 minutes, 5999201.28 ms). The original poster came back later with a modified query that is significantly faster[3], but I was mostly wondering about the whys of the slowness. I think (but am not sure) that this is a join, and since the initial `for` binding ($emp) is pretty big (~240K), the processor has to parse through the $emp result sequence and match to values in the /departments part of the database; is that a correct assumption? Again, I'm assuming that in the second, faster, query, the processor has two sequences ($d and $e) and is able to pull the joined data together much more quickly? Thanks in advance for any light you can shed on these questions. Best, Bridger [1] https://www.reddit.com/r/xml/comments/c3mb86/simple_xquery_optimization/ [2] http://timecenter.cs.aau.dk/software.htm [3] improved query: ``` for $d in /departments/department for $e in /employees/employee[deptno[@tend='9999-01-01'] = $d/deptno] return $e/lastname || " " || $d/deptno || " " || $d/deptname ```

2 1

Re: [basex-talk] BaseX: Use and Error Questions
by Christian Grün 20 Jun '19

20 Jun '19

Hi Jordan, So that must have been the reason. If you use the GUI, you’ll need to avoid parallel requests on opened databases because there will be no synchronization between these instances (see [1] for more details). You can run your script inside the GUI; maybe that solves your problems. Cheers Christian [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations Jordan Castillo <jordantcastillo1992(a)gmail.com> schrieb am Do., 20. Juni 2019, 18:36: > Hello Christian, > > First, thank you for the speedy reply. > > 1. This was the source of the problem. After closing the GUI I could run > the script that failed previously. > 2. The GUI can remain open if I instead use the CREATE DB or CHECK > commands rather than the OPEN command. > > Hope you have a great day. > > Jordan Castillo > > On Thu, Jun 20, 2019 at 6:28 AM Christian Grün <christian.gruen(a)gmail.com> > wrote: > >> Hi Jordan, >> >> The way you proceeded looks ok to me. Some questions: >> >> 1. Did you run any operations in parallel while the script was running >> (such as checking the progress of the script via the GUI or another >> CLI instance)? >> 2. Does the problem always occur after the same ADD operation in your >> script? >> 3. Does it work if you create a new database instead of opening an >> existing one?… >> >> CREATE DB exists >> ADD >> /Users/user/Desktop/O-Lab/Examples/cubesat/BINARIES/BINARY-03abaa7c-18fd-40a4-a26b-4be24089cfe4 >> ... >> >> Thanks in advance >> Christian >> >> >> >> >> On Thu, Jun 20, 2019 at 12:08 AM Jordan Castillo >> <jordantcastillo1992(a)gmail.com> wrote: >> > >> > Hello BaseX Staff, >> > >> > I am a developer who is new to BaseX and am getting stuck sending >> commands through the basex executable. >> > My goal is to either open the CLI executable and send a command >> (through a script), or send the command without the basex CLI opening, as >> long as the command is run. >> > In my recent attempt that I thought was close, I received the following >> error message: >> > >> > users-MacBook-Pro:Scripts user$ /Users/user/Downloads/basex/bin/basex >> -c/Users/user/Desktop/O-Lab/Examples/Scripts/commands.bsx >> > >> > Improper use? Potential bug? Your feedback is welcome: >> > >> > Contact: basex-talk(a)mailman.uni-konstanz.de >> > >> > Version: BaseX 9.2.2 >> > >> > Java: Oracle Corporation, 12.0.1 >> > >> > OS: Mac OS X, x86_64 >> > >> > Stack Trace: >> > >> > java.lang.RuntimeException: exists: lock file does not exist. >> > >> > at org.basex.util.Util.notExpected(Util.java:61) >> > >> > at org.basex.data.DiskData.finishUpdate(DiskData.java:246) >> > >> > at org.basex.core.cmd.ACreate.update(ACreate.java:97) >> > >> > at org.basex.core.cmd.Add.run(Add.java:56) >> > >> > at org.basex.core.Command.run(Command.java:257) >> > >> > at org.basex.core.Command.execute(Command.java:93) >> > >> > at org.basex.api.client.LocalSession.execute(LocalSession.java:132) >> > >> > at org.basex.api.client.Session.execute(Session.java:36) >> > >> > at org.basex.core.CLI.execute(CLI.java:92) >> > >> > at org.basex.core.CLI.execute(CLI.java:76) >> > >> > at org.basex.core.CLI.execute(CLI.java:63) >> > >> > at org.basex.BaseX.<init>(BaseX.java:80) >> > >> > at org.basex.BaseX.main(BaseX.java:42) >> > >> > >> > The command file I am trying to have basex accept looks like this: >> > >> > >> > >> > OPEN exists >> > >> > ADD >> /Users/user/Desktop/O-Lab/Examples/cubesat/BINARIES/BINARY-03abaa7c-18fd-40a4-a26b-4be24089cfe4 >> > >> > >> > With many more "ADD ..." commands to follow. >> > >> > >> > Any advice on how to perform this operation would be greatly >> appreciated. >> > >> > >> > Thanks, >> > >> > >> > Jordan Castillo >> >

1 0

BaseX: Use and Error Questions
by Jordan Castillo 20 Jun '19

20 Jun '19

Hello BaseX Staff, I am a developer who is new to BaseX and am getting stuck sending commands through the basex executable. My goal is to either open the CLI executable and send a command (through a script), or send the command without the basex CLI opening, as long as the command is run. In my recent attempt that I thought was close, I received the following error message: users-MacBook-Pro:Scripts user$ /Users/user/Downloads/basex/bin/basex -c/Users/user/Desktop/O-Lab/Examples/Scripts/commands.bsx Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.2.2 Java: Oracle Corporation, 12.0.1 OS: Mac OS X, x86_64 Stack Trace: java.lang.RuntimeException: exists: lock file does not exist. at org.basex.util.Util.notExpected(Util.java:61) at org.basex.data.DiskData.finishUpdate(DiskData.java:246) at org.basex.core.cmd.ACreate.update(ACreate.java:97) at org.basex.core.cmd.Add.run(Add.java:56) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.api.client.LocalSession.execute(LocalSession.java:132) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:92) at org.basex.core.CLI.execute(CLI.java:76) at org.basex.core.CLI.execute(CLI.java:63) at org.basex.BaseX.<init>(BaseX.java:80) at org.basex.BaseX.main(BaseX.java:42) The command file I am trying to have basex accept looks like this: OPEN exists ADD /Users/user/Desktop/O-Lab/Examples/cubesat/BINARIES/BINARY-03abaa7c-18fd-40a4-a26b-4be24089cfe4 With many more "ADD ..." commands to follow. Any advice on how to perform this operation would be greatly appreciated. Thanks, Jordan Castillo

2 1

Hyphenation with XQuery
by Zimmel, Daniel 20 Jun '19

20 Jun '19

Hi, somewhat off-topic to BaseX, but I wonder if anybody already tried to port the TeX hyphenation algorithm to XQuery? See for example this Python port: https://nedbatchelder.com/code/modules/hyphenate.py >>> hyphenate_word("supercalifragilisticexpialidocious") ['su', 'per', 'cal', 'ifrag', 'ilis', 'tic', 'ex', 'pi', 'ali', 'do', 'cious'] Best, Daniel

2 2

Using the attribute index to get attribute values
by France Baril 12 Jun '19

12 Jun '19

Hi, I have been implementing more queries that use the attribute indexes lately. However a lot of my queries require getting values to offer selectable items in user forms (GUI). I have not found a good way to do that. For example, I tried changing : let $account-types := distinct-values(db:open($db-name)//account/@type) to let $account-types := distinct-values(db:attribute-range($db-name, 'a', 'zzzzzzzzzz', 'type')[parent::*/name() = 'account']) I looked for a function that would be more like let $account-types := db:attribute-values($db-name, 'type')[parent::*/name() = 'account] I'm not getting any performance improvements with the db:attribute-range compared to the regular db:open($db-name). and I am assuming that the issue is that since I provide a range, it has to check every value individually as opposed to just grabbing everything in the named attribute. Any chance we can get values at some point? Or do you have a suggestion to improve this type of query? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 3

Docker basex/basexhttp 9.2.2?
by Jörn Willhöft 12 Jun '19

12 Jun '19

Hi BaseX Team, I just realized, that there is no current docker release for BaseX 9.2. Which contains a feature (www-authenticate override) I need. Is it planned to be released soon? As I easily migrated from 9.1.2 it shouldn't be much effort. Cheers, Jörn

2 3

Use of xs:hexBinary() comes with strange results
by Andreas Mixich 11 Jun '19

11 Jun '19

Hi, I came around this, the other day: (: results in � (some (unknown?) binary char) :) declare function local:test1($string) { xs:hexBinary($string) }; (: results in *[convert:string] String conversion: Decoding error: xff.* :) declare function local:test2($string) { convert:binary-to-string(xs:hexBinary($string)) }; (: results in Ê� :) declare function local:test3($string) { xs:hexBinary($string) ,convert:binary-to-string(xs:hexBinary($string), "UTF-8", true()) }; let $input1 := "c3" let $input2 := "28" return ( local:test3($input1), local:test3($input2) ) I came around this, when I wanted to unescape an IRI by converting the 2 digits after the '%' to their character representation. What buffles me the most is, that in local:test1#1 I get the unrecognizable binary char for the xs:hexBinary call. If, however, as done in local:test2#1 the very same expression becomes part of a sequence, then I get back the desired character. And if I use convert:binary-to-string#1 I get an error, while using the 3-arity version, I do not get the error, but the unreadable binary char. How can I simply get back any character, readable by a human, from a hexadecimal value? -- Minden jót, all the best, Alles Gute, Andreas Mixich

2 1

Re: [basex-talk] Health Analyzer registration issue
by Ganesh Joshi Regmi (c) 11 Jun '19

11 Jun '19

Hi Team, I am trying to register the VMware Health Analyser OVA with code that I received after registering via my employee email. However, I am unable to complete the registration with below error. [cid:image001.png@01D52064.82450F00] Can you please look at this and revert back with solution. Cheers, Ganesh Ganesh Joshi Regmi | Senior PSO Consultant VCP-4,5,6 | VCP- NV | VCAP-NV | VCAP-DCA VMware Australia & New Zealand<http://www.vmware.com/> +61 452 409 609 | gjoshiregmi(a)vmware.com<mailto:gjoshiregmi@vmware.com> Level 8 175 Pitt Street, Sydney NSW 2000 [Mware]<http://www.vmware.com/> [signature_1983795089][signature_706459014][signature_1104082849][signature_1647313773]

2 1