BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Concurrent Query Execution
by happy somani 10 Jan '13

10 Jan '13

Hey Guys, I was trying a scenario out today and wanted to see if I could query two different databases in parallel. I tried out using the code attached and found that while one of the program was trying to write data to a database the other program waits for the write to the database to finish before it could read data from a database. I am attaching the code in this email and here are the steps that you would need to take to reproduce this issue. 1. Run the UploadFileTest class. (This class is trying to create a db using a large xml file) 2. Run the GetData class (This class is trying to read from a small database called sam. The sam database is being created in this program). I would appreciate if somebody could help me in setting up this concurrent query execution framework or if I have been doing something in the wrong way. Thanks. -- Regards Happy

3 3

XQuery update: updating inside a closure & how to modify a node and insert it in a DB
by Daniel Kvasnička 10 Jan '13

10 Jan '13

Hi folks, I'm trying to implement a secure RESTXQ service like this: declare %rest:path("api/users/init") %restxq:PUT("{$data}") %output:method("text") function page:init-user($data) { sec:secure(function() { let $profile := json:parse-ml(convert:binary-to-string($data)) return ( insert node attribute id { sec:get-current-user-id() } into $profile, insert node $profile as last into db:open("db")/s:root ) }) }; And I have two problems: - when executing it like this, inside of a closure, nothing happens. No modifications of the database and no errors (%updating missing) either - which is weird. Is this construct supported in 7.5? - when I remove the sec:secure call and leave only the rest (adding %updating to the declaration) the second insert runs but the first one doesn't - the node is saved without a "id" attribute. Does this have something to do with the PUL order? (http://docs.basex.org/wiki/Update#Example) Thanks for your hints! I feel like I'm overlooking something obvious... Daniel -- danielkvasnicka.net

4 9

example .basexperm files please
by pw＠themail.co.uk 09 Jan '13

09 Jan '13

hello list are there any examples of .basexperm files for use with the WAR distribution or the httpserver? what form are the global permissions described for each user? [i.e. 0777, or -rwxrwxrwx, or some other form] Is the separator a space or a tab? [does it matter?] thanks Pete

3 3

Either db:replace() or I had too much to drink this XMas
by France Baril 08 Jan '13

08 Jan '13

Hi, I am having issues with updating functions in BaseX 7.5 (official release). When I update a document, its content is updated with the content of another document. I even perform the db:optimized in a separate function after a forward to ensure that the db:replace is in fact completed before indexes are optimized. * * To replicate: you'll need a db named 'en-us' with the 3 following documents (file names don't matter): <menu id="devicehelp"/> <menu id="smbonly"/> <menu id="ptt-help"/> Then use these functions: * * *declare* %rest:path("/admin/refresh-menu-headings") %rest:GET %rest:query-param("menu-id", "{$menu-id}", "devicehelp") *updating* *function* *admin:refresh-menu-headings*(*$menu-id* *as ** xs:string*){ (:Get the content:) *let* *$raw-menu* := *app:open-db*('en-us')/*menu*[*@id* = *$menu-id* ] (:Get the file location:) *let* *$menu-uri* := *substring-after*(*$raw-menu*/*base-uri*(), 'en-us/') (:Copy the content:) *let* *$menu* := *$raw-menu* * (:Output the content in a file to ensure you have the right one:)* * **let* *$debug* := *file:write*('debug-ouch.xml', *document*{*$menu* }) (:Output the file uri to ensure you have the right one:) *let* *$debug-uri* := *file:write*('debug-uri.xml', *$menu-uri*) (:Replace the content of the file with the same content that was outputted in debug-ouch:) *return *(*db:replace*('en-us', *$menu-uri*, *$menu*), *db:output*(<restxq:forward> /restxq/admin/success/heading-refresh</restxq:forward>)) }; *declare* %rest:path('/admin/success/heading-refresh') *updating* *function* *admin:success-heading-refresh*(){ *let **$result* := <html *xmlns*=*"http://www.w3.org/1999/xhtml"*> <head><title>Add headings to menu topicrefs </title></head> <body> <h2>Add headings to menu topicrefs</h2> <ul> <li *style*=*"color:green"*>Menus were updated successfully.</li> </ul> </body> </html> *return *(*db:optimize*('en-us'), *db:output*(*$result*)) RESULT: The result after optimize if your query for a list of the /menu/data(@id) should be devicehelp, smbonly, ptt-help, but it's ptt-help, smbonly, ptt-help. debug-ouch.xml shows the correct content (content of menu devicehelp), debug-uri shows the right file path (path of menu ptt-help), yet the content of menu with @id devicehelp gets replaced by the content of menu with @id=ptt-help after db:replace. Note: If I use db:optimize('en-us', true()), I get 'unexpected error: 0' -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 6

Request for UPDINDEX option setting via BaseX GUI
by France Baril 05 Jan '13

05 Jan '13

Hi, I could not find how to set the UPDINDEX option to true() in the BaseX Gui. I also looked in .basexgui. Can you tell me where it is, or may I submit a request to include it. I could write a script, but it's so much easier to get my users to import content with the GUI. Best regards, France -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 1

Trying to learn BaseX
by Kenneth Ellested 05 Jan '13

05 Jan '13

Hi, I'm new to BaseX and researching it at the moment, and therefore I have a couple of questions starting to build up. 1. Modules seems to be compiled on every request in the GUI. Adding something like "funqtx" to the imported modules increases the query overhead by ~50ms. Is there a way to precompile modules, other than writing a native java plugin (or is this actually just a GUI designed feature, making you able to edit module files in between requests)? 2. What are collections good for as opposed to storing documents individually. I'm looking for a way to generate sequential ID's, and currently uses a method described on the list, where the count is hold in a containing node like <somecollection nextid="1234"><item id="1"> . <item id="1233"></somecollection> I'm not sure but I think I've seen other XML databases use document collections for keeping automated track of document id's - is there something similar for BaseX? 3. How do you make sure that you are not overwriting documents with stale data. Do you use locking attributes (optimistic locking)? 4. I like the idea of being able to reshape the data with greater ease in the future, but at the same time it's also a little scary to have data stored in a form that is not structured in terms of what values a field may take and so on. I know that XML schemas or DTD's might help in this, but what kind of impact can be expected when introducing such validation mechanisms (in particular on inserts and updates). I'm sure some of it depends on the complexity of the documents, but are the Schema for example cached so that it does not need to be read and parsed on each request? I'm generally impressed with the speed and feature set of BaseX, and I'm happy to see that you have also included Session variables to help in building web applications to run directly of the server. Unfortunately I will also need binary storage (load/save files over http) for the particular application that we have under development/design and I'm not sure whether this is possible in the current release (I've read something about XQuery only being able to handle UTF8). It's a little hard to search the mailing list (have you considered a forum J) for questions regarding specific areas of interest, so I hope that my questions are not already answered 300 times in the past - and please forgive me if that's the case. It would be of great help if there was more information on how to get started with designing an application for BaseX. I mean, when you still think RDBM's it's not obvious how to navigate and find solutions within the BaseX paradigms. It might help to see a real world BaseX application, addressing a classic application preferably including handling of errors, transactions and locking. Best regards Kenneth

2 1

example .basexperm files please
by pw＠themail.co.uk 02 Jan '13

02 Jan '13

hello list are there any examples of .basexperm files? what form are the permissions in? [i.e. 0777, or -rwxrwxrwx, or some other form] Is the separator a space or a tab? [does it matter?] thanks Pete

1 0

Re: [basex-talk] Initial xquery for full text and geospatial search of ISO 19115 docs
by David Stuebe 02 Jan '13

02 Jan '13

Hi Chris I did look at the Query Info in the Gui and it seems you are correct. The complex query I created is not utilizing the full text index. Details here: https://gist.github.com/4438473 The gist contains query info for the complex search that I created and for a simple one that just executes the 'contains text' clause. The compile statement for the simple query includes the following line: "applying full-text index" The complex query does not… So what to do now? How do I figure out why basex is not using the full text index as the initial step in limiting the results of my search? Thanks David From: "basex-talk-request(a)mailman.uni-konstanz.de<mailto:basex-talk-request@mailman.uni-konstanz.de>" <basex-talk-request(a)mailman.uni-konstanz.de<mailto:basex-talk-request@mailman.uni-konstanz.de>> Reply-To: "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Date: Tue, 1 Jan 2013 06:00:02 -0500 To: "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: BaseX-Talk Digest, Vol 37, Issue 1 Message: 1 Date: Mon, 31 Dec 2012 20:56:01 +0100 From: Christian Gr?n <christian.gruen(a)gmail.com<mailto:christian.gruen@gmail.com>> To: David Stuebe <DStuebe(a)asascience.com<mailto:DStuebe@asascience.com>> Cc: Kyle Wilcox <KWilcox(a)asascience.com<mailto:KWilcox@asascience.com>>, "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: Re: [basex-talk] Initial xquery for full text and geospatial search of ISO 19115 docs Message-ID: <CAP94bnPneuWguMGL-k2ZMw6gCD4WQNc82KBR5es8h+BrZ1fs2Q(a)mail.gmail.com<mailto:CAP94bnPneuWguMGL-k2ZMw6gCD4WQNc82KBR5es8h+BrZ1fs2Q@mail.gmail.com>> Content-Type: text/plain; charset=windows-1252 Hi David, thanks for the insight into your project. It may be that the full-text index is not utilized by your XQuery expression. Did you have a look at the query info (e.g. via GUI, InfoView, or -V on command line)? Did you manage to write simpler queries that are processed faster? Best, Christian ___________________________ On Mon, Dec 31, 2012 at 7:31 PM, David Stuebe <DStuebe(a)asascience.com<mailto:DStuebe@asascience.com>> wrote: Hi Basex Folks I have written a simple minded xquery script which can be used in a post to search ISO 19115 metadata documents. As I am a newbie to xquery and basex I expect that is much that I could do to improve performance, but currently searches take up to 15 seconds. The server hardware is not blazing fast and we are running inside tomcat? but that is certainly not acceptable for a database which is still quiet small. Initially it was fine, responding in less than a second, but when we expanded from less than 100 docs to about 35000 the time grew at least linearly. I am hoping this is due to my poor xquery programming or a setting on the server. Here is the query we are running using a post request with the declared variables at the bottom filled in by the UI: https://github.com/asascience-open/glos_catalog/blob/master/queries/full_se… Here are some of the ISO xml documents that we have in our basex DB: https://github.com/asascience-open/glos_catalog/tree/master/ISOs It is used by this site: http://explorer.glos.us/ To provide geospatial metadata search. Fill in a text value like "water" or "temperature" in the search box in the top right? The server is here: http://64.9.200.113:8080/BaseX73/ User Name: user Password: glos ACL: read only I am hoping it is as simple as a setting on the basex server. Here is the current server info: info database Database Properties Name: glos Size: 422 MB Nodes: 17045388 Documents: 34922 Binaries: 0 Timestamp: 27.12.2012 00:58:03 Resource Properties Timestamp: 22.12.2012 01:43:05 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON Full-Text Index: ON The index info is available here: https://github.com/asascience-open/glos_catalog/blob/master/queries/glos_in… David Stuebe Scientist & Software Engineer ? RPS ASA 55 Village Square Drive South Kingstown, RI 02879-8248 Tel: +1 (401) 789-6224 Email: David.Stuebe(a)rpsgroup.com<mailto:David.Stuebe@rpsgroup.com> www: asascience.com | rpsgroup.com A member of the RPS Group plc _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de<mailto:BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 2

Fwd: concat string in for loop
by Jarosław Kowalewski 02 Jan '13

02 Jan '13

Hi, I've a problem with concatation strings in for loop. e.g. xquery concat("text",'
',"additional text"), '
', '
', for $i in <root><a>element-a</a><b>element-b</b></root>/* return concat($i,'
') give me the result " text additional text element-a element-b " with additional space before "element-a" and "element-b" but the concatation in the first row works fine. I tried it in GUI mode version 7.3 and 7.5. Jarek

2 1

how to know creation options of a database
by Fabrice Etanchaud 02 Jan '13

02 Jan '13

Dear all at BaseX, How can I know the creation options of a given database ? When I open a database created with a few non default options (MAXCATS set to 10000) for example, GET MAXCATS seems to always return the last value set with SET MAXCATS. Regards, Fabrice Etanchaud Questel-Orbit

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk