BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5245 discussions

Fwd: Re: Mailing list help
by Christian Grün 30 Dec '12

30 Dec '12

Dear all, the mailing list is currently not available outside the University of Konstanz. We will report back as soon as we know what is causing the problems. Sorry for that, Christian

1 1

Re: [basex-talk] Java Heap Space Error
by Dirk Kirsten 29 Dec '12

29 Dec '12

Dear John, should work as well on the mailing list, so I am answering on the list. Maybe someone else can benefit from your question as well. For an OutOfMemoryException I would always simply try to increase the Java Heap space using the -Xmx option starting BaseX. if this is not helping, maybe some bug was introduced in a newer version. To check this we need a simple self-contained example, i.e. a simple query and some data to demonstrate the problem. Cheers, Dirk On Fri, Dec 28, 2012 at 8:02 AM, John Best <johnbest5673(a)gmail.com> wrote: > Dear Dirk, > > The mailing list returned the mail, that's why mailing you :) > > I am getting Java heap Space Error while searching a string... > 3 days ago, while I searched "Today is Christmas", everything went well. > But today, when I searched same > string, I got following error. Then I tried, "Today is", result same ie > error.... > > My DB, after FT Indexing is 374 MB. Using BaseX 7.5. > > > java.lang.OutOfMemoryError: Java heap space > at org.basex.index.ft.FTIndex$FTCache.<init>(FTIndex.java:466) > at org.basex.index.ft.FTIndex.iter(FTIndex.java:399) > at org.basex.index.ft.FTIndex.iter(FTIndex.java:132) > at org.basex.data.Data.iter(Data.java:159) > at org.basex.query.ft.FTWords$1.next(FTWords.java:146) > at org.basex.query.ft.FTIndexAccess$1.next(FTIndexAccess.java:45) > at org.basex.query.ft.FTIndexAccess$1.next(FTIndexAccess.java:42) > at org.basex.query.path.IterPath$1.next(IterPath.java:67) > at org.basex.query.path.IterPath$1.next(IterPath.java:39) > at org.basex.query.expr.Set$SetIter.next(Set.java:99) > at org.basex.query.expr.Union$1.next(Union.java:59) > at org.basex.query.expr.Union$1.next(Union.java:54) > at org.basex.query.flwor.For$1.next(For.java:86) > at org.basex.query.flwor.FLWR$1.next(FLWR.java:63) > at > in.xxxxxxxxxxx.project.db.dbconnection.DBConnection.iterate(DBConnection.java:44) > at > in.xxxxxxxxxxx.project.yyyyyy.views.gistview.DBModelGist.getGistSearch(DBModelGist.java:32) > at > in.xxxxxxxxxxx.project.yyyyyy.views.gistview.GistTableModel.getList(GistTableModel.java:50) > at > in.xxxxxxxxxxx.project.yyyyyy.main.searchText.searchResult(searchText.java:208) > at > in.xxxxxxxxxxx.project.yyyyyy.main.searchText.access$0(searchText.java:195) > at > in.xxxxxxxxxxx.project.yyyyyy.main.searchText$1.keyPressed(searchText.java:94) > at > org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:167) > at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) > at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053) > at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1077) > at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1062) > at org.eclipse.swt.widgets.Widget.sendKeyEvent(Widget.java:1104) > at org.eclipse.swt.widgets.Text.sendKeyEvent(Text.java:1455) > at org.eclipse.swt.widgets.Widget.sendKeyEvent(Widget.java:1100) > at org.eclipse.swt.widgets.Widget.wmChar(Widget.java:1509) > at org.eclipse.swt.widgets.Control.WM_CHAR(Control.java:4640) > at org.eclipse.swt.widgets.Text.WM_CHAR(Text.java:2259) > at org.eclipse.swt.widgets.Control.windowProc(Control.java:4528) > > > -- > Have a nice day > JBest > > > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

RFE: Turning off parts of the BaseX REST interface
by C. M. Sperberg-McQueen 22 Dec '12

22 Dec '12

I am building some Web-based services for a project I'm involved with, using the BaseX REST interface, and the experience has given me an idea for a possible enhancement to BaseX. It's extremely convenient for development to be able to issue arbitrary queries from the REST interface, but in my role as part-time system administrator and worrier about security, the REST 'query', 'command', and 'get' operations worry me to death. I am happy for the user access control provided by the GRANT command, and I find myself thinking it would be even nicer to have more control. I am happy to discover by experiment that a user with READ access only to a single database sees only that database name when they issue the the default GET request (http://hostname:8984/rest). When I allow my security paranoia full sway, I find I would like to be able to ensure that only authorized users can - perform arbitrary queries using the 'query' or 'command' interfaces - perform particular queries using the 'run' interface Concretely, in this case I would like to be able to create a user for restricted access, which I'll call PUBLIC for now, and ensure that a user who presents the PUBLIC userid and password - cannot fetch any data using the GET interface - cannot run queries using the rest:query interface - cannot run commands using the rest:command interface - can run only specified modules from the HTTPPATH directory (so we can limit the portions of the database we expose to the PUBLIC user -- I think of this as very roughly analogous to being able to limit a SQL user to particular views instead of to the underlying base tables) Of course, by running a packet filter we can ensure that the BaseX server only receives packets from (or: purporting to be from) the project's host, and we can keep the user password for the PUBLIC user secret in what I believe is the usual way (it's there in the source of the PHP module, but web users don't get to see the source of the module). The restrictions I have in mind would serve the purpose of attempting to limit the damage an adversarial user could cause if the user credentials were exposed or (in the case of limiting users to specific modules) if an adversary were able to add modules to the HTTPPATH directory. Disclaimer: I am not a security expert, just (at the moment) a worrier. You will surely be able to get advice from people who understand security issues better than I do. Thank you again for this extremely helpful software. -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

Hearty Congratulations and Merry Christmas :)
by Anand Chiney 22 Dec '12

22 Dec '12

Dear BaseX Team Hearty Congratulations for 7.5 :) and Merry Christmas :) -- Regards Have a nice day :) Anand Chiney

1 0

basex SERVERHOST
by Liam R E Quin 22 Dec '12

22 Dec '12

How do I use SERVERHOST in ~/.basex (or elsewhere) to get basex to listen on the given PORT only on localhost (127.0.0.1) and not on externally-visible IP addresses? Setting SERVERHOST and HOST to localhost does not seem to accomplish this. Thanks! -- Liam Quin - XML Activity Lead, W3C, http://www.w3.org/People/Quin/ Pictures from old books: http://fromoldbooks.org/ Ankh: irc.sorcery.net irc.gnome.org freenode/#xml

2 2

server / GUI synchronization and data safety
by C. M. Sperberg-McQueen 22 Dec '12

22 Dec '12

At various points in the documentation, it is observed that the BaseX server, the BaseX client, and the GUI interface all run in different virtual machines, so the GUI and the server's databases are not synchronized. In the GUI of BaseX 7.3, I see an optional Server Administration on the Database menu, which carries the warning Warning: The client/server architecture and the GUI are not synchronized. The same database should not be opened from clients and the GUI. Does this mean that it's safe to run both the server and the GUI as long as they have different databases open? (It doesn't say that; it says it's unsafe if they have the *same* database open. You see how timid warnings can make a user!) Also - in my case it would be convenient to be able to open the GUI and do some work while the BaseX HTTP server is running. If the HTTP server handles a request directed at database X, does that database remain open indefinitely or is it closed when the request has been handled? That is, is it safe to work with database X as long as I don't pass requests against X to the HTTP server at the same time/ And third - if neither the HTTP server nor the GUI are performing any updates, but only retrievals from the database, does the warning still apply, or is read-only access from multiple instances of BaseX actually safe? (I ask because if I need to shut down the HTTP server every time I want to launch the GUI to experiment with a new function, and then shut down the GUI so I can launch the HTTP server and work on the Web interface to the new function, then I am going to want to find a more convenient way of starting and stopping the HTTP server than going into a terminal window and running the shell script.) Thank you! -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

Release BaseX 7.5 – The BaseXMas Edition
by Christian Grün 21 Dec '12

21 Dec '12

Dear subscribers, yes, it has been quite a while… Which is why we are even more excited to finally announce the release of BaseX 7.5, the BaseXMas Edition, our XML Database and XQuery Processor! Here are the latest features and changes: XQUERY UPDATE - bulk updates are now much faster than before - insert and replace operations take much less memory - databases can now be created via XQuery and db:create() GUI TEXT EDITOR - a fast and flexible search/replace panel has been added - error highlighting has been extended to XML files - the editor was improved for editing arbitrary text files XQUERY 3.0 - the code has been aligned with latest changes in the specs - HTML5 support has been updated WEB APPLICATIONS - new modules have been added: Request, Session, Sessions - logging has been revised and extended to HTTP requests - SSL support added, switched to Jetty 8 - all operation modes have been unified and simplified - RESTXQ elements added to simplify forwarding and redirects CORE FEATURES - improved stability of concurrent read/write operations - the INSPECT command performs database sanity checks - EXECUTE triggers the execution of command scripts Numerous other things have happened, which you can look up in our documentation (http://docs.basex.org). 2012 has been a great year for BaseX, which is why we are very confident that you can expect many more open source versions of our product in the future! Thanks for reading; we are looking forward to all your feedback, Christian BaseX Team 2012 PS: If you haven’t registered yet… Don’t forget to join our XMLPrague User Meeting (http://lanyrd.com/2013/basex-users-meetup-xml-prague/)!

1 0

Spatial XQuery
by David Stuebe 21 Dec '12

21 Dec '12

Hi Basex-ers I am new to the list but have been working with basex for a few weeks now. We are using basex to search ISO 19115 geospatial metadata. The full text search is simple and works better than any of the existing purpose built catalog tools we have worked with so far. I am very interested in the pervious thread on Spatial Xquery. https://mailman.uni-konstanz.de/pipermail/basex-talk/2012-January/002484.ht… I am looking over the Geo Module geospatial API<http://expath.org/spec/geo> today, and also at Zorba's Geo Module<http://www.zorba-xquery.com/html/modules/expath/geo> implementation. Has the Basex community made an further progress? The API is the first issue and so far the Geo Module definition looks great. If linear search using the existing attribute indexes is all that is available now, that is fine. It would be fantastic to write a geo spatial index to support that API in basex in the future. What type of indexes have you considered? I would think an Rtree would probably be best for supporting that API. This email is essentially a status query – as I work on this over the next week or two we can start new threads for specific topics. David Stuebe Scientist & Software Engineer – RPS ASA 55 Village Square Drive South Kingstown, RI 02879-8248 Tel: +1 (401) 789-6224 Email: David.Stuebe(a)rpsgroup.com<mailto:David.Stuebe@rpsgroup.com> www: asascience.com<http://www.asascience.com/> | rpsgroup.com<http://www.rpsgroup.com/> A member of the RPS Group plc

3 2

Restxq updating functions running indefinitely.
by France Baril 19 Dec '12

19 Dec '12

Hi, I just upgraded to 7.5 from 7.4. Everything seems to work except the Updating functions db:replace and db:store (I use db:add elsewhere and it works as it did before). There is very little information regarding what the problem could be: - I am starting the httpserver with these .basex settings: USER = admin and PASS = admin. So I do not expect the problem to be security. - Symtom: the query runs and never times out. Browser stays on empty page. I have to stop the server with the httpstop script. - Error messages in the terminal window: None. - When I start the server I get this message before the server starts: Null identity service, trying login service: null Finding identity service: null I tried two different 7.5 snapshots including today's RC1. Any clue is welcome. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 2

DTD validation
by France Baril 18 Dec '12

18 Dec '12

Hi, We are having challenges with validation. We have built a Documentation Controller for authors that create XML content. On a regular basis, we ask them to check that all documents are valid. We are running the process on hundreds of file. the ideal situation would be to collect all errors and display them of the webpage for authors to find and correct. Ex. of dream code: *let **$db* := *app:open-db*(*$lang*) *let* *$topic-validation* := <ul>{*for **$x* *in **$db*/*[* name*()='topic' or *name*()='media'] *return if* (*contains*(* validate:dtd*(*$x*, *$app:dtd-topic*), 'BXVA0001')) *then *<li>File {*$x*/* base-uri*()} doesn't validate against the DTD.</li> *else *() } </ul> *let* *$menu-validation* := <ul>{*for **$x* *in **$db*/*[* name*()='menu'] *return if* (*contains*(* validate:dtd*(*$x*, *$app:dtd-menu*), 'BXVA0001')) *then *<li>File {*$x*/* base-uri*()} doesn't validate against the DTD.</li> *else *() }</ul> *return if* (*count*(*$topic-validation*/*li*) + *count*(* $menu-validation*/*li*[*normalize-space*(.) != '']) != 0) *then *<div>{*$topic-validation*}{*$menu-validation*} </div> *else *<ul><li *style*=*"color:green"*>All menus and topics validate against the DTDs.</li></ul> Instead, as soon as validate:dtd finds one single file with an error, it crashes the web page with an error message like this: Stopped at line 270, column 77 in /Applications/basex75/webapp/restxq/How2_Admin.xqm: [BXVA0001] Validation failed: 1355790115420.xml, 3:22: Element type "headin" must be declared. On top of this, the name of the file that is referenced in the error message doesn't exist. I've been querying the DB to find errors. Ex. Search for all files with 'headin' in this case. However, we'd really like the writer to be able to find their own faulty files. Are we misusing the function? Is this a bug? What can we do about it? Thanks in advance for you help! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk