- BaseX-Talk - mailman.uni-konstanz.de

db:create, language values
by France Baril 26 May '16

26 May '16

Hi, Is it possible to add the list of supported values in the doc for LANGUAGE at: http://docs.basex.org/wiki/Options#Indexing. LANGUAGE *Signature* LANGUAGE [lang] *Default* en *Summary* The specified language will influence the way how an input text will be tokenized. This option is mainly important if tokens are to be stemmed, or if the tokenization of a language differs from Western languages. See Full-Text Index <http://docs.basex.org/wiki/Indexes#Full-Text_Index> for more details. Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 6

A db can only be copied once...
by France Baril 25 May '16

25 May '16

Hi, Since a DB cannot be created dynamically from a restxq call, I'm trying to create some databases by copying an existing one (an empty DB with all the desired parameters). However, it seems that I am unable to create multiple instances from the same DB template. Is there a reason for this limit? I am providing a different target name for each, so technically there shouldn't be any duplicate writing. Any workaround to suggest? Beside the creation of multiple template DB source? Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

file store question
by Wang, Genneva 25 May '16

25 May '16

Hi BaseX gurus, I noticed that if the resource is persisted in basex, there is a way to tell what type of the resource it is(db:content-type?). However, I’m wondering for new resources to be persisted, is there a way to determine ? Or mostly needs to rely on the application to determine which basex call to be make ? I’m seeing on the document that db:store is to persist binary database and use db:add for other documents. Does it mean that the caller really need to know the type of the resource, in order to determine which db function to call ? Thanks much for your help. Regards, -Genneva

2 1

Open Document spreadsheets and column position
by Graydon Saunders 24 May '16

24 May '16

Hi all -- So in Open Document Spreadsheets, columns with empty cells may be collapsed: <table:table-row table:style-name="ro2"> <table:table-cell table:number-columns-repeated="3" table:style-name="ce454" /> <table:table-cell table:style-name="ce255" /> <table:table-cell table:style-name="ce255" office:value-type="string"> <text:p>label</text:p> </table:table-cell> <table:table-cell table:style-name="ce255" office:value-type="string"> <text:p>description</text:p> </table:table-cell> <table:table-cell table:number-columns-repeated="4" table:style-name="ce455" /> </table:table-row> Not all of the rows have have these collapsed empty cells; in some rows, all the cells are present because they've got values in them. And while I wouldn't care in the example row, sometimes more than one table:table-cell represents a collapsed column in a position I care about. All the labels are in column D and all the descriptions in column E (in spreadsheet terms), whether all the table:cell elements are present in the XML representation of the sheet or not, and I need to reliably find them so as to be able to convince myself that the XSLT transform is getting correct answers. (The spreadsheet is about 40 MiB; not so much by recent list standards, but still more than I can hope to read. :) declare function local:realPos($current as node()) as xs:integer { (: the horror, the horror :) xs:integer(path($current) ! tokenize(.,'/')[last()] ! replace(.,'.*\[(\p{Nd}+)\]','$1') ! xs:integer( .) + sum($current/preceding-sibling::table:table-cell/@table:number-columns-repeated) - count($current/preceding-sibling::table:table-cell/@table:number-columns-repeated) ) }; works, in the sense of "will get the cell corresponding to the intended spreadsheet column even when some of the columns have been collapsed with @table:number-columns-repeated". It's horribly slow and it hurts just to look at, though, so -- is there a better way? (The XSLT transform pre-processes all the collapsed table:table-cell elements back into place, among other tidying. I'm not at all sure that's a better way with XQuery.) Thanks! Graydon

2 2

Stopping the http server
by France Baril 24 May '16

24 May '16

Hi, A client of mine has multiple users who are able to start/stop the server. The issue though is that the person who starts the server is the only one who can stop it. Some research led to this site that explains how to use secret keys to allow for stopping the server http://www.eclipse.org/jetty/documentation/current/runner.html. Configuring stop You can configure a port number for jetty to listen on for a stop command, so you are able to stop it from a different terminal. This requires the use of a "secret" key, to prevent malicious or accidental termination. Use the --stop-port and --stop-key parameters as arguments to the jetty-runner: > java -jar jetty-runner.jar --stop-port 8181 --stop-key abc123> java -jar jetty-runner.jar --stop-port 8181 --stop-key abc123 Then, to stop jetty from a different terminal, you need to supply the same port and key information. For this you’ll either need a local installation of jetty, the jetty-maven-plugin <http://www.eclipse.org/jetty/documentation/current/jetty-maven-plugin.html>, the jetty-ant plugin <http://www.eclipse.org/jetty/documentation/current/ant-and-jetty.html#jetty…>, or write a custom class. Here’s how to use a jetty installation to perform a stop: > java -jar start.jar --stop-port 8181 --stop-key abc123 --stop> java -jar start.jar --stop-port 8181 --stop-key abc123 --stop In our case, Jetty is started through the BaseX start script. Is there any way we can use a secret key as explained above through the BaseX start/stop server scripts? Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 5

add resource from client
by Gilad Wagner 24 May '16

24 May '16

Hi There, I need to load our db from a client xml, the problem is the server cannot reach the client so remote url is not an option. I think I need to use the -I/-i options, but I couldn't find documentation about how to use it. Can you show me a little example? Thank you! Gilad.

2 7

Creating db in restxq interface
by Henning Phan 23 May '16

23 May '16

Hi, My question is how do you create a new database in restxq?When trying to create a db I get the error msg:HTTP Error 400[XUST0001] element constructor: no updating expression allowed.Some digging around and I learned that I might need the "updating" annotation though even after the change it gives the same error.My file looks like this now:=========== File start ================ declare %rest:path("/start") %updating %output:method("xhtml") %output:omit-xml-declaration("no") %output:doctype-public("-//W3C//DTD XHTML 1.0 Transitional//EN") %output:doctype-system("http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd") function page:hello() as element(Q{http://www.w3.org/1999/xhtml}html) { <html xmlns="http://www.w3.org/1999/xhtml"> <title>Good day Sir!</title> <link rel="stylesheet" href="static/w3.css"/> <time>The current time is: { current-time() }</time> <body class="w3-container"> <ul class="w3-navbar w3-green"> <li><a href="#">Home</a></li> <li><a href="#">Link 1</a></li> <li><a href="#">Link 2</a></li> <li><a href="#">Link 3</a></li> </ul> <ul>{ for $result in db:open('factbook')//continent/@name return <li>{ data($result) }</li> }</ul> <li> { db:create("test") } </li> </body> </html> =========== File End ================

3 5

Querying Basex from a web interface
by Bram Vanroy | KU Leuven 22 May '16

22 May '16

Hello all I have been reading through many emails on this list and I've learnt a lot about how Basex works and how others use it. A month or so back I have sent an email myself to this list concerning caching. Even though I have some more questions about that, I will leave that for another time. Today I am concerned about retrieving chunked input from Basex. (Question also found on StackOverflow, with a nice bounty! :) http://stackoverflow.com/questions/36675388/efficient-and-user-friendly-way- to-present-slow-loading-results) Case at hand: we use Basex to query a 50 million tokens corpus. We also make this available to other users through a website. The thing is that this is slow. For our own projects that's no problem, we dive straight into the back-end and run a search command from terminal and let the query run for all the time it needs. However, for users it is paramount that they get a quick response. At the moment it is taking too long. I don't blame BaseX. We love BaseX and are astounded by its efficiency and optimisations! However, we want to deliver the best user-experience to our users. We call a new session from PHP, wait to receive the results, do some post-processing and then load the result page. As said, this takes too much time. We've been looking into some solutions. The best one that I think should be possible, is returning chunks of the results. Do you know those websites that allow you to see results but only, like, 20 per page? I think something similar is appropriate. When a user has searched for a pattern, we only show the 20 or so first results just so they can get an idea of the results they'd find. Then, when they click a button, we should query for the twenty next results which are then appended to the list (JavaScript solution I guess), and so on. Until all results have been found. Additionally, I will also provide a button from which users can download all results in a text file. This is allowed to take a longer time. The main thing is that users should get early feedback and results on their query. Now the question is if something like this is possible in an efficient manner in BaseX. Can you form a query that only finds the 20 first results, and then the following 20 and so on - and is this faster than searching everything at once? In other words, when I am searching for the results 120-140 (after having pushed the button a couple of times), is BaseX smart enough to skip the search space it has already done to find the 120 previous hits? If so, that would be great. Could you help me on my way, with some PHP/XQuery code that is suitable? I also highly encourage you to participate on StackOverflow. As I said, I am offering a 200 bounty - for the people who are interested in Internet fame. :) Thank you for your time Kind regards Bram Vanroy http://bramvanroy.be

2 8

dba lags on replace resource
by Marco Lettere 22 May '16

22 May '16

Hi all, I have a single resource in a db. I perform several replace operations on that resource. The dba interface shows an increasing number of resources available in the db according to the number of replace operations performed. To get the count of resources back to 1 I need to optimize the database. When opening the database the visible content is however correct (showing the only one resource). Feels like dba is somehow lagging the information displayed with respect to the db content .... Regards, Marco.

3 5

RESTXQ and xsd validation strangeness
by Marco Lettere 22 May '16

22 May '16

Dear all, this question triggers a dejavu in my head and I'm pretty sure this has been discussed some time ago so I'm not sure why it strikes back at us ... With the latest snapshot (but with 8.4.4 it's the same) downloaded just few minutes ago I start the basehttp server. Then I add the foolowing RestXQ to the restxq.xqm file: declare %rest:path("/testxsd") %rest:POST("{$body}") %rest:consumes("application/xml") function page:testxsd($body){ validate:xsd-info($body, "xsd.xsd") }; I store the following dummy xsd as xsd.xsd in the webapp folder: <?xml version="1.0"?> <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema"> <xs:element name="a"/> </xs:schema> I invoke the restxq with: curl -vd "<a/>" http://localhost:5000/testxsd -H "Content-type:application/xml" Getting back the following error: Error 400 Stopped at /tmp/basex/webapp/restxq.xqm, 12/20: [bxerr:BXVA0002] Validation could not be started: Resource "/tmp/basex/POST.xml (No such file or directory)" not found.</title> This happens no matter what xml and what xsd is used. If I change $body with <a/> in the call to validate:xsd-info everything works smoothly ... Any ideas? Thanks, Marco.

3 2

Re: [basex-talk] Faceted search
by Finney, Tim 22 May '16

22 May '16

Hi All, I would love to see faceted search capability. Sorry, but I can't offer sponsorship. Two things I would love to see in BaseX are faceted search capability (fast, index-based) and role-based security. Best, Tim Finney ------ Hi Greg, currently there is no out-of-the-box functionality, yet there is an EXPath Specification that handles facets: http://expath.org/spec/facet We have not yet implemented it in BaseX, but we might eventually if there is enough interest and maybe even a sponsor :-) Would that module cover your needs? Best Michael

3 3

connection question
by Wang, Genneva 22 May '16

22 May '16

Hi basex gurus, One other question. We internally have connection pools of 20 connecting to basex. While trying to do performance stress test using Jmeter, we found out that if we submit more than the configured connection pool, say submit 30 connections, we noticed that the connection will not be recovered and the connection pool size will be in a un-recovereable stage (to pool size 0 eventually). I was just wondering does basex does any queueing on the receiving the incoming transactions, or is this something that the application needs to handle? Any tips would be greatly appreciated! Thank you very much. Regards, —Genneva

2 1

Basex: basexhttp Failing to Start with "Server is running or permission was denied"
by Sovello Hildebrand Mgani 22 May '16

22 May '16

Hi! I have downloaded BaseX 8.4.4 and running it on Ubuntu 14.04[.4] I have added basex/bin to $PATH so I can be able to run basex, basexhttp ecc. I can successfully run basex and basexserver. RUnning the HTTP server fails with this message *$ basexhttp* [main] INFO org.eclipse.jetty.server.Server - jetty-8.1.18.v20150929 [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [main] INFO / - Aliases are enabled! Security constraints may be bypassed!!! Server was started (port: 1984). [main] INFO org.eclipse.jetty.server.AbstractConnector - Started SelectChannelConnector@0.0.0.0:8984 HTTP Server was started (port: 8984). Server is running or permission was denied. Server was stopped (port: 1984). and the output when I run *$ basexhttp -d* DEBUG: true BaseX 8.4.4 [HTTP Server] [main] INFO org.eclipse.jetty.server.Server - jetty-8.1.18.v20150929 [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet [main] INFO / - Aliases are enabled! Security constraints may be bypassed!!! WEBPATH: /opt/oim/basex/webapp DEBUG: true Server was started (port: 1984). [main] INFO org.eclipse.jetty.server.AbstractConnector - Started SelectChannelConnector@0.0.0.0:8984 HTTP Server was started (port: 8984). java.net.BindException: *Address already in use* at java.net.PlainSocketImpl.socketBind(Native Method) at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:387) at java.net.ServerSocket.bind(ServerSocket.java:375) at java.net.ServerSocket.bind(ServerSocket.java:329) at org.basex.BaseXHTTP$StopServer.<init>(BaseXHTTP.java:430) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:147) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) Server is running or permission was denied. Server was stopped (port: 1984). Which shows address is already in use. I only have apache2 and have run apache2 and tomcat earlier on the same laptop without issues, and I don't have any service that is listening on that port 8984. (I have tried running BaseX from version 8.0 and get the same errors). Am not sure what is not OK. Can you give me pointers to resolve this? Cheers -- :: Sovello Hildebrand Mgani :: --If you teach man to fish, you'll feed him a lifetime--

3 2

file:write - check, if path is existing
by Günter Dunz-Wolff 20 May '16

20 May '16

Hi all, for the command file:write($path, distinct-values($list)) I have to check, if $path is existing (for example let $path := ´users/xxx/xxx/etc’. How is it done in XQuery? Thanks for any help. Cheers, Günter

3 2

Xquery recursion and db:add() - stack overflow
by Lars Johnsen 18 May '16

18 May '16

The following code generates the error "Stack Overflow: try tail recursion?" The code reads in bibliographic data using OAI-PMH and updates a database for each chunk of data. With OAI-PMH, only part of the data is available for each request, so the server returns a resumption token if there are more data available. The xquery function making the queries is implemented recursively preceded by a database update request (see the last two lines) for each call. Is it db:add() that causes the stack overflow? The recursion cannot be placed further towards the end! declare %updating function local:getResumption($token) { if (empty($token)) then () else let $http-request := http:send-request($http-option, $URL || $token) let $result := if ($http-request instance of node()) then $http-request else <http-err>{$http-request}</http-err> let $resume := $result//oai:resumptionToken/text() return ( db:add($database,element chunk {$result//oai:metadata}, $path) , local:getResumption($resume) ) }; Best, Lars

4 8

Faceted search
by Murray, Gregory 18 May '16

18 May '16

Hello, Does BaseX have built-in support for faceted search? I see that there's an easy way to get the facets for the entire database using index:facets(), but is there way to get search results that includes a similar list of facets, based only on those results? Thanks, Greg

2 3

question
by Rob Stapper 17 May '16

17 May '16

Hi Chistian, In order to get some path to the element that is being processed I hoped that the following statement [ 1] would return a sequence of positions of each node amongst its siblings. Unfortunately it only returns a bunch of: 1. [ 1] $element/ancestor-or-self::* ! ./fn:position() Should this work? Is there some other ;-) clever way to retrieve a path to a random element that is being processed? TIA for your reply, Rob Stapper

6 6

How to restrict access to restxq functions just for the same domain
by Ioan Fericel 13 May '16

13 May '16

Hi, I seemed that this is the behavior if disabling REST Service in web.xml (BaseX.war deploymented on Tomcat), but this does not happen. The surprise is that the functions are accessible from anywhere, if access is not protected by other methods. I'm doing wrong, what should be setting? I use BaseX 8.3. Thanks for any guidance! Ioan

2 2

Basex on maven central
by Lance Java 13 May '16

13 May '16

It seems that maven central is not up to date with the latest basex version. I see here that there's only version 7.3.1 whereas on the basex website the latest version is 8.4.4 http://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.basex%22 Are there any plans to keep maven central up to date with basex releases?

3 2

Recursion error
by Alex R. Loayza 11 May '16

11 May '16

When performing a query on BaseX on a Windows 8 PC, the query runs normally. When doing the same query on a copy of the database in another Windows 8 PC, I get "[bxerr:BASX0005] Stack Overflow: Try tail recursion?" Any ideas as to what could be causing this difference in behavior? Thank you. Alex

1 1

dba lags on update
by Marco Lettere 10 May '16

10 May '16

Hi all, I have a single resource in a db. I perform several replace operations on that resource. The dba interface show an increasing number of resources available in the db according to the number of replace operations performed. To get the count of resources back to 1 I need to optimize the database. Anyway, when opening the database the visible content is correct (only the one resource). Seems like the dba interface counts the gone instances of the resource as well ... Regards, Marco.

1 0

Re: [basex-talk] Executing xq file from client fails
by Christophe Marchand 10 May '16

10 May '16

Problem solved. A database file was corrupted. Re-creating the database solved the problem. Best, Christophe Le 10/05/2016 12:00, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Message: 1 > Date: Mon, 09 May 2016 16:09:03 +0200 > From: cmarchand(a)oxiane.com > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] Executing xq file from client fails > Message-ID: <8eb5f02e745a4ce0f8cb6ff6dc587425(a)oxiane.com> > Content-Type: text/plain; charset="us-ascii" > > > > Hello, > > while running a .xq file on a database generates this error. > > The error is database-content relative ; with some data I have the > error, with other data, I do not have the error. > > my lanceClient.sh is just /usr/local/basex4/bin/basexclient > -nFR003-D0659 -p4984 -Ubasex -Pbasex $* > > Any hint to help me find where I have to search ? > > I can provide the .xq* files but for data, it wil be complicated : I > have more than 7Gb in one collection (which never changes) ; other > filewhich generates the error is 1.8Mb and can be provided, if needed. > > Best regards, > > Christophe > > $ ./lanceClient4.sh -d > -bp-repertoire-output=/home/efladm/webbuint/uaur/om-work/orders/ > /home/efladm/webbuint/uaur/om-work/xquery/create-orders-formulaires.xq > org.basex.core.BaseXException: Improper use? Potential bug? Your > feedback is welcome: > Contact: basex-talk(a)mailman.uni-konstanz.de > Version: BaseX 8.2.3 > Java: Oracle Corporation, 1.8.0_51 > OS: Linux, amd64 > Stack Trace: > java.lang.NullPointerException > > at org.basex.api.client.ClientSession.receive(ClientSession.java:193) > at org.basex.api.client.ClientSession.execute(ClientSession.java:162) > at org.basex.api.client.ClientSession.execute(ClientSession.java:167) > at org.basex.api.client.Session.execute(Session.java:36) > at org.basex.core.CLI.execute(CLI.java:103) > at org.basex.BaseX.<init>(BaseX.java:121) > at org.basex.BaseXClient.<init>(BaseXClient.java:40) > at org.basex.BaseXClient.main(BaseXClient.java:27) > Improper use? Potential bug? Your feedback is welcome: > Contact: basex-talk(a)mailman.uni-konstanz.de > Version: BaseX 8.2.3 > Java: Oracle Corporation, 1.8.0_51 > OS: Linux, amd64 > Stack Trace: > java.lang.NullPointerException >

1 0

Executing xq file from client fails
by cmarchand＠oxiane.com 09 May '16

09 May '16

Hello, while running a .xq file on a database generates this error. The error is database-content relative ; with some data I have the error, with other data, I do not have the error. my lanceClient.sh is just /usr/local/basex4/bin/basexclient -nFR003-D0659 -p4984 -Ubasex -Pbasex $* Any hint to help me find where I have to search ? I can provide the .xq* files but for data, it wil be complicated : I have more than 7Gb in one collection (which never changes) ; other filewhich generates the error is 1.8Mb and can be provided, if needed. Best regards, Christophe $ ./lanceClient4.sh -d -bp-repertoire-output=/home/efladm/webbuint/uaur/om-work/orders/ /home/efladm/webbuint/uaur/om-work/xquery/create-orders-formulaires.xq org.basex.core.BaseXException: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.3 Java: Oracle Corporation, 1.8.0_51 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException at org.basex.api.client.ClientSession.receive(ClientSession.java:193) at org.basex.api.client.ClientSession.execute(ClientSession.java:162) at org.basex.api.client.ClientSession.execute(ClientSession.java:167) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:103) at org.basex.BaseX.<init>(BaseX.java:121) at org.basex.BaseXClient.<init>(BaseXClient.java:40) at org.basex.BaseXClient.main(BaseXClient.java:27) Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.3 Java: Oracle Corporation, 1.8.0_51 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException

1 0

Re: [basex-talk] Load 5GB xml using python
by Henning Phan 09 May '16

09 May '16

Hello,My case:1. A (non technical) user uploads a 5 GB xml which gets parsed by basex2. Does some queries to check and modify some values3. Downloads the modified 5 GB xml back. So I'm planning to allow the user to edit their xml through a web application and therefore the user must upload the xml to the web application. I'm using python and when I receive the xml I want to create a database by using the create function from the client API, but the create(name, content) forces me to load the 5GB in memory which it cannot handle. I read the java client API which takes a stream unlike the python API. Am I forced to use java? What options are there to solve this problem gracefully? Any options that involve Python? Thank you for reading this - Henning

2 1

Web application static files
by Murray, Gregory 06 May '16

06 May '16

Hello, I'm new to BaseX, and I'm setting up a simple web application (on Mac/Unix, using the ZIP distribution of BaseX). I'm unable to bring in static files like CSS. Following the documentation and the "dba" web application that comes with BaseX, I have included the following in the HTML: <link rel="stylesheet" type="text/css" href="static/app.css"/> to point to a file that resides here: ~/basex/webapp/bookplates/static/app.css I have a module sitting here: ~/basex/webapp/bookplates/controller.xqm with a function with these annotations: %rest:path("bookplates") %output:method("html") When I point my browser to http://localhost:8984/bookplates/ the server successfully returns the HTML, but when the browser tries to load the CSS it requests http://localhost:8984/bookplates/static/app.css and the server responds with a 404 saying "No function found that matches the request" as if the server is looking for a RESTXQ function. What am I doing wrong? Thanks, Greg

4 6

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk