BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5269 discussions

Re: [basex-talk] Load 5GB xml using python
by Henning Phan 09 May '16

09 May '16

Hello,My case:1. A (non technical) user uploads a 5 GB xml which gets parsed by basex2. Does some queries to check and modify some values3. Downloads the modified 5 GB xml back. So I'm planning to allow the user to edit their xml through a web application and therefore the user must upload the xml to the web application. I'm using python and when I receive the xml I want to create a database by using the create function from the client API, but the create(name, content) forces me to load the 5GB in memory which it cannot handle. I read the java client API which takes a stream unlike the python API. Am I forced to use java? What options are there to solve this problem gracefully? Any options that involve Python? Thank you for reading this - Henning

2 1

Web application static files
by Murray, Gregory 06 May '16

06 May '16

Hello, I'm new to BaseX, and I'm setting up a simple web application (on Mac/Unix, using the ZIP distribution of BaseX). I'm unable to bring in static files like CSS. Following the documentation and the "dba" web application that comes with BaseX, I have included the following in the HTML: <link rel="stylesheet" type="text/css" href="static/app.css"/> to point to a file that resides here: ~/basex/webapp/bookplates/static/app.css I have a module sitting here: ~/basex/webapp/bookplates/controller.xqm with a function with these annotations: %rest:path("bookplates") %output:method("html") When I point my browser to http://localhost:8984/bookplates/ the server successfully returns the HTML, but when the browser tries to load the CSS it requests http://localhost:8984/bookplates/static/app.css and the server responds with a 404 saying "No function found that matches the request" as if the server is looking for a RESTXQ function. What am I doing wrong? Thanks, Greg

4 6

KILL session
by George Sofianos 06 May '16

06 May '16

I'm trying to create an environment where I can have mutliple BaseX Servers, and I can run 2-3 complex queries on them at a time. However, I want to have the ability to stop a running XQuery script for any reason. I assumed that's what would happen if I KILL the session using a BaseX client. However when I try to KILL a session I have the following issues: 1) BaseX client freezes and I have to CTRL-C to stop it 2) The session I try to kill is removed from the list, but the process continues to run. I have to force kill -9 the basex server for it to stop. Should I report this as a bug or is there another way to kill the running scripts? Thanks

2 1

User and Password in REST URL
by Mike Cobo 04 May '16

04 May '16

Hi all When invokling an XQuery via REST, eg. http://mydomain.com:8984/rest?run=scripts/myscript.xq I'm prompted to type in the user and password for authentication. This is ok when a script needs user authentication to connect to a database. But when the script only uses the XQuery processor to output a (generated) HTML page it would be easier if the user authentication could by included in the URL, eg http://mydomain.com:8984/rest?run=scripts/myscript.xq&user=tester&password=… Is there a way to bypass the authentication dialog this way? I tried with the parameters "user" and "password" as shown in the example above, but this dosn't work. ThnxMike

2 2

Re: [basex-talk] Runtime Exception
by Christian Grün 04 May '16

04 May '16

Dear Mansi, you could try to run the INSPECT command on the affected database, or all databases, in order to find out if your database has gone corrupt. Did you repeatedly come across this error? Best, Christian Am 25.04.2016 16:45 schrieb "Mansi Sheth" <mansi.sheth(a)gmail.com>: > > Hello, > > My current BaseXDB is at 920GB, with ~230 databases... I run jetty server visa basexhttp script with giving it explicit 30GB of RAM. While trying to access a query, thru REST api via XQUERY, I get below error. > > HTTP/1.1 400 Bad Request^M > Content-Type: text/plain;charset=UTF-8^M > Content-Length: 4207^M > Server: Jetty(8.1.16.v20140903)^M > ^M > Improper use? Potential bug? Your feedback is welcome: > Contact: basex-talk(a)mailman.uni-konstanz.de > Version: BaseX 8.2.3 > Java: Oracle Corporation, 1.7.0_95 > OS: Linux, amd64 > Stack Trace: > java.lang.RuntimeException: Data Access out of bounds: > - pre value: 126882320 > - #used blocks: 495643 > - #total locks: 495643 > - access: 495642 (495643 > 495642] > at org.basex.util.Util.notExpected(Util.java:60) > at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:458) > at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) > at org.basex.data.Data.kind(Data.java:306) > at org.basex.query.value.node.DBNode.<init>(DBNode.java:51) > at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:68) > at org.basex.query.value.seq.DBNodeSeq.itemAt(DBNodeSeq.java:22) > at org.basex.query.value.seq.Seq$1.next(Seq.java:77) > at org.basex.query.expr.path.IterPath$1.next(IterPath.java:58) > at org.basex.query.expr.path.IterPath$1.next(IterPath.java:36) > at org.basex.query.MainModule$1.next(MainModule.java:114) > at org.basex.query.func.StandardFunc.cache(StandardFunc.java:384) > at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:129) > at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:59) > at org.basex.query.func.xquery.XQueryEval.value(XQueryEval.java:49) > at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:77) > at org.basex.query.QueryContext.value(QueryContext.java:421) > at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:187) > at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:95) > at org.basex.query.MainModule$1.next(MainModule.java:114) > at org.basex.core.cmd.AQuery.query(AQuery.java:91) > at org.basex.core.cmd.XQuery.run(XQuery.java:22) > at org.basex.core.Command.run(Command.java:398) > at org.basex.http.rest.RESTCmd.run(RESTCmd.java:99) > at org.basex.http.rest.RESTQuery.query(RESTQuery.java:74) > at org.basex.http.rest.RESTRun.run0(RESTRun.java:41) > at org.basex.http.rest.RESTCmd.run(RESTCmd.java:65) > at org.basex.core.Command.run(Command.java:398) > at org.basex.core.Command.execute(Command.java:100) > at org.basex.core.Command.execute(Command.java:123) > at org.basex.http.rest.RESTServlet.run(RESTServlet.java:22) > at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) > at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) > at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1086) > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:429) > at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1020) > at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:370) > at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:494) > at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:971) > at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1033) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:644) > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235) > at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82) > at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:696) > at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:53) > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:745) > > > -- > - Mansi

2 6

Strange restxq path error "assigned to several functions"
by Maximilian Gärber 02 May '16

02 May '16

Hi, suddenly, I get a path error [1] for functions that worked just minutes ago. When renaming the functions again it sometimes resolves the issue. I have CACHERESTXQ = false But this "feels" just like a caching issue. Appeared while on 8.4.1, but same on 8.4.3 Any ideas? [1] Problem accessing /test/import-convert/19.2.xlsx. Reason: Stopped at /webapp/test/api/import.xqm, 55/10: [bxerr:BASX0003] Path "/test/import-convert/{$file}" assigned to several functions: /webapp/test/api/import.xqm, 55/10 /webapp/test/api/import.xqm, 55/10

2 6

xquery:eval - static context?
by Hans-Juergen Rennau 30 Apr '16

30 Apr '16

Dear BaseX team, a question concerning the static context used by xquery:eval. It seems to me that the static context is not inherited from the location of the evaluating call. Therefore arises the question how to call user-defined functions within code evaluated by xquery:eval. Please consider this example: Attempt #1:=========================================================== declare namespace f="http://www.foxpath.org/xquery-functions"; declare function f:num2($number) {2 * $number}; let $inlineFunctionText := "function($number) {f:num2($number)}" let $f := xquery:eval($inlineFunctionText) return $f(1) =========================================================== Executing this, an error is raised: [XPST0081] No namespace declared for 'f:num2'. Adding a namespace declaration does not help: Attempt #2:=========================================================== declare namespace f="http://www.foxpath.org/xquery-functions"; declare function f:num2($number) {2 * $number}; let $inlineFunctionText := "declare namespace f='http://www.foxpath.org/xquery-functions'; function($number) {f:num2($number)}" let $f := xquery:eval($inlineFunctionText) return $f(1) =========================================================== Now I get this error: [XPST0017] Unknown function: Q{http://www.foxpath.org/xquery-functions}num2. The only (?) way out is pass in the function a parameter: Attempt #3:=========================================================== declare namespace f="http://www.foxpath.org/xquery-functions"; declare function f:num2($number) {2 * $number}; let $inlineFunctionText := "declare namespace f='http://www.foxpath.org/xquery-functions'; declare variable $num2 external; function($number) {$num2($number)}" let $context := map{'num2': f:num2#1} let $f := xquery:eval($inlineFunctionText, $context) return $f(1) ===========================================================Result: 2Ok! Fortunately, the passed in function does inherit its own static context (as it should, per spec), so that it may call other functions themselves not known to the inline function expression: Attempt #4:=========================================================== declare namespace f="http://www.foxpath.org/xquery-functions"; declare function f:num2($number) {2 * $number + f:num3($number)}; declare function f:num3($number) {3 * $number}; let $inlineFunctionText := "declare namespace f='http://www.foxpath.org/xquery-functions'; declare variable $num2 external; function($number) {$num2($number)}" let $context := map{'num2': f:num2#1} let $f := xquery:eval($inlineFunctionText, $context) return $f(1) ===========================================================Result: 5Okissimo! So my question is whether it is by design or by bug that xquery:eval "forgets" the static context in place where the invocation of xquery:eval occurs. And I emphasize the great practical relevance of the question as it impacts the possibility of using within the evaluated expression user-defined functions. Cheers,Hans-Jürgen

1 0

basexhttp on OpenShift
by Mike Cobo 29 Apr '16

29 Apr '16

Hi all I'm trying to migrate my docker based BaseX app to OpenShift Enterprise and after building and deploying successfully the container it can not start due to the following strange permission problem: 1 /srv/.basex could not be written.2 java.nio.file.AccessDeniedException: /srv/.basex3 at sun.nio.fs.UnixException.translateToIOException(UnixException.java:84)4 at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)5 at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)6 at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)7 at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:430)8 at java.nio.file.Files.newOutputStream(Files.java:172)9 at java.nio.file.Files.write(Files.java:3092)10 at org.basex.io.IOFile.write(IOFile.java:221)11 at org.basex.util.options.Options.write(Options.java:143)12 at org.basex.util.options.Options.read(Options.java:696)13 at org.basex.util.options.Options.<init>(Options.java:95)14 at org.basex.core.StaticOptions.<init>(StaticOptions.java:115)15 at org.basex.core.Context.<init>(Context.java:78)16 at org.basex.core.Context.<init>(Context.java:70)17 at org.basex.http.HTTPContext.init(HTTPContext.java:424)18 at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:69)19 at org.basex.BaseXHTTP.main(BaseXHTTP.java:52)20 /srv/.basex: writing new configuration file.21 DEBUG: true22 Creating Database...23 . 4.61 ms (18501 KB)24 Creating /srv/BaseXWeb/WEB-INF/web.xml25 java.nio.file.NoSuchFileException: /srv/BaseXWeb/WEB-INF/web.xml26 at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)27 at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)28 at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)29 at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)30 at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:430)31 at java.nio.file.Files.newOutputStream(Files.java:172)32 at java.nio.file.Files.write(Files.java:3092)33 at org.basex.io.IOFile.write(IOFile.java:221)34 at org.basex.BaseXHTTP.locate(BaseXHTTP.java:264)35 at org.basex.BaseXHTTP.initJetty(BaseXHTTP.java:219)36 at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:75)37 at org.basex.BaseXHTTP.main(BaseXHTTP.java:52)38 /srv/BaseXWeb/WEB-INF/web.xml In my Docker file I simply copy some files (the same errors occurs when the last line in the Docker file is omitted, so there's no difference if the .basex file is added or not): FROM basex/basexhttp:latestMAINTAINER MyName <my.name(a)domain.com>VOLUME ["/srv/BaseXData", "/srv/BaseXWeb"]COPY lib/*.jar /usr/src/basex/basex-core/lib/COPY data/users.xml /srv/BaseXData/COPY web/test.xq /srv/BaseXWeb/COPY .basex /srv/.basex I'm not sure if the problem is OpenShift related or if it is based on the way the basex server is started... Any ideas? Thx.Mike

1 0

Non-updating Expressions: copy/modify/return. Multiple for-clauses inside modify
by Günter Dunz-Wolff 29 Apr '16

29 Apr '16

Hi all, hi Christian, for my queries I have to modify some legacy xml-documents. The copy/modify/return-expression works fine with one for-clause. But I have to modify different elements. I can't figure out, how to chain the for-clauses. Working Example: copy $doc := $document modify ( let $first_elements := $doc//element-name for $element in $first_elements let $target := $element/@target let $htm_anchor := substring-after($target, '#') return replace value of node $element/@target with 'xyz' || $htm_anchor ) return $doc This is working for one for-clause. But I have to do a lot more with different elements for example: let $second_element := $doc//element-name-second for $ele in $second_elements let $... return ... The returning document should contain all modifications. How can I chain the for-clauses inside modify? Thanks for a hint in advance. Günter

2 2

Re: [basex-talk] Loading XML file as an InputStream in BaseX
by Christian Grün 29 Apr '16

29 Apr '16

Hi Isuru, I have attached a little example to this mail (in which the result will be streamed as well). Hope this helps Christian On Fri, Apr 29, 2016 at 6:23 AM, Isuru Ranawaka <isurur(a)wso2.com> wrote: > Hi Christian, > > We are in the process of evaluating BaseX as a XPath engine that can be > used inside our products. But samples that we have seen are only for > evaluating XQuery against a XML Document. Do you have any sample or way > that we can evaluate XPath against a InputStream. Because we cannot convert > incoming stream in to a document and read it again it will have huge > overhead. It will be great if you can provide sample code or reference that > can be refer to. > > thanks > > On Thu, Apr 28, 2016 at 11:11 PM, Christian Grün < > christian.gruen(a)gmail.com> wrote: > >> Hi Pubudu, >> >> Streaming may be a non-trivial task. Before thinking about pipelining >> input data, I would first be interested if data transmission will really be >> a potential bottleneck. Have you already done som profiling? >> >> Cheers, >> Christian >> >> >> >> On Thu, Apr 28, 2016 at 10:45 AM, Pubudu Fernando <pubuduf(a)wso2.com> >> wrote: >> >>> Hi, >>> >>> I was going through the sample file given at [1]. Here, the XML file is >>> taken from a file. Is there any way of giving the XML as a stream instead? >>> The requirement is to use XPath expressions on an XML payload that comes >>> with an HTTP request (the payload will be available to consume, as an >>> InputStream) to check whether the payload contains some given text/data. >>> >>> I also had a look at [2]. Is this approach valid only for common types >>> like integer, string etc? >>> >>> [1] - >>> https://github.com/BaseXdb/basex/blob/master/basex-examples/src/main/java/o… >>> [2] - >>> https://github.com/BaseXdb/basex/blob/master/basex-examples/src/main/java/o… >>> >>> Thanks >>> -- >>> *Pubudu Fernando* >>> Software Engineer - Intern >>> WSO2 Inc. >>> m: +94 77 888 2543 >>> >>> <https://lk.linkedin.com/in/pubuduf> <http://blog.pubudu.xyz/> >>> <https://github.com/pubudu91> >>> <http://stackoverflow.com/users/4329912/pubudu> >>> >>> >> > > > -- > Best Regards > Isuru Ranawaka > M: +94714629880 > Blog : http://isurur.blogspot.com/ >

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk