- BaseX-Talk - mailman.uni-konstanz.de

Reg : ArrayIndexOutOfBoundsException
by chandra Sekhar 09 Aug '19

09 Aug '19

Dear basex team, We are getting the below error while accessing the collection. Exception ::org.basex.core.BaseXException: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.9 Java: Oracle Corporation, 1.7.0_151 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException Collection size : 37 GB And did INSPECT command on the collection,It is showing success. Regards, Chandrasekhar

2 1

Serialization mismatch using Saxon for xslt:transform
by Majewski, Steven Dennis (sdm7g) 08 Aug '19

08 Aug '19

Continuing with my test.xqm experiments… I have copied Saxon jar into WEB-INF/lib/ so xslt:transform is using Saxon. I have the following functions declared: declare %rest:path("test/xqdoc.xml") %output:method('xml') function test:doc() { inspect:xqdoc( $test:module_name ) }; declare %rest:path('test/xdoc') %output:method('html’) (: I’ve tried various values for method and html-version here ! :) %output:html-version('5.0') function test:htmldoc() { (: WTF? :) xslt:transform( test:doc(),'static/xsl/html-module.xsl', map { 'source' : 'test.xqm' }) }; Where html-module.xsl initially was: https://github.com/xquery/xquerydoc/blob/master/src/lib/html-module.xsl <https://github.com/xquery/xquerydoc/blob/master/src/lib/html-module.xsl> Accessing /basex/test/xdoc returns error message: Stopped at /usr/local/tomcat/webapps/basex/test.xqm, 41/20: [FODC0002] "" (Line 69): The entity "nbsp" was referenced, but not declared. Which was initially very puzzling, as I could not find nbsp in either my test.xqm, html-module.xsl, or inspect:xsdoc() output. Turns out, even though it was encoded as " ” in html-module.xsl, Saxon was encoding it as “ ” on output of the transform. Initially, I wasn’t sure if Saxon or BaseX was doing the serialization. I guess it seems to be both. Original output method for that stylesheet is: <xsl:output method="html" indent="yes" encoding="UTF-8"/> And changing output:method on the function to xhtml or html doesn’t have any effect on results. Changing output method on the stylesheet to xhtml causes Saxon to serialized it as “ ” instead of “ ” , and the serialization method on the basex RESTXQ function doesn’t seem to give an errors with any output methods. I take from these results that the output from Saxon xslt:transform is serialized according to the stylesheet, and then parsed again by BaseX as xml on the way to being serialized again on output from the function, and the error is coming from that implicit parse. I don’t suppose there is a way to short circuit the parsing of the xslt:transform function output and just output the results directly (?) I tried xslt:transform-text() but it escapes all of the element tags. Or a way to get it to parse the results of that transform function as html ? Clearly changing the stylesheet is the easy solution for this test file, but for some of my other real cases, I may be trying to repurpose stylesheets that will be used in different contexts: within BaseX and outside of that context, so keeping different versions of the stylesheets is going to be annoying. I suppose I could read in the stylesheets and modify the xml:output line in XQuery or XSLT before using it within BaseX. — Steve M.

3 2

Error from function-name(request:query#0): only from RESTXQ, not REST context.
by Majewski, Steven Dennis (sdm7g) 08 Aug '19

08 Aug '19

I’ve been learning how to use the BaseX webapp, and below is one of the first test scripts for the REST interface I wrote. No problems with this script. import module namespace request = "http://exquery.org/ns/request"; declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:omit-xml-declaration "no"; declare option output:method "xhtml"; (: http://docs.basex.org/wiki/XQuery_3.0#Serialization :) (: declare variable $contains := try { request:parameter( 'contains' ) } catch basex:http { '' }; Simpler to use implicit assignment: http://docs.basex.org/wiki/REST#Assigning_Variables "All query parameters that have not been processed before will be treated as variable assignments" :) declare variable $contains as xs:string external := ""; declare function local:f0line( $f ) as node() { (: build a list item with function name and function values :)I <li><b>{fn:function-name($f)}:</b> {$f()}</li> }; declare variable $CTX := try { . } catch err:XPDY0002 { () }; declare variable $DB := try { db:name( $CTX[1] ) } catch err:XPTY0004 { "" }; (: Could be, if (): [XPTY0004] node() expected, empty sequence found. but not sure if that's the only possible case. :) <html><head><title>test</title></head><body> <div id="context"> <h3>Database: { $DB }</h3> <h3>Context documents (.)</h3> <ol> { for $doc in $CTX return <li><b>{base-uri($doc)}</b></li> } </ol> </div> <div id="request"> <h3>HTTP Request</h3> <ul> { for $f in ( request:method#0, request:scheme#0, request:hostname#0, request:port#0, request:path#0, request:query#0, request:uri#0, request:context-path#0, request:address#0, request:remote-hostname#0, request:remote-address#0, request:remote-port#0 ) return local:f0line($f) } </ul> </div> <div id="params"> <h3>Request Parameters:</h3> <ul> { for $param in request:parameter-names() return <li><b>{$param}:</b> {request:parameter($param)}</li> } </ul> </div> <div id="headers"> <h3>Headers</h3> <ul> { for $header in request:header-names() return <li><b>{$header}:</b> {request:header($header)}</li> } </ul> </div> <div id="cookies" > <h3>Cookies</h3> <ul> { for $cookie in request:cookie-names() return <li><b>{$cookie}:</b> {request:cookie($cookie)}</li> } </ul> </div> <div id="xslt"> <h4>XSLT</h4> <ul> <li><b>xslt:processor: { xslt:processor()},   xslt:version: { xslt:version()}</b></li> </ul> </div> </body></html> I’m now trying to learn RESTXQ programming, so I was trying to do the same sort of thing from a RESTXQ module. I was getting an error from the line where (: request:query#0, :) is now commented out, and added the line: <li>{ request:query( ), function-name(request:query#0)}</li> And I see that what happens is that it’s the latter function-name(request:query#0) that is generating an error, but only when there is no query string in my request. An empty query string, i.e. “http://localhost/basex/test? <http://localhost/basex/test?>” , for example, works. But “http://localhost/basex/test <http://localhost/basex/test> returns: Stopped at /usr/local/tomcat/webapps/basex/test.xqm, 33/66: [XPTY0004] Cannot convert empty-sequence() to xs:string: (). I assume this has something to do with how RESTXQ processes form and request parameters, and I probably don’t actually need to do it this way, but I was wondering what exactly is the source of the problem with doing something like this or if there is an obvious work around. Maybe writing another local function to wrap around request:query and to use in that loop. ( One reason I chose that test to convert to RESTXQ was that it wasn’t obvious to be from the docs if I could mix those different access methods, and so what was surprising was that it mostly worked — only that one function failed (so far)). module namespace test = 'http://localhost/test'; import module namespace request = "http://exquery.org/ns/request"; declare function test:f0line( $f ) as node() { (: build a list item with function name and function values :) <li><b>{fn:function-name($f)}:</b> {$f()}</li> }; (:~ : Generates a welcome page. : @return HTML page :) declare %rest:path("test") %output:method("xhtml") %output:omit-xml-declaration("no") %output:doctype-public("-//W3C//DTD XHTML 1.0 Transitional//EN") %output:doctype-system("http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd") function test:test( ) as element(Q{http://www.w3.org/1999/xhtml}html) { <html xmlns="http://www.w3.org/1999/xhtml"> <head> <title>BaseX HTTP Services</title> <link rel="stylesheet" type="text/css" href="static/style.css"/> </head> <body> <div class="right"><a href='/'><img src="static/basex.svg"/></a></div> <h1>TEST</h1> <div id="debug" > <ul> <li>{ request:query( ), function-name(request:query#0)}</li> </ul> </div> <div id="request"> <h3>HTTP Request</h3> <ul> { for $f in ( request:method#0, request:scheme#0, request:hostname#0, request:port#0, request:path#0, (: request:query#0, :) request:uri#0, request:context-path#0, request:address#0, request:remote-hostname#0, request:remote-address#0, request:remote-port#0 ) return test:f0line($f) } </ul> </div> </body> </html> };

2 1

comment()
by Marc 08 Aug '19

08 Aug '19

Hi, I want to write a comment in the xml I produce with my XQuery. I try to use the comment() function, but each time I want to put something inside the () i have a syntax error. for example : <test> {comment("test"), let $r := random:integer(100) + 1 for $j in (/*)[$r] return ( $r,$j) } </test> or (who is more what I want to do) <test> { let $r := random:integer(100) + 1 for $j in (/*)[$r] return (comment("$r"),$j) } </test> I don't find any example on how to use the comment function. Anyone have example about that use? Thanks Marc

3 4

Coding help
by Greg Kawchuk 08 Aug '19

08 Aug '19

Hi everyone, I'm wondering if someone could provide what I think is a brief script for a scientific project to do the following. The goal is to identify XML documents from a very large collection that would be too big to load into a database all at once. Here is how I see the functions provided by the code. 1. In the script, the user could enter the path of the target folder (with millions of XML documents). 2. In the script, the user would enter the number of documents to load into a database at a given time (i =. 1,000) depending on memory limitations. 3. The code would then create a temporary database from the first (i) xml files in the target folder. 4. The code would then search the 1000 xml documents in the database for a pre-defined text string. 5. If hits exist for the text string, the code would write those documents to a unique XML file. 6. Clear the database. 7. Read in the next 1000 files (or remaining files in the folder). 8. Return to #4. There would be no need to append XML files in step 5. The resulting XML files could be concatenated afterwards. Thank you in advance. If you have any questions, please feel free to email me here. Greg *************************************************** Greg Kawchuk BSC, DC, MSc, PhD. Professor, Faculty of Rehabilitation Medicine University of Alberta greg.kawchuk(a)ualberta.ca 780-492-6891

5 4

BaseX in AWS Lambda - has anyone tried it?
by James Ball 07 Aug '19

07 Aug '19

Good afternoon, I’m currently working on a project where I get lots - maybe thousands - of XML files and I have to run a series of tests on them. I get a whole batch then maybe none for a week. I have all my code in XQuery in BaseX but with some locking and update issues it can take a long time to process. So I thought I might give AWS Lambda a try as all the tests can run independently. Before I jump in I wondered if anyone else has tried it? Any thoughts, suggestions, issues? I did a search of the list but didn’t see anything. Many thanks, James

1 0

Stopping BaseX HTTP server
by Markus Wittenberg 02 Aug '19

02 Aug '19

Hi all, we have a problem trying to stop a BaseX HTTP server with the Windows task scheduler. The server ist started with a maven profile, calling mvn exec:java -Pstart pom.xml extract see below, and can also be stopped directly with the corresponding stop profile by a batch file: cd /D "%~dp0" mvn exec:java -Pstop But calling this batch profile in task scheduler works fine on our local computers, but does not work on the server (Windows Server 2012). On this machine, executing the stop profile by the task scheduler results in a message HTTP server was started (port: 8985). in the console window of the process to be stopped, but it continues running anyway. Any ideas regarding this strange behavior? Can we stop the server with a simple HTTP request? Calling localhost:8985 in the browser also results only in the message above. Thanks in advance for any hints. Best regards, Markus Extract from pom.xml: <profile> <id>start</id> <build> <plugins> <plugin> <groupId>org.codehaus.mojo</groupId> <artifactId>exec-maven-plugin</artifactId> <version>1.4.0</version> <configuration> <mainClass>org.basex.BaseXHTTP</mainClass> <arguments> <argument>-h9894</argument> <argument>-s8985</argument> <argument>-p1985</argument> <argument>-Urestxq</argument> </arguments> <additionalClasspathElements> <additionalClasspathElement>src/main/resources</additionalClasspathElement> </additionalClasspathElements> </configuration> </plugin> </plugins> </build> </profile> <profile> <id>stop</id> <build> <plugins> <plugin> <groupId>org.codehaus.mojo</groupId> <artifactId>exec-maven-plugin</artifactId> <version>1.4.0</version> <configuration> <mainClass>org.basex.BaseXHTTP</mainClass> <arguments> <argument>-s8985</argument> <argument>stop</argument> </arguments> </configuration> </plugin> </plugins> </build> </profile> <profile> -- Markus Wittenberg Tel +49 (0)341 248 475 36 Mail wittenberg(a)axxepta.de ---- axxepta solutions GmbH Lehmgrubenweg 17, 88131 Lindau Amtsgericht Berlin HRB 97544B Geschäftsführer: Karsten Becke, Maximilian Gärber

3 12

Forcing download of JSON doc
by Tim Thompson 01 Aug '19

01 Aug '19

Hello, I am posting a JSON doc to a RESTXQ function from XForms and trying to set a Content-Disposition header to trigger a file download. Is this possible to do without first saving the JSON doc as a file? Right now, the RESTXQ function returns the correct headers, but does not force a file download dialog. Thanks in advance! Tim -- Query: xquery version "3.1"; module namespace wrap = "http://example.org/wrap"; declare %rest:path("/wrap") %rest:POST("{$data}") %output:method("json") function wrap:process( $data as node() ) as item()* { let $name := data($data/data/upload/file/@name) let $json := json-to-xml($data/data/upload/file) let $header := ``[attachment; filename="`{$name}`";]`` return ( <rest:response> <http:response status="200" message="OK"> <http:header name="Content-Type" value="application/json"/> <http:header name="Content-Disposition" value="{$header}"/> </http:response> </rest:response>, <map xmlns="http://www.w3.org/2005/xpath-functions"> <map key="Profile"> <array key="resourceTemplates">{$json}</array> <string key="title">Wrapper_Profile</string> <string key="id">Wrapper:Profile:BF2</string> <string key="description">Profile wrapper for resource templates</string> <string key="author">Wrapper</string> <string key="schema"> https://ld4p.github.io/sinopia/schemas/0.0.9/profile.json</string> <string key="date">{current-dateTime()}</string> </map> </map> => xml-to-json() => parse-json() => serialize(map {'method': 'json', 'use-character-maps' : map {'/' : '/'}}) ) }; -- Tim A. Thompson Discovery Metadata Librarian Yale University Library

2 4

ß = ss: not equal in all cases
by Alexander Witzigmann 31 Jul '19

31 Jul '19

Hi All, the following query declare default collation 'http://basex.org/collation?lang=de;strength=secondary'; "anschließend" contains text "anschliessend" returns *false* but the following query declare default collation 'http://basex.org/collation?lang=de;strength=secondary'; "anschließend" = "anschliessend" returns *true*. and the following query declare default collation 'http://basex.org/collation?lang=de;strength=secondary'; "anschließend" eq "anschliessend" returns *true*. I wonder why 'contains text' does not return true as well? All full-text related functions doesn't support ß = ss for german collation. Alex

2 1

Full-Text Search long s
by Günter Dunz-Wolff 26 Jul '19

26 Jul '19

Hi all, I’m working since some years on a digital edition of the works of a former german author. In my transcription of those works are lots of gothic characters like the old german long s (Unicode: LATIN SMALL LETTER LONG S). For example: Büchſe (exactly Buͤchſe). In my Full-Text-Search my goal is, that the user asks for „Büchse“ and gets „Büchse“ AND „Büchſe“ (with long s). In best case, she should get „Büchse“ AND „Büchſe“ AND „Buͤchſe“. How can I achieve, that //text[. contains text { } treats s and ſ and ü and uͤ as the same character? Thanks a lot for any help. Best regards, Guenter

3 2

Managing external entities
by Majewski, Steven Dennis (sdm7g) 26 Jul '19

26 Jul '19

I have a corpus of TEI files with figures and page images encoded as external entities. It appears that even when choosing “Parse DTDs and entities” this info is lost when parsing files into database, And in any case, unparsed-entity-uri() is an XSLT only function. It would appear that I first need to transform the files first and replace @entity attributes with @url attributes while these unparsed entity values are available, before creating the database, or else generate another database to map entity names to values later. Are there any better ways to handle this case ? Is there any way to do these transforms on the fly before parsing the files into the database ? The only thing that comes to mind is to set up a local SaxonServlet to do the transforms, and load from URLs instead of file paths. ( I’ve been doing something similar for a different case, and running into memory errors that I don’t see when loading from a directory when creating a database. Increasing memory didn’t help much, but inserting ‘flush’ command between even ‘add’ commands seemed to work. ) — Steve Majewski

2 2

BaseX 9.2.1: Maintenance Release
by Christian Grün 26 Jul '19

26 Jul '19

Dear all, A new BaseX maintenance release is available: - GUI: Parsing of project files has become faster and smarter. - RESTXQ: Custom reponses are now sent as streams. - Performance tweaks (static typing: typeswitch, instance of). - Minor bugs have been fixed. Looking forward to your feedback, Christian BaseX Team

1 3

File-io:error. File lock by another process (windows-only)
by France Baril 24 Jul '19

24 Jul '19

Hi, We have this issue only on Windows system since 9.2 that we know of... could be from 902. It is still happening after upgrade to 923. I am not able to provide a sample to reproduce systematically as it never happens at the same .xqm location. It does however always seem that the 1st error message occurs on a line with a file:write or file;append. I am giving you everything I know, in case that it rings a bell. 1. Start server with basexhttp 2. Run a process that has many functions and many file:write and file:append. 3. This generally works properly. The process ends with success. 4. Run the same process again, there is a good chance that we'll get an error that says something like: [file:io-error] Resource "debug-list-imtes.xml' locked by another process. 5. Run the same process again May get file-oi:error at the same location or a different one. 6. Restarting the server brings us back to 1... but sometimes we need to manually delete the files written with function from the file module before we can go back to 1 and get 1 good run of the process. Note: Although the process runs correctly and seems to finish running (to the same point that releases all locks on Linux). The person on the Windows system also often gets: [db:open] Resource "C:\basex\data\staging-en-us\txt.basex locked by another process and then the related database also remains locked and we may get messages: Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.2.3 Java: Oracle Corporation, 1.8.0_211 OS: Windows 10, amd64 Stack Trace: java.nio.channels.OverlappingFileLockException at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source) at sun.nio.ch.SharedFileLockTable.add(Unknown Source) at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source) at org.basex.io.random.TableDiskAccess.lock(TableDiskAccess.java:147) at org.basex.io.random.TableDiskAccess.(TableDiskAccess.java:79) at org.basex.data.DiskData.init(DiskData.java:125) at org.basex.data.DiskData.(DiskData.java:84) at org.basex.core.cmd.Open.open(Open.java:99) at org.basex.query.QueryResources.database(QueryResources.java:179) at org.basex.query.func.StandardFunc.checkData(StandardFunc.java:429) at org.basex.query.func.db.DbOpen.value(DbOpen.java:17) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:45) at org.basex.query.expr.path.IterPath$1.init(IterPath.java:79) at org.basex.query.expr.path.IterPath$1.next(IterPath.java:46) at org.basex.query.expr.path.IterPath$1.next(IterPath.java:1) at org.basex.query.iter.Iter.value(Iter.java:65) at org.basex.query.expr.path.IterPath.nodes(IterPath.java:87) at org.basex.query.expr.path.AxisPath.value(AxisPath.java:39) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:173) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:80) at org.basex.query.func.StaticFunc.invValue(StaticFunc.java:172) at org.basex.query.func.FuncCall.invoke(FuncCall.java:117) at org.basex.query.func.FuncCall.value(FuncCall.java:56) at org.basex.query.scope.MainModule.value(MainModule.java:135) at org.basex.query.QueryContext.update(QueryContext.java:673) at org.basex.query.QueryContext.iter(QueryContext.java:332) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:56) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:54) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:505) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804) at java.lang.Thread.run(Unknown Source)undefined -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 10

Re: [basex-talk] Transaction Management
by Christian Grün 24 Jul '19

24 Jul '19

Hi Radim (cc to the list), > it takes so long even when it was being stored from a file on local hard drive. The xml file has about 15 to 20 MB. Wow. How large is your database? How did you add the documents? > Could you give me the XQuery or the BaseX command to move the file from the TempDB to the TargetDB the quickest possible way? Sure. There are various ways to do so, here’s just one (based on the database module [1]): 1. upload your document to database 'db-temp' 2. insert documents into final database: db:replace('db', db:list('db-temp'), db:open('db-temp')) 3. remove all your documents from the temporary database: db:delete('db-temp', '/') You can also drop the temporary database completely via db:drop. Hope this helps, Christian [1] http://docs.basex.org/wiki/Database_Module And how about database cache settings? Is something like that in BaseX? > > Thank you in advance for your response. > Best regards, > > Radim Havlicek > > > ---------- Původní e-mail ---------- > Od: Christian Grün <christian.gruen(a)gmail.com> > Komu: Radim Havlicek <radim-havlicek(a)post.cz> > Datum: 23. 7. 2019 15:12:04 > Předmět: Re: [basex-talk] Transaction Management > > Hi Radim, > > Do you have a clue how the long update time can be explained? Does it > take 20 minutes to upload your document to the BaseX server, or does > it take the same time if you update your database directly on the > server? If it’s the upload time, you could e.g. insert your document > in another temporary database and copy it to the final database in a > second step. > > Hope this helps, > Christian > > > > On Tue, Jul 23, 2019 at 10:34 AM <radim-havlicek(a)post.cz> wrote: > > > > Hello. > > > > We use client/server architecture, especially the C# client. I read that: > > > > Read transactions are executed in parallel. > > If an updating transaction comes in, it will be queued and executed after all previous read transaction have been executed. > > > > We have a web Front-End built on BaseX. We read XML documents stored in the database, and show charts with statistics calculated from those documents. Few times per day, we copy a new document to the database (via REPLACE command to make sure, the document is not stored in the database already). > > > > The problem we are facing is that while big document is being stored to the database (10 to 20 minutes), we cannot read documents from the database and display charts for users on the web interface. The web interface is waiting until the document is stored, and then read the the needed documents, and display the charts. It is very inconvenient for users to wait so long for a chart that is normally displayed in few seconds. > > > > Is there a way we could read the xml documents from the database while another document is being stored to the database? It is very, very needed. > > > > Best regards, > > > > Radim Havlicek

1 0

Transaction Management
by radim-havlicek＠post.cz 23 Jul '19

23 Jul '19

Hello. We use client/server architecture, especially the C# client. I read that: * Read transactions are executed in parallel. * If an updating transaction comes in, it will be queued and executed after all previous read transaction have been executed. We have a web Front-End built on BaseX. We read XML documents stored in the database, and show charts with statistics calculated from those documents. Few times per day, we copy a new document to the database (via REPLACE command to make sure, the document is not stored in the database already). The problem we are facing is that while big document is being stored to the database (10 to 20 minutes), we cannot read documents from the database and display charts for users on the web interface. The web interface is waiting until the document is stored, and then read the the needed documents, and display the charts. It is very inconvenient for users to wait so long for a chart that is normally displayed in few seconds. Is there a way we could read the xml documents from the database while another document is being stored to the database? It is very, very needed. Best regards, Radim Havlicek

2 1

Quickest way to parse a DomSource
by Marco Lettere 22 Jul '19

22 Jul '19

Hi all, I'm currently working on the usage of BaseX Xquery scripts inside a BPMN engine. I have to access portions of the XML representation of the BPMN file by binding the engine's API. The closest that I can get to a standard XML representation is currently a javax.xml.transform.dom.DOMSource. What is the shortest way to transform (in XQuery) this DomSource to a BaseX representation of the Document in order to query it? Thanks, Marco.

2 2

PATCH verb in RestXQ implementation
by Schopper, Daniel 19 Jul '19

19 Jul '19

Dear list, I just came across the fact that BaseX does not recognize PATCH as a known HTTP verb (at least in my admittedly not bleading-edge version). Is this a feature or a bug? And, in order to work around that: is there a way of passing payload to a custom %rest:method (without having an additional PUT or POST annotation on the same XQuery function)? Thanks in advance! Best Daniel

3 4

Update operation is spawning new databases with underscore
by Zimmel, Daniel 18 Jul '19

18 Jul '19

Hi, sometimes in my update operations BaseX deliberately is spawning several databases like the following, with a name of the database plus underscore and number: DBNAME_2618234251 caused by db:replace($dbname, $dbpath|| '/' || $fname, $file-to-import, map { 'intparse': true(), 'chop': false(), 'addcache': false() }) I cannot find anything about this behavior in the docs. It seems to happen randomly, and the main database does seem ok. How can I avoid these extra databases? They will vanish only by force. BaseX 9.2.1 Thanks, Daniel

2 4

Bug in 9.2.3??
by Buddy Kresge 17 Jul '19

17 Jul '19

The below code works fine in 9.2.2 (and any version before), but when we execute the below in 9.2.3 we get the following error. Thanks in advance for your assistance. Cannot convert element() to xs:string?: $status := <EmploymentStatusCode>Active</Employment.... declare function local:employmentStatus($employee as element()?) as xs:string? { $employee/*:Employment/*:EmploymentStatus/*:EmploymentStatusCode }; declare function local:isActive($employee as element()?) as xs:boolean { let $status := local:employmentStatus($employee) return if (string-length($status) > 0) then contains($status, 'Active') else false() }; let $ee := <Subscriber><Employment><EmploymentStatus><EmploymentStatusCode>Active</EmploymentStatusCode></EmploymentStatus></Employment></Subscriber> return local:isActive($ee)

2 1

Query filter by attributes with Colons
by Jordan Castillo 15 Jul '19

15 Jul '19

Hello BaseX Staff, I am noticing that my queries aren't working when I check the value of an attribute who has a colon in the name field. Here is an example: 1: Yields no results let $begin := db:open($documentName) return $begin//packagedElement[@name="auxiliaryResource" and @xmi:id="_12_1_8f90291_1173963323875_662612_98"] 2: Yields no results return $begin//packagedElement[@xmi:id="_12_1_8f90291_1173963323875_662612_98"] 3: Yields expected result: return $begin//packagedElement[@name="auxiliaryResource"] Example of element I am searching for here: <packagedElement xsi:type="uml:Stereotype" xmi:id="_12_1_8f90291_1173963323875_662612_98" ID="_12_1_8f90291_1173963323875_662612_98" name="auxiliaryResource"> This particular element has an "ID" attribute but most do not so checking that attribute is not an option. Any hints or tips as to how I can make this work would be greatly appreciated. Thanks! Jordan Castillo

2 1

Enforce index with dynamic values
by Beck, Julia 12 Jul '19

12 Jul '19

Hello BaseX team, I am struggeling with the enforce index pragma and get a "Improper use? Potential bug? Your feedback is welcome". So here is my feedback/question: I have XML data describing books in several databases that also contain (potentially outdated) control numbers for authority data and I have an XML doc with a list of old numbers and their replacement (== new number). So I want to go through this list and replace the old numbers in my data with the new numbers. My XQuery works for each database on its own, but as soon as I provide a list of databases, I get a NullPointerException. The xml doc with the authority numbers looks like this: <gnds> <gnd> <old>gnd_4452199-6</old>; <new>gnd_2163369-1</new>; </gnd> <gnd> <old>gnd_16288049-2</old>; <old>gnd_4683522-2</old>; <new>gnd_1901229-9</new>; </gnd> .... </gnds> The data in the databases looks like this: <rdf:RDF> <edm:ProvidedCHO @rdf:about="..."> <edm:wasPresentAt @rdf:resource="gnd_4452199-6"/> <dc:contributor @rdf:resource="gnd_4683522-2"/> ... </edm:ProvidedCHO> ... </rdf:RDF> In the XQuery, I left out the replacement part (which I thought to be the problem first, but the script already throws the error when I just want to have the new numbers printed). It works when I run it for "tmd" and "tes" individually. When I leave out the pragma it takes really long time (obviously not using the index). I more or less followed the 3rd example in http://docs.basex.org/wiki/Indexes#Enforce_Rewritings let $old_gnds := doc("oldIds.xml")/gnds/gnd, $all_db := ("tmd","tes") for $gnd in $old_gnds/old/text() let $new := $gnd/../../new/text() for $db in $all_db for $attr in db:open($db)/rdf:RDF/*/*/@rdf:resource where (# db:enforceindex #) {$attr = $gnd} return $new Best wishes, Julia -- JULIA BECK Elektronische Dienste / FIDDK Universitätsbibliothek Johann Christian Senckenberg Bockenheimer Landstraße 134-138 60325 Frankfurt am Main 069 798 39387

2 3

server load
by Ветошкин Владимир 10 Jul '19

10 Jul '19

2 4

Connecting the BaseX AppChecker to Visual Studio
by Matt Stam 09 Jul '19

09 Jul '19

Hello, I've been trying to set up and use the "AppChecker" that we are going to need to run our X++ code through. Does anyone have any knowledge on how to run this? I've followed everything laid out on their github: https://github.com/microsoft/Dynamics365FO-AppChecker. BaseX and the environmental variables are installed. But I am unsure about how to actually use it to check my code on VS. Any help would be appreciated. Best, Matt

3 2

Time complexity
by Jordan Castillo 08 Jul '19

08 Jul '19

Hello BaseX Staff, Question regarding why the time complexity of my query is dramatically different in these 2 situations. I'm building a map inside a function that is called many times, and this function receives an ID and then has to retrieve some values to store inside the map. In case #1, I check if the values exists first, otherwise I store '()': "lowerValue" : if (exists($context//packagedElement[@xmi:id=$currID]/ownedAttribute[@xmi:id=$propList[2 + $mult]]/lowerValue[@value])) then data($context//packagedElement[@xmi:id=$currID]/ownedAttribute[@xmi:id=$propList[2 + $mult]]/lowerValue/[@value]) else (), "upperValue" : if (exists($context//packagedElement[@xmi:id=$currID]/ownedAttribute[@xmi:id=$propList[2 + $mult]]/upperValue[@value])) then data($context//packagedElement[@xmi:id=$currID]/ownedAttribute[@xmi:id=$propList[2 + $mult]]/upperValue/[@value]) else () Total Time: 1526.0 In case #2:

1 2

problem: accessing inner java class methods with bases java bindings
by Florian Eckey 08 Jul '19

08 Jul '19

Hi, I use basex java bindings in my project. It works fine but when I try to access inner java classes i cant find a way to get it work. I will use the SimpleJavaMail libs and there is a class called “MailerRegularBuilder” which is an inner class of “MailerBuilder”, especially with the method “buildMailer()”. Here is a sample snippet of the based java class source code: public class MailerBuilder { ... private MailerBuilder() { } public static class MailerRegularBuilder extends MailerGenericBuilder<MailerRegularBuilder> { ... public Mailer buildMailer() { return new Mailer(this); } ... } } In java I can easily access this method in the inner class with the following code (in red): MailerRegularBuilder mailRegularBuilder = MailerBuilder.withSMTPServer("smtp.gmail.com", 465, "username1", "password1"); mailRegularBuilder = mailRegularBuilder.withProperty("mail.smtp.starttls.enable", "true"); mailRegularBuilder = mailRegularBuilder.withProperty("mail.smtp.socketFactory.class", "javax.net.ssl.SSLSocketFactory"); Mailer inhouseMailer = mailRegularBuilder.buildMailer(); inhouseMailer.sendMail(email); That works fine (remember it is only a snipped). With XQuery I always get a class not found exception or a unknown method exception with the following code: declare namespace Email = "java:org.simplejavamail.email.Email"; declare namespace EmailBuilder = "java:org.simplejavamail.email.EmailBuilder"; declare namespace Mailer = "java:org.simplejavamail.mailer.Mailer"; declare namespace MailerBuilder = "java:org.simplejavamail.mailer.MailerBuilder"; declare namespace EmailPopulatingBuilder = "java:org.simplejavamail.email.EmailPopulatingBuilder"; declare namespace MailerRegularBuilder = "java:org.simplejavamail.mailer.MailerBuilder.MailerRegularBuilder"; declare namespace MailerGenericBuilder = "java:org.simplejavamail.mailer.MailerGenericBuilder"; declare variable $local:fromName := "Florian Eckey"; declare variable $local:fromEmailAdress := "a.b(a)gmail.com"; declare variable $local:username := "username1" declare variable $local:password := "password1"; declare variable $local:smtpServer := "smtp.gmail.com"; declare variable $local:smtpPort := 465; declare function local:sendMail($toName, $toEmailAdress, $subject, $plainText, $attachementName, $attachement, $attachementType) { let $emailPopulatingBuilder := EmailBuilder:starting-blank() let $emailPopulatingBuilder := EmailPopulatingBuilder:from($emailPopulatingBuilder,$local:fromName, $local:fromEmailAdress) let $emailPopulatingBuilder := EmailPopulatingBuilder:to($emailPopulatingBuilder,$toName, $toEmailAdress) let $emailPopulatingBuilder := EmailPopulatingBuilder:withSubject($emailPopulatingBuilder,$subject) let $emailPopulatingBuilder := if($attachement) then EmailPopulatingBuilder:withAttachment($attachementName, $attachement, $attachementType) else $emailPopulatingBuilder let $emailPopulatingBuilder := EmailPopulatingBuilder:withPlainText($emailPopulatingBuilder,$plainText) let $email := EmailPopulatingBuilder:buildEmail($emailPopulatingBuilder) let $mailerRegularBuilder := MailerBuilder:withSMTPServer($local:smtpServer, xs:int($local:smtpPort), $local:username, $local:password) let $mailerRegularBuilder := MailerGenericBuilder:withProperty($mailerRegularBuilder,"mail.smtp.starttls.enable", "true") let $mailerRegularBuilder := MailerGenericBuilder:withProperty($mailerRegularBuilder,"mail.smtp.socketFactory.class", "javax.net.ssl.SSLSocketFactory") let $mailer := MailerRegularBuilder:buildMailer($mailerRegularBuilder) return (Mailer:sendMail($mailer,$email),"email send") }; The red line will always throw the error: [XPST0017] Unknown class: org.simplejavamail.mailer.MailerBuilder.MailerRegularBuilder. Beside: I copied all the used java libs into the lib folder of my basex instance. All other classes were found. Does anyone have an idea how to access this inner class methods? Or is it not possible and I have to implement a custom java lib which masks the code in one static method? Best regards, Florian PS: Sorry for the unhighlighted code, but it was just copied from the basex gui.

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk