BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Reg : Collection Performence
by chandra Sekhar 04 Dec '19

04 Dec '19

Dear Basex Team, We are using basex7.9,here we are facing performance issue when we are trying to add XML documents to collection database. *scenario *: We are adding nearly one lakh xml documents to the collection,In my application we should run xquery on one lakh xmls,that reason we are adding xmls to same collection,but total xml size also very less. In this situation my our collection server taking more time to add documents to collection database. *one lakh xml size *: 4GB *Please suggest any option to improve performance* Regards, Chandrasekhar

2 1

Join
by Giuseppe G. A. Celano 29 Nov '19

29 Nov '19

Hi, I have the following query: count( for $r in doc("hib_parses.xml")//row let $i := doc("hib_lemmas.xml")//row[field[@name="lemma_lang_id"][. = "3"]] where $r/field[@name="lemma_id"] = $i/field[@name="lemma_id"] return $r ) I have noticed that the where clause needs to be changed into $r/field[@name="lemma_id"]/text() = $i/field[@name="lemma_id"]/text() in order to get a result (otherwise the query seems to never end). I am wondering whether this is a BaseX issue, in that I would assume that the two kinds of where clause are equivalent (because of atomization). I have also noticed that /data() does not work either. Thanks! Best, Giuseppe

2 3

BaseX 9.3: The Winter Edition
by Christian Grün 29 Nov '19

29 Nov '19

Hello to our loyal readers of our list, We are glad to announce version 9.3 of BaseX, our XML framework, database system and XQuery 3.1 processor: http://basex.org/ The focus has been put on in-depth optimizations of complex XQuery code and faster processing of RESTXQ web applications: RESTXQ - seamless streaming of custom responses to the client - Request Module: bind attributes to current request - better support for the OPTIONS and HEAD methods - trace output is now stored in the database logs - enforce premature HTTP response with web:error - optional GZIP compression of HTTP responses - server-side forwarding with web:forward USER INTERFACES - GUI: project view: skip directories with .ignore file - GUI: project view: do now follow symbolic links - DBA: user panel updated to show user info - DBA: faster processing of log entries STORAGE - hot fix for replacing single documents with namespaces - improved XQuery processing of binary resources - ADDCACHE: faster caching of single documents - WITHDB: less locking when using fn:doc XQUERY FUNCTIONS - user:info/user:update-info: process user-specific data - db:open-id, db:open-pre: support for multiple ids - file:descendants: return descendant file paths - inspect:type: return type of a value as string - db:alter-backup: rename database backups - xslt:transform: support for catalog files XQUERY PERFORMANCE - merge of adjacent/redundant steps in paths and predicates - removal of redundant switch, typeswitch and catch clauses - interruption of side-effecting code (Files Modul etc.) - fn:count: pre-evaluation of zero-or-one arguments - faster processing of alternative steps: a/(b,c) - rewriting of paths to simple map expressions - inlining of values in simple map expressions - flattening of nested simple map expressions - rewriting of lists to union expressions - removal of superfluous predicates For a more comprehensive list of added and updated features. please check out our documentation: http://docs.basex.org/. Your feedback is welcome as usual. Have fun with the new release, Your BaseX Team

3 2

I have been given control of xqDoc from Darin McBeath
by Loren Cahlander 22 Nov '19

22 Nov '19

Hello folks, June of 2018, I updated the xqDoc codebase to be able to handle the additions to the language for XQuery 3.1 and most of the vendor specific language extensions. I updated the parser to Antlr 4. Darin McBeath, the creator of xqDoc, asked me if I wanted to take over the domain. I accepted. I will be updating the website http://xqDoc.org and would like to get the community’s input. What changes would people like to see in the website? xqDoc’s GitHub is officially at http://github.com/xqdoc Thank you, Loren Cahlander

2 3

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 20 Nov '19

20 Nov '19

1 0

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 20 Nov '19

20 Nov '19

3 5

executing windows command
by Dieter Zanzinger 20 Nov '19

20 Nov '19

Hello all, I tried to execute a windows command with proc:execute(). See my module: ——— module namespace _ ='process'; declare %rest:path('treez/proc') function _:process() { prof:dump( proc:execute('C:\Program Files\Microsoft Office 15\root\office15\winword.exe','/q') ) }; declare %rest:path('treez/proc_dir') function _:process2() { proc:execute('dir','\’) ———— While function process() works as expected and opens winword, the function process2() (example from the docs) leads to following error: <result> <error> Cannot run program "dir": CreateProcess error=2, Das System kann die angegebene Datei nicht finden </error> </result> Any hints? As process() works and opens winword, I prosume that the error does not come from my installation (Win10, Tomcat 9.0, BaseX 9 - war version). Starting Tomcat as admin does not change anything. Best, Dieter Zanzinger Finanzgericht München

2 1

Exception shown on fn:doc with XML document
by Stefan Pöschel 18 Nov '19

18 Nov '19

Hello, the XPath function "fn:doc" in BaseX can also be used to open a database (instead of an XML document). However when I open an XML document and have debug messages enabled, an exception is shown that seems to be related to an (unsuccessful) attempt to open a database (meanwhile the fn:doc command itself succeeds): ----- org.basex.core.BaseXException: Database 'test.xml' was not found. at org.basex.core.cmd.Open.open(Open.java:92) at org.basex.query.QueryResources.data(QueryResources.java:405) at org.basex.query.QueryResources.doc(QueryResources.java:207) at org.basex.query.func.fn.Docs.doc(Docs.java:61) at org.basex.query.func.fn.FnDoc.item(FnDoc.java:17) at org.basex.query.func.StandardFunc.optimize(StandardFunc.java:82) at org.basex.query.expr.Arr.compile(Arr.java:43) at org.basex.query.func.StaticFunc.comp(StaticFunc.java:69) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) at org.basex.query.QueryContext.compile(QueryContext.java:312) at org.basex.query.QueryContext.iter(QueryContext.java:331) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:73) at org.basex.http.web.WebResponse.create(WebResponse.java:63) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:53) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:865) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1700) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1667) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:505) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:698) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:804) at java.lang.Thread.run(Thread.java:748) ----- Please find attached a minimal test XQM and a corresponding XML document. Both files have to be stored in the "webapp" subfolder of the folder from which BaseX is called. With the option "WITHDB = false" in ".basex", the exception doesn't occur (which is not surprising). However I think that the exception shouldn't show up in the debug output here at all, as the fn:doc command actually succeeds (and as it "pollutes" the output). I use BaseX 9.2.4 on Linux; the used cmdline is "basexhttp -d". Thanks and best regards, Stefan -- Stefan Pöschel IRT - Institut für Rundfunktechnik GmbH - https://www.irt.de ------------------------------------------------------------ Research and Development Institute of ARD, ZDF, DRadio, ORF and SRG/SSR Floriansmühlstr. 60, 80939 München, Germany Registration court Munich Commercial, Register No. B 5191 Managing Director: Michael Hagemeyer

2 4

Is there an API that provides XQuery compilation results?
by Peter Villadsen 15 Nov '19

15 Nov '19

When I use the GUI application I can see some error description (even if it a little terse) when my queries are incorrect. For instance I might get: Stopped at tableFields.xq, 27/50: [XQST0118] Different start and end tag: <Artifact>...</Artiact>. If I submit a query like <Artifact></Artiact> However, I cannot seem to find an API that brings me that information? I tried: xquery:parse("<B></C>", map {'pass':true()}) but that did not get the result I expected. Also, while we're at at it, it would be nice to also get the optimized query. Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

3 2

Re: [basex-talk] REPLACE vs STORE
by Christian Grün 14 Nov '19

14 Nov '19

> Thank you for your answer. Do you plan something like that in future? We face the problem we need to upload tens thousands of files in 4 hours per week. We are able to do it with replace with folder, but current store per file is too slow. :-( Have you already tried the XQuery way? If so, and if it’s too slow, feel free to share your code with us. > Odesláno z mého chytrého telefonu Samsung Galaxy. > > -------- Původní zpráva -------- > Od: Christian Grün <christian.gruen(a)gmail.com> > Datum: 14.11.19 18:30 (GMT+01:00) > Komu: Radim Havlicek <radim-havlicek(a)post.cz> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Předmět: Re: [basex-talk] REPLACE vs STORE > > Hi Radim, > > The STORE command is restricted to single files [1]. XQuery and > db:store (e.g. combined with file:list) gives you more flexibility > here. > > Hope this helps, > Christian > > [1] http://docs.basex.org/wiki/Commands#STORE > > > > > On Thu, Nov 14, 2019 at 10:53 AM <radim-havlicek(a)post.cz> wrote: > > > > Hello, > > I would like to store new reports into existing database folder (with other existing files already) after opening. > > > > Help: > > REPLACE > > Syntax REPLACE [path] [input] > > XML Syntax <replace path='...'>[input]</replace> > > > > STORE > > Syntax STORE (TO [path]) [input] > > XML Syntax <store (path='...')>[input]</store> > > > > But actually I encountered this problem: > > > open mydb > > Database 'mydb' was opened in 3.0 ms. > > > replace /Report/ c:/Share/REPORTS/ > > 903 resource(s) replaced in 11077.73 ms. > > > store to /Report/ c:/Share/REPORTS/ > > Resource "C:/Share/REPORTS/" not found. > > > > What am I doing wrong? Is it possible to use store to instead of replace to just add files to existing ones? > > > > Thanks in advance for your answer, > > > > Radim Havlicek

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk