- BaseX-Talk - mailman.uni-konstanz.de

array:for-each issue
by Andy Bunce 18 Sep '15

18 Sep '15

Hi, Using 8.2.3 (and the latest beta) this code seems to be invoking the JSON serializer. I don't understand why. declare function local:wrap2($doc,$x as xs:integer*){ $doc }; let $b:=doc("file.xml") return array:for-each([1],local:wrap2($b,?)) And if file.xml is <doc> <p style="prior"/> <p style="target"/> <p style="later"/> </doc> Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.3 beta 89201d1 Java: Oracle Corporation, 1.8.0_45 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.Token.eq(Token.java:619) at org.basex.io.serial.json.JsonNodeSerializer.finishOpen(JsonNodeSerializer.java:145) at org.basex.io.serial.Serializer.prepare(Serializer.java:524) at org.basex.io.serial.Serializer.openElement(Serializer.java:229) at org.basex.io.serial.Serializer.node(Serializer.java:437) at org.basex.io.serial.Serializer.node(Serializer.java:176) at org.basex.io.serial.StandardSerializer.node(StandardSerializer.java:99) at org.basex.io.serial.json.JsonNodeSerializer.node(JsonNodeSerializer.java:89) at org.basex.io.serial.Serializer.serialize(Serializer.java:126) at org.basex.io.serial.StandardSerializer.serialize(StandardSerializer.java:84) at org.basex.io.serial.json.JsonSerializer.serialize(JsonSerializer.java:57) at org.basex.io.serial.json.JsonSerializer.serialize(JsonSerializer.java:76) at org.basex.io.serial.json.JsonSerializer.function(JsonSerializer.java:120) at org.basex.io.serial.AdaptiveSerializer.function(AdaptiveSerializer.java:78) at org.basex.io.serial.Serializer.serialize(Serializer.java:128) at org.basex.io.serial.AdaptiveSerializer.serialize(AdaptiveSerializer.java:63) at org.basex.query.value.Value.serialize(Value.java:223) at org.basex.core.cmd.AQuery.query(AQuery.java:85) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.gui.GUI.exec(GUI.java:472) at org.basex.gui.GUI.access$4(GUI.java:425) at org.basex.gui.GUI$7.run(GUI.java:412)

2 3

Different result in BaseX 8.1 vs. 8.2.3 for path starting with slash
by Amanda Galtman 18 Sep '15

18 Sep '15

Hi, While debugging a query, I noticed a difference in behavior between BaseX 8.1 and BaseX 8.2.3. I boiled it down to this short example, which I hope is understandable even if you don't have my database at hand. for $node in collection("DocLibrary")//chapter return $node/ends-with(/book/title,'Examples') In version 8.2.3, all the results are false, which is unexpected. In version 8.1, I get a mix of true and false values, which is what I expect based on the documents in the database. The XQuery 3.0 and 3.1 specs say the following in the "Path Expressions" section: A "/" at the beginning of a path expression is an abbreviation for the initial step (fn:root(self::node()) treat as document-node())/ (however, if the "/" is the entire path expression, the trailing "/" is omitted from the expansion.) The effect of this initial step is to begin the path at the root node of the tree that contains the context node. If I make the substitution mentioned in the spec, for $node in collection("DocLibrary")//chapter return $node/ends-with((fn:root(self::node()) treat as document-node())/book/title,'Examples') then I get expected results in both BaseX 8.1 and BaseX 8.2.3. Do my unexpected results with 8.2.3 arise from a bug? Perhaps the syntax is not that intuitive in either case (my real query is generated rather than coded by hand, so normally no human needs to look at it), but I still wanted to pose this question in case there is a bug. Thanks, Amanda

2 2

Re: [basex-talk] XSD 1.1
by Christian Grün 17 Sep '15

17 Sep '15

Hi Alex (cc to the list), Your feedback was very helpful. And I've finally learnt more about XML Schema 1.1 validation, which is now available in the new snapshot [1]. I have also completely revised the documentation on our Validation Module [2]. Looking forward to your feedback on your first tests, Christian [1] http://files.basex.org/releases/latest/ [2] http://docs.basex.org/wiki/Validation_Module#XML_Schema_Validation

2 1

Db creation
by meumapple 17 Sep '15

17 Sep '15

Hi, I am trying to open a collection of files where some of them contain character entity references like – which are not declared in the document and so make basex crash if I use collection() If I use file:read-text for each file and then put this functioni in file:write, the saved text will show < > instead of < and >: why? Moreover, if I create a database from the GUI and select the option "skip corrupt", the database is created. However if I follow instruction here http://docs.basex.org/wiki/Parsers In order to add single files to a db usind db:add and precede the query with declare option db:skipcorrupt 'true', the files are not added because I get an error message due to the not well-formed xml. I have tried to declare other db options in the same way but they seem not be read. Giuseppe

3 6

Database corruption
by France Baril 16 Sep '15

16 Sep '15

Hi, Once in a while, when saving a file that is not well formed from Oxygen, instead of just getting a raw file in the server, we end up with a corrupted database. It's not a constant occurrence meaning that it doesn't happen all the time, but we were able to get what we think is a relevant error message. We think saving 310.mot.com:8984/webdav/en-us/topics/legal-privacy-modular.xml while it wasn't well formed is what caused the issue. local:8984/webdav/en-us/topics/legal-privacy-modular.xml [qtp1977419222-62] INFO com.bradmcevoy.http.HttpManager - PUT :: http://~ local:8984/webdav/en-us/topics/legal-privacy-modular.xml - http://~ local:8984/webdav/en-us/topics/legal-privacy-modular.xml [qtp1977419222-64] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml [qtp1977419222-65] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml java.lang.NullPointerException java.lang.NullPointerException [qtp1977419222-62] WARN com.bradmcevoy.http.http11.PutHandler - parent exists bu t is not a collection resource: /webdav/en-us/topics [qtp1977419222-61] WARN com.bradmcevoy.http.http11.PutHandler - parent exists bu t is not a collection resource: /webdav/en-us/topics java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException [qtp1977419222-62] WARN com.bradmcevoy.http.http11.PutHandler - Your resource fa ctory returned a resource with a different name to that requested!!! Requested: webdav returned: - resource factory: class org.basex.http.webdav.BXResourceFact ory java.lang.NullPointerException [qtp1977419222-61] WARN com.bradmcevoy.http.http11.PutHandler - Your resource fa ctory returned a resource with a different name to that requested!!! Requested: webdav returned: - resource factory: class org.basex.http.webdav.BXResourceFact ory java.lang.NullPointerException java.lang.NullPointerException [qtp1977419222-61] ERROR com.bradmcevoy.http.StandardFilter - process [qtp1977419222-62] ERROR com.bradmcevoy.http.StandardFilter - process java.lang.NullPointerException at java.text.SimpleDateFormat.parse(Unknown Source) at java.text.DateFormat.parse(Unknown Source) at org.basex.util.DateTime.parse(DateTime.java:66) at org.basex.http.webdav.impl.WebDAVService.timestamp(WebDAVService.java :120) at org.basex.http.webdav.impl.WebDAVService.createDb(WebDAVService.java: 269) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:77) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:1) at org.basex.http.webdav.BXCode.eval(BXCode.java:37) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:79) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:1) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:261) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:249) at com.bradmcevoy.http.http11.PutHandler.process(PutHandler.java:175) at com.bradmcevoy.http.StandardFilter.process(StandardFilter.java:52) at com.bradmcevoy.http.FilterChain.process(FilterChain.java:40) at com.bradmcevoy.http.HttpManager.process(HttpManager.java:228) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:43) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684 ) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java :503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.jav a:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl er.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl er.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java: 429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle r.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle r.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper .java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(Abstrac tHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpC onnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.conten t(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnecti on.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEn dPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEnd Point.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo l.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool .java:543) at java.lang.Thread.run(Unknown Source) java.lang.NullPointerException at java.text.SimpleDateFormat.parse(Unknown Source) at java.text.DateFormat.parse(Unknown Source) at org.basex.util.DateTime.parse(DateTime.java:66) at org.basex.http.webdav.impl.WebDAVService.timestamp(WebDAVService.java :120) at org.basex.http.webdav.impl.WebDAVService.createDb(WebDAVService.java: 269) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:77) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:1) at org.basex.http.webdav.BXCode.eval(BXCode.java:37) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:79) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:1) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:261) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:249) at com.bradmcevoy.http.http11.PutHandler.process(PutHandler.java:175) at com.bradmcevoy.http.StandardFilter.process(StandardFilter.java:52) at com.bradmcevoy.http.FilterChain.process(FilterChain.java:40) at com.bradmcevoy.http.HttpManager.process(HttpManager.java:228) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:43) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684 ) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java :503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.jav a:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl er.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl er.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java: 429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle r.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle r.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper .java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(Abstrac tHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpC onnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.conten t(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnecti on.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEn dPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEnd Point.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo l.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool .java:543) at java.lang.Thread.run(Unknown Source) [qtp1977419222-49] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml [qtp1977419222-64] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml [qtp1977419222-55] INFO com.bradmcevoy.http.HttpManager - PROPFIND :: http://~local:8984/webdav/html-review/ - http://~local:8984/webd av/html-review/ -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 3

duplicate declaration error-message when using dynamic module-imports ( inspect:functions)
by Rob Stapper 16 Sep '15

16 Sep '15

Hi, I get a "duplicate declaration" error-message when I using the inspect:functions-function. Consider program: testRun1-2a.xq. The program imports module: module1.xqm and module2a.xqm. Module: module1.xqm, declares a variable: $mod1:x, and a function: mod1:show( $x). Module: module2a.xqm, declare a function: mod2a:run, which calls a function by a given function-name: $name in a dynamically imported module by a given module-uri: $uri. Program: testRun1-2a.xq, calls the run-function in module2a and tells it to use variable: $mod1:x, on function: mod1:show in module: module1.xqm. This triggers an error: Duplicate declaration on static variable $mod1:x. On the other hand, program: testRun1-2b.xq, does exactly the same except that module:module2b.xqm, is statically linked to module: module1.xqm, instead of dynamically as happens in module:module2a.xqm. Shouldn't the dynamically import of modules behave in the same manner as its static counterpart? Is it possible to achieve this? Cheers, Rob PS the examples are a bit awkward but in my real-life program this construction makes sense (to my anyway). --- Dit e-mailbericht is gecontroleerd op virussen met Avast antivirussoftware. https://www.avast.com/antivirus

2 1

Stopword-related NullPointerException (in FTWords.java)
by Ron Katriel 15 Sep '15

15 Sep '15

Hi, I encountered a peculiar error with a query using a stopwords file in the context of a full text search. The query joins two XML databases: CT.gov (containing 86635503 nodes) and the 2015 MeSH dictionary (containing 12064461 nodes). I am debugging using CT.gov trial NCT00303472, hardcoded in the ‘where' clause of the following query: let $trees := db:open('MeSH')/DescriptorRecordSet/DescriptorRecord for $article in db:open('CTGov')/clinical_study where $article/id_info/nct_id = 'NCT00303472' let $mesh := $article/condition_browse/mesh_term let $tn1 := $trees[DescriptorName/String contains text { $mesh }] let $tn2 := $trees[DescriptorName/String contains text { $mesh } using stop words at "/Volumes/Extra/Documents/Standards/MeSH/stopwords.txt"]/TreeNumberList/TreeNumber return <match> { $article/id_info/nct_id, $mesh, $tn2 } </match> When the return clause contains the variable $tn2 (i.e., using stopwords - as shown above) a Java NullPointerException is generated (see the stack trace below). However, when only $tn1 is returned there is no problem (the code for $tn2 is removed by the optimizer). The issue is related to a specific stopword (“syndrome”). When the stopword is removed from the file the exception does not occur. Surprisingly, when the stopword is in uppercase (“Syndrome”) the issue does not occur - even though the target MeSH term in this CT.gov trial is in uppercase, that is <mesh_term>Syndrome</mesh_term> Am I doing something wrong, or is this a real bug in BaseX? If the former, please suggest a workaround as I would like to filter out generic MeSH terms that match the stopwords before any further processing (I removed a lot of code from the above query to make it easier to debug). Thanks, Ron Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2 Java: Oracle Corporation, 1.8.0_20 OS: Mac OS X, x86_64 Stack Trace: java.lang.NullPointerException at org.basex.query.expr.ft.FTWords$1.next(FTWords.java:166) at org.basex.query.expr.ft.FTIndexAccess$1.next(FTIndexAccess.java:48) at org.basex.query.expr.ft.FTIndexAccess$1.next(FTIndexAccess.java:45) at org.basex.query.iter.Iter.value(Iter.java:53) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:67) at org.basex.query.QueryContext.value(QueryContext.java:421) at org.basex.query.expr.path.CachedPath.iter(CachedPath.java:41) at org.basex.query.expr.path.CachedPath.iter(CachedPath.java:22) at org.basex.query.QueryContext.iter(QueryContext.java:410) at org.basex.query.expr.List$1.next(List.java:133) at org.basex.query.expr.constr.Constr.add(Constr.java:70) at org.basex.query.expr.constr.CElem.item(CElem.java:92) at org.basex.query.expr.constr.CElem.item(CElem.java:23) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:43) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:99) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.query.QueryContext.cache(QueryContext.java:660) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:103) at org.basex.core.cmd.AQuery.query(AQuery.java:83) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.gui.GUI.exec(GUI.java:472) at org.basex.gui.GUI.access$400(GUI.java:43) at org.basex.gui.GUI$7.run(GUI.java:412) Compiling: - pre-evaluating db:open("MeSH") - pre-evaluating db:open("CTGov") - inlining $trees_0 - applying full-text index for { $mesh_2 } using language 'English' - applying full-text index for { $mesh_2 } using language 'English' - inlining $tn2_4 - removing variable $tn1_3 - applying text index for "NCT00303472" - rewriting where clause(s) Query: let $trees := db:open('MeSH')/DescriptorRecordSet/DescriptorRecord for $article in db:open('CTGov')/clinical_study where $article/id_info/nct_id = 'NCT00303472' let $mesh := $article/condition_browse/mesh_term let $tn1 := $trees[DescriptorName/String contains text { $mesh }] let $tn2 := $trees[DescriptorName/String contains text { $mesh } using stop words at "/Volumes/Extra/Documents/Standards/MeSH/stopwords.txt"]/TreeNumberList/TreeNumber return <match> { $article/id_info/nct_id, $mesh, $tn2 } </match> Optimized Query: for $article_1 in db:text("CTGov", "NCT00303472")/parent::*:nct_id/parent::*:id_info/parent::*:clinical_study let $mesh_2 := $article_1/*:condition_browse/*:mesh_term return element match { (($article_1/*:id_info/*:nct_id, $mesh_2, ft:search("MeSH", { $mesh_2 } using language 'English')/parent::*:String/parent::*:DescriptorName/parent::*:DescriptorRecord/TreeNumberList/TreeNumber)) } Query plan: <QueryPlan compiled="true"> <GFLWOR> <For> <Var name="$article" id="1"/> <IterPath> <ValueAccess data="CTGov" type="TEXT" name="*:nct_id"> <Str value="NCT00303472" type="xs:string"/> </ValueAccess> <IterStep axis="parent" test="*:id_info"/> <IterStep axis="parent" test="*:clinical_study"/> </IterPath> </For> <Let> <Var name="$mesh" id="2"/> <IterPath> <VarRef> <Var name="$article" id="1"/> </VarRef> <IterStep axis="child" test="*:condition_browse"/> <IterStep axis="child" test="*:mesh_term"/> </IterPath> </Let> <CElem> <QNm value="match" type="xs:QName"/> <List> <IterPath> <VarRef> <Var name="$article" id="1"/> </VarRef> <IterStep axis="child" test="*:id_info"/> <IterStep axis="child" test="*:nct_id"/> </IterPath> <VarRef> <Var name="$mesh" id="2"/> </VarRef> <CachedPath> <FTIndexAccess data="MeSH"> <FTWords> <VarRef> <Var name="$mesh" id="2"/> </VarRef> </FTWords> </FTIndexAccess> <IterStep axis="parent" test="*:String"/> <IterStep axis="parent" test="*:DescriptorName"/> <IterStep axis="parent" test="*:DescriptorRecord"/> <IterStep axis="child" test="TreeNumberList"/> <IterStep axis="child" test="TreeNumber"/> </CachedPath> </List> </CElem> </GFLWOR> </QueryPlan> Ron Katriel, Ph.D. | Senior Data Scientist | Medidata Solutions 350 Hudson Street, 7th Floor, New York, NY 10014 rkatriel(a)mdsol.com | direct: +1 201 337 3622 | mobile: +1 201 675 5598 | main: +1 212 918 1800

2 6

Different behavior with same query in BaseX 7.9 and 8.2.3
by Antoine WOLF 15 Sep '15

15 Sep '15

*Hi,* *We are in the process of evaluating BaseX and recently upgraded from version 7.9 to 8.2.3We have a DB “TESTDB” with 50 xml files, named Fund1.xml, Fund2.xml, Fund3.xml,…. each having the same structure:Fund1.xml--------------< fund>…<properties>…<domain reference=”fund1”>…</domain>…</properties>…</fund>Fund2.xml--------------< fund>…<properties>…<domain reference=”fund2”>…</domain>…</properties>…</fund>….….The following query does not behave the same on both versions :For $d at $i in db:open(“TESTDB”)/fund/properties/domainwhere $i < 2return data($d/@reference)Result in 7.9------------------“Fund1”Result in 8.2.3-----------------“Fund1 Fund2 Fund3 Fund4 …”Is this a bug or is there something wrong with the query ?Best Regards,Antoine Wolf*

3 3

Unexpected error: Improper use? Potential bug?
by Pierre-Yves JALLUD 15 Sep '15

15 Sep '15

Hi all, I have some troubles with BaseX request and webdav access. My situation is the following: the acces to BaseX with webdav is with an oXygen (developer version 17) with Ubuntu 14.0.4 and the BaseX server is running under a Scientific Linux 64b (2.6.32-573.3.1.el6.x86_64 ... if the precision is necessary ;)). The BaseX server is behind a web cluster using a load balancer and an APACHE HTTP server. All the access passing thrue this server and the different ports access are managed with HAProxy. If the context is not clear enough, don't hesitate to ask more precisions. The symptom is that the BaseX server is freezing after a webdav request. The log's extracts you can find below track the following use case: - I try an access to http://BaseX.huma-num.fr/webdav/bvm/bvm.xml with oXygen - I recieve a HTTP error 500 - I try to access to the BaseX server with my web site and more than one minute later, I have a timeout. ... but the worst symptom is that in some cases (not always), the requested db get corrupted and emptied (totally or partly) : resources are missing or they throw End of File exceptions when we then try to reopen them. This use case can appear many times a day... but not systematically. And other colleagues have the same problems with other version of oXygen with other OS (Windows), but allways with the same BaseX server. Does anyone of you have an idea to solve my problem? Thanks Pierre-Yves Some extracts of the log file: ... 17:13:06.694 X.X.X.X:34953 admin REQUEST [GET] http://BaseX.huma-num.fr/webdav/bvm/bvm.xml 17:13:06.845 X.X.X.X:34954 admin REQUEST [LOCK] http://BaseX.huma-num.fr/webdav/bvm/bvm.xml 17:13:06.888 X.X.X.X:34954 admin 200 43.82 ms 17:13:08.437 X.X.X.X:34953 admin 500 Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.1 Java: Oracle Corporation, 1.8.0_31 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: org.eclipse.jetty.io.EofException at org.basex.http.webdav.BXServletResponse.close(BXServletResponse.java:80) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:46) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextH... 1743.02 ms ... 17:15:20.041 X.X.X.X:38436 admin REQUEST [PROPFIND] http://BaseX.huma-num.fr/webdav/skepsis/Cicero_De_Finibus.xml 17:15:40.067 X.X.X.X:38770 admin REQUEST [PROPFIND] http://BaseX.huma-num.fr/webdav/skepsis/Cicero_De_Finibus.xml 17:16:00.078 X.X.X.X:39090 admin REQUEST [PROPFIND] http://BaseX.huma-num.fr/webdav/skepsis/ 17:16:00.170 X.X.X.X:39091 admin REQUEST [PROPFIND] http://BaseX.huma-num.fr/webdav/bvm/bvm.xml 17:16:20.194 X.X.X.X:39582 admin REQUEST [PROPFIND] http://BaseX.huma-num.fr/webdav/bvm/bvm.xml 17:17:00.904 X.X.X.X:39091 admin 200 60733.77 ms 17:17:00.907 X.X.X.X:39582 admin 200 40712.41 ms 17:17:00.909 X.X.X.X:38770 admin 200 80842.45 ms 17:17:00.910 X.X.X.X:38436 admin 200 100868.15 ms 17:17:01.004 X.X.X.X:39090 admin 200 60926.05 ms 17:19:37.189 Y.Y.Y.Y:39926 admin ERROR Timeout exceeded. 60000.62 ms ...

3 6

Re: [basex-talk] Xquery collections
by michele.greco2＠email.it 15 Sep '15

15 Sep '15

Hi, i tried this xquery: for $e in db:open("dbName")//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in db:open("dbName")//w:tc[.//text()="Indirizzo"] return $x//following::text())   but only returns the result of the first document. How do i do it for all the documents? --------- Original Message -------- Da: "Dirk Kirsten" <dk(a)basex.org> To: Cc: basex-talk(a)mailman.uni-konstanz.de Oggetto: Re: [basex-talk] Xquery collections Data: 03/09/15 18:08 Ciao Michele, welcome to the community :-) Collections in BaseX are basically databases. You can simply open a database e.g. by issueing the XQuery db:open('mydatabase'). This will use all documents in your database. You can find some more examples at http://docs.basex.org/wiki/Databases It might also be helpful for you to read some of the Tutorials given at http://docs.basex.org/wiki/Getting_Started like BaseX for Dummies, given a concise introduction to BaseX. Spero che sia d'aiuto Dirk On 09/03/2015 05:48 PM, michele.greco2(a)email.it wrote: Hello I Michele i'm new to basex, i created a collection with different documents .xml. I want to know how to query the entire collection e its documents at one xquery. I'm trying,but i can't.   Thanks. MG   ---- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli clicca qui Sponsor: Idee regalo classiche o alternative? Trova l'offerta migliore in un click Clicca qui -- Dirk Kirsten, BaseX GmbH, http://basexgmbh.de |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a quelle certificate PEC. Confronta le soluzioni Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13325&d=4-9

3 2

Validate module and catalogs
by Lizzi, Vincent 14 Sep '15

14 Sep '15

It appears that the Validate module is not using catalogs. I'm working with XML that contains a DTD DOCTYPE declaration with a public identifier and a system identifier that contains the filename of the DTD, and I have set up a catalog that provides the DTD location. Here is a rough example: declare option db:chop 'false'; declare option db:dtd 'true'; declare option db:catfile 'schemas/catalog.xml'; let $xmlFile := 'path/to/file.xml' let $parsed := doc($xmlFile) let $report := validate:dtd-report($xmlFile) return ($report, $parsed) This fails on the validate:dtd-report line. The error report indicates that BaseX is trying to find the DTD in the same folder as the XML file. I know the catalog is working because the doc() call is parsing the XML and populating default attributes, and if I remove the db:catfile option declaration the doc() call fails. If I add a path to the DTD in the second parameter in validate:dtd-report($xmlFile, 'path/to/dtd.dtd') the validation works. I'm not sure why this is needed because the XML contains a DOCTYPE and the catalog should be resolving the DTD location. Is this intentional? There are use cases to require that validation is done using a specific DTD and not simply any DTD that the XML happens to declare. In other cases however it is easier to validate using the DTD that is already identified in the DOCTYPE of the XML file. Is this a bug? Thanks, Vincent

3 3

Out of Main Memory - Inconsistent DB
by Martín Ferrari 14 Sep '15

14 Sep '15

Hi all, I think one of our DB seems to have gotten corrupt. I wonder if there's a command that will recover it. Issuing REPLACE or OPTIMIZE on it will result in "Out of Main Memory" errors. We have DBs that occupy more space and have more documents, so I assume the problem must be that this DB broke somehow. I've tried raising the -Xmx parameter to 1024m, but still get the same "Out of Main Memory" error. Thanks, Martín. INSPECT Checking main table (11292441 nodes):- 0 invalid node kinds- 0 invalid parent references- 87 wrong parent/descendant relationships (pre: 10932445,..)Warning: Database is inconsistent. INFO DB Database Properties Name: OrderInquiryV2_1 Size: 2138 MB Nodes: 11292441 Documents: 251980 Binaries: 0 Timestamp: 2015-09-10T16:40:29.000Z Resource Properties Timestamp: 2015-09-08T23:11:28.497Z Encoding: UTF-8 CHOP: false Indexes Up-to-date: false TEXTINDEX: false ATTRINDEX: false FTINDEX: false LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: false AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96

2 1

Re: [basex-talk] size on collection in the time (Marc)
by cmarchand＠oxiane.com 14 Sep '15

14 Sep '15

I confirm the problem : on another database (same data, same script.xbs, different server), we have exactly the same problem : the database grows each time the script is run. I'm going to prepare a test-case with small public data tonight. Best regards, Christophe Hello Dirk, We use a BaseX script (.xbs) with a list of REPLACE. We try to investigate this point if this is reproducable or not. If I find this problem again, I take a copy of the collection before to delete her. Thank you for answer. Marc Le 03/09/2015 09:52, Dirk Kirsten a ?crit : > Hello Marc, > > sure, a replace should lead to a true replace, i.e. the old data will be > dropped. So this sounds like a bug, but it is difficult to replicate > from what you describe. > > Do you think it would be possible to make the issue reproducable, maybe > also with a smaller data set? Also, how exactly do you add documents or > do you also do any queries and maybe other updating queries? > > Cheers > Dirk > > On 09/02/2015 05:36 PM, Marc wrote: > >> Hi, >> I have a remark about the size of the files of a collection. >> We do a lot of updates (REPLACE) with an attributes index but without >> a text index. >> I see that the size of the files grows up in the time we arrive until >> 30Go until the limit of the filessytems quota. >> When I drop the collection and recreate it from the last version of >> the files the size was only 6Go. >> >> We will redo the test with the time, but I just want to know if the >> program clears the disk use when he does a REPLACE? >> >> Marc ------------------------------ Message: 4 Date: Thu, 3 Sep 2015 10:01:05 +0200 From: Marc <Marc.Liste(a)free.fr> To: Dirk Kirsten <dk(a)basex.org> Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> Subject: Re: [basex-talk] (no subject) Message-ID: <55E7FE41.5080205(a)free.fr> Content-Type: text/plain; charset=iso-8859-15; format=flowed I forgot to give this precision, we use the 7.9 version on this server. Marc Le 01/01/1970 01:00, a ?crit : > Hello Dirk, > We use a BaseX script (.xbs) with a list of REPLACE. > We try to investigate this point if this is reproducable or not. > If I find this problem again, I take a copy of the collection before to > delete her. > > Thank you for answer. > > Marc > Le 03/09/2015 09:52, Dirk Kirsten a ?crit : Hello Marc, > > sure, a replace should lead to a true replace, i.e. the old data will be > dropped. So this sounds like a bug, but it is difficult to replicate > from what you describe. > > Do you think it would be possible to make the issue reproducable, maybe > also with a smaller data set? Also, how exactly do you add documents or > do you also do any queries and maybe other updating queries? > > Cheers > Dirk > > On 09/02/2015 05:36 PM, Marc wrote: Hi, > I have a remark about the size of the files of a collection. > We do a lot of updates (REPLACE) with an attributes index but without > a text index. > I see that the size of the files grows up in the time we arrive until > 30Go until the limit of the filessytems quota. > When I drop the collection and recreate it from the last version of > the files the size was only 6Go. > > We will redo the test with the time, but I just want to know if the > program clears the disk use when he does a REPLACE? > > Marc End of BaseX-Talk Digest, Vol 69, Issue 5 *****************************************

2 1

size on collection in the time
by Marc 14 Sep '15

14 Sep '15

Hi, I have a remark about the size of the files of a collection. We do a lot of updates (REPLACE) with an attributes index but without a text index. I see that the size of the files grows up in the time we arrive until 30Go until the limit of the filessytems quota. When I drop the collection and recreate it from the last version of the files the size was only 6Go. We will redo the test with the time, but I just want to know if the program clears the disk use when he does a REPLACE? Marc

3 4

Schematron validation
by Lizzi, Vincent 14 Sep '15

14 Sep '15

I have just released a module that provides an easy way to use Schematron in BaseX. It's is available on GitHub at https://github.com/vincentml/schematron-basex. This module is a convenience wrapper around the standard ISO Schematron XSLTs. In addition, a version of this module for eXist-db is available at https://github.com/vincentml/schematron-exist Vincent "Everything should be made as simple as possible, but not simpler."

2 1

Fastest way to get resources starting with path
by Martín Ferrari 14 Sep '15

14 Sep '15

Hello: I wonder if there's a fast way to get the contents or names of the resources that start with a certain path. We have something like this: string query = @"for $doc in collection() where substring-after(document-uri($doc), '/') = '" + documentName + @"' return $doc/Root"; But our db has millions of resources so this doesn't scale too well. I'd like a way to get the contents (or names) of resources in which the names start with a certain pattern without having to check all names. Is it possible? The alternative would be to add a field inside the xml resources, index on it, and perform a query. Thanks, Martín.

3 3

Erstellen eines XLSX Sheet mittels Apache POI in einer XQuery Rest Funktion
by Arthur Stocker 14 Sep '15

14 Sep '15

Hallo Zusammen Ich möchte in einer REST Funktion Daten als XLSX zurück geben. Via Java Bindings wollte ich in der Xquery Funktion die Apache POI nutzen und habe mal versucht das einfache Beispiel der JSP Seite zu übersetzen, scheitere nun aber an der Meldung "[XPST0017] Several implementations found for …. „ beim Aufruf der Funktion createSheet(). Einfacher Versuch - XQ Funktion. import module namespace xlsx = "org.apache.poi.xssf.usermodel.XSSFWorkbook"; declare %rest:path('/test') function root:test( ) { let $sheet := xlsx:createSheet() let $row := $sheet:createRow(0) let $cell := $row:createCell(0) return $cell:setCellValue("Some text“) }; JSP Source: <%@page import="org.apache.poi.xssf.usermodel.*" %><%@page import="java.io.*" %><% // create a small spreadsheet if xls then HSSF.... instead of XSSF.... for xlsx XSSFWorkbook wb = new XSSFWorkbook(); XSSFSheet sheet = wb.createSheet(); XSSFRow row = sheet.createRow(0); XSSFCell cell = row.createCell(0); cell.setCellValue("Some text"); // write it as an excel attachment ByteArrayOutputStream outByteStream = new ByteArrayOutputStream(); wb.write(outByteStream); byte [] outArray = outByteStream.toByteArray(); //response.setContentType("application/ms-excel"); response.setContentType("application/vnd.openxmlformats-officedocument.spreadsheetml.sheet"); response.setContentLength(outArray.length); response.setHeader("Expires:", "0"); // eliminates browser caching //response.setHeader("Content-Disposition", "attachment; filename=testxls.xls"); response.setHeader("Content-Disposition", "attachment; filename=testxls.xlsx"); OutputStream outStream = response.getOutputStream(); outStream.write(outArray); outStream.flush(); %> Die Dokumentation konnte mir das weitere Vorgehen nicht so ganz aufzeigen. Hat jemand das Apache POI schonmal in XQuery genutzt? Beim Lesen der Doku und den Beispielen bekomme ich den Eindruck, nicht um das Schreiben einer eigenen JAVA Klasse herum zu kommen. VG Arthur

2 1

DELETE Performance
by Martín Ferrari 14 Sep '15

14 Sep '15

Hi: I have a DB with around a million records. Adding resources to it takes some milliseconds. However, executing DELETE on a resource takes more than 60 seconds. Am I doing something wrong? Is this by design? Thanks! Martín.

3 3

http:request timeout
by Marco Lettere 13 Sep '15

13 Sep '15

Hello all, I think there is a mismatch in the semantics of timeout for the http:request datastructure. expath says it's in seconds where as the basex impl treats it as milliseconds. Could you confirm this? The expath states: [...] |timeout|is the maximum number of seconds to wait for the server to respond. If this time duration is reached, an error is thrown[err:HC006] <http://expath.org/spec/http-client#errHC006>. [...] whereas in the HttpClient (lines 168 and 169) the code for setting the timeout is the following: [...] final String timeout = request.attribute(TIMEOUT); if(timeout != null) conn.setConnectTimeout(Strings.toInt(timeout)); [...] conn being an instance of HttpUrlConnection and the documentation of setConnectTimeout states it to be in milliseconds. If this is not my bad interpretation, maybe a note in the docs should be provided ... Regards, Marco.

3 2

FW: duplicate declaration error-message when using dynamic module-imports ( inspect:functions) ( in the rebound)
by Rob Stapper 11 Sep '15

11 Sep '15

Hi, Probably my previous mail got lost somewhere, so here it is again. Regards, Rob Stapper Van: Rob Stapper [mailto:r.stapper@lijbrandt.nl] Verzonden: dinsdag 8 september 2015 16:16 Aan: BaseX Onderwerp: duplicate declaration error-message when using dynamic module-imports ( inspect:functions) Hi, I get a "duplicate declaration" error-message when I using the inspect:functions-function. Consider program: testRun1-2a.xq. The program imports module: module1.xqm and module2a.xqm. Module: module1.xqm, declares a variable: $mod1:x, and a function: mod1:show( $x). Module: module2a.xqm, declare a function: mod2a:run, which calls a function by a given function-name: $name in a dynamically imported module by a given module-uri: $uri. Program: testRun1-2a.xq, calls the run-function in module2a and tells it to use variable: $mod1:x, on function: mod1:show in module: module1.xqm. This triggers an error: Duplicate declaration on static variable $mod1:x. On the other hand, program: testRun1-2b.xq, does exactly the same except that module:module2b.xqm, is statically linked to module: module1.xqm, instead of dynamically as happens in module:module2a.xqm. Shouldn't the dynamically import of modules behave in the same manner as its static counterpart? Is it possible to achieve this? Cheers, Rob PS the examples are a bit awkward but in my real-life program this construction makes sense (to my anyway). --- Dit e-mailbericht is gecontroleerd op virussen met Avast antivirussoftware. https://www.avast.com/antivirus

1 0

Re: [basex-talk] problem with prepared
by michele.greco2＠email.it 10 Sep '15

10 Sep '15

Sorry and thanks for the answer. Michele --------- Original Message -------- Da: "Dirk Kirsten" <dk(a)basex.org> To: Cc: "Maximilian GÃ&fnof;Â¤rber" <mgaerber(a)arcor.de>de>, basex-talk(a)mailman.uni-konstanz.de Oggetto: Re: [basex-talk] problem with prepared Data: 10/09/15 10:28 Hello Michele, please always make sure to send us a SSCCEE (see http://sscce.org/). It is very time-consuming to read such a large XQuery and I highly doubt all this is relevant for your actual problem. Also, I highly doubt that you need 8 (!) for-loops, which are all nested. This takes an execution time of n^8, which is **a lot**, even for small values of n. Also, all your for loops seem to do basically the same and work on the same data, so I doubt that it is really neccessary. Based on this and your previous questions I would recommend you to get a better understanding of XQuery before tackling your actual problem. Otherwise, you will always stumble across new problems, which you could self yourself better and faster if you know the core conecpts. I can recommend the XQuery book by Priscilla Walmsley, I also find the wikibook about XQuery (https://en.wikibooks.org/wiki/XQuery) quite useful. As part of our commercial offering we also offer seminars or on-site training (see http://basexgmbh.de/en/). If you are interested, please contact us in private. Regards, Dirk On 09/10/2015 10:10 AM, michele.greco2(a)email.it wrote: Thanks for the help ,Max. I modified my xquery this way: declare namespace pkg="http://schemas.microsoft.com/office/2006/xmlPackage"; declare namespace w="http://schemas.openxmlformats.org/wordprocessingml/2006/main"; declare function local:indice() as xs:integer* {   for $i in(1 to count(for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text()))) return $i }; declare function local:nome() as xs:string* { for $n in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text())) return $n }; declare function local:indirizzo() as xs:string* { for $in in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Indirizzo"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Telefono"] return $x//following::text())) return $in  }; declare function local:telefono() as xs:string* { for $t in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Telefono"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Fax"] return $x//following::text())) return $t };  declare function local:fax() as xs:string* { for $f in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Fax"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="E-mail"] return $x//following::text())) return $f }; declare function local:email() as xs:string* {  for $em in  (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="E-mail"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Nazionalità"] return $x//following::text())) return $em   }; declare function local:nazionalita() as xs:string* { for $na in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nazionalità"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text() ="D" ] return $x//following::text())) return $na }; declare function local:dataNascita() as xs:string* { for $d in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Data di nascita"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Esperienza lavorativa"] return $x//following::text())) return $d }; for $indice at $pos in local:indice() for $nome in local:nome() [$pos] for $indirizzo in local:indirizzo()[$pos] for $telefono in local:telefono()[$pos] for $fax  in local:fax()[$pos] for $email  in local:email()[$pos] for $nazionalita  in local:nazionalita()[$pos] for $datanascita  in local:dataNascita()[$pos] let $init := sql:init("com.mysql.jdbc.Driver"),     $conn := sql:connect("jdbc:mysql://localhost:3306/DbName","user","password''),     $stmt := sql:prepare($conn, "INSERT INTO informazionipersonali(idInformazioniPersonali,nome,indirizzo,telefono,fax,email,nazionalità,dataNascita) VALUES(?,?,?,?,?,?,?,?) ")         let $params:=  <sql:parameters>         <sql:parameter type="int">{$indice}</sql:parameter>        <sql:parameter type="string">{$nome}</sql:parameter>       <sql:parameter type="string">{$indirizzo}</sql:parameter>       <sql:parameter type="string">{$telefono}</sql:parameter>        <sql:parameter type="string">{$fax}</sql:parameter>       <sql:parameter type="string">{$email}</sql:parameter>       <sql:parameter type="string">{$nazionalita}</sql:parameter>        <sql:parameter type="string">{$datanascita}</sql:parameter>      </sql:parameters>  return sql:execute-prepared($stmt,$params)   It works,but it returns only the first row in my database, and i want a row for each value (indice,nome,indirizzo,........) How can i do? --------- Original Message -------- Da: "Maximilian GÃ¤rber" <mgaerber(a)arcor.de> To: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> Oggetto: Re: [basex-talk] problem with prepared Data: 09/09/15 09:12 or using a where statement for $indice at $pos in local:indice() for $nome at $pos2 in local:nome() let $params:= <sql:parameters> <sql:parameter type="int">{$indice}</sql:parameter> <sql:parameter type="string">{$nome}</sql:parameter> </sql:parameters> where $pos2 = $pos return $params 2015-09-09 9:05 GMT+02:00 Maximilian Gärber <mgaerber(a)arcor.de>de>: > Hi, > > when you join (by nesting for statements) you will always get the > combinations unless you provide more constraints. > > You might try something like: > > declare function local:indice() as xs:integer* { > > for $i in (1 to 10) > return $i > }; > > declare function local:nome() as xs:string* { > > for $n in ('a', 'b', 'c', 'd') > return $n > }; > > for $indice at $pos in local:indice() > for $nome in local:nome()[$pos] > > let $params:= <sql:parameters> > <sql:parameter type="int">{$indice}</sql:parameter> > <sql:parameter type="string">{$nome}</sql:parameter> > </sql:parameters> > return $params > > > Regards, Max > > 2015-09-08 16:20 GMT+02:00 <michele.greco2(a)email.it>it>: >> Hi i have following xquery: >> declare function local:indice() as xs:integer* { >> count(for $document in collection("curriculum") >> let $c:= document-uri($document) >> for $a in doc($c) >> order by $c >> return >> for $e in doc($c)//w:tc[.//text()="Nome"] >> return $e/./following::text()except >> (for $x in doc($c)//w:tc[.//text()="Indirizzo"] >> return $x//following::text())) >> }; >> >> declare function local:nome() as xs:string* { >> for $document in collection("curriculum") >> let $c:= document-uri($document) >> for $a in doc($c) >> order by $c >> return >> for $e in doc($c)//w:tc[.//text()="Nome"] >> return $e/./following::text()except >> (for $x in doc($c)//w:tc[.//text()="Indirizzo"] >> return $x//following::text()) >> }; >> for $ indice in local:indice() >> let $init := sql:init("com.mysql.jdbc.Driver"), >> $conn := >> sql:connect("jdbc:mysql://localhost:3306/DBName","user","password''), >> $stmt := sql:prepare($conn, "INSERT INTO >> informazionipersonali(idInformazioniPersonali,nome,indirizzo,telefono,fax,email,nazionalità,dataNascita) >> VALUES(?,?,'null','null','null','null','null','null') ") >> for $nome in local:nome() >> let $params:= <sql:parameters> >> <sql:parameter type="int">{$indice}</sql:parameter> >> <sql:parameter type="string">{$nome}</sql:parameter> >> </sql:parameters> >> return sql:execute-prepared($stmt,$params) >> >> >> which return a combination of index and names, but i want only one row for >> each index and name. >> How can i do? >> >> ---- >> ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per >> tutti i dettagli clicca qui >> >> Sponsor: >> Registra i domini che desideri ed inizia a creare il tuo sito web >> Clicca qui ---- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli clicca qui Sponsor: Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a quelle certificate PEC. Confronta le soluzioni Clicca qui -- Dirk Kirsten, BaseX GmbH, http://basexgmbh.de |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Caselle con tuo dominio su piattaforma Zimbra, fino a 30 GB di spazio, sincronizzazione dati e backup Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13324&d=10-9

1 0

Re: [basex-talk] problem with prepared
by michele.greco2＠email.it 10 Sep '15

10 Sep '15

Thanks for the help ,Max. I modified my xquery this way: declare namespace pkg="http://schemas.microsoft.com/office/2006/xmlPackage"; declare namespace w="http://schemas.openxmlformats.org/wordprocessingml/2006/main"; declare function local:indice() as xs:integer* {   for $i in(1 to count(for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text()))) return $i }; declare function local:nome() as xs:string* { for $n in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text())) return $n }; declare function local:indirizzo() as xs:string* { for $in in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Indirizzo"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Telefono"] return $x//following::text())) return $in  }; declare function local:telefono() as xs:string* { for $t in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Telefono"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Fax"] return $x//following::text())) return $t };  declare function local:fax() as xs:string* { for $f in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Fax"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="E-mail"] return $x//following::text())) return $f }; declare function local:email() as xs:string* {  for $em in  (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="E-mail"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Nazionalità"] return $x//following::text())) return $em   }; declare function local:nazionalita() as xs:string* { for $na in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nazionalità"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text() ="D" ] return $x//following::text())) return $na }; declare function local:dataNascita() as xs:string* { for $d in (for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Data di nascita"] return $e/./following::text() except   (for $x in doc($c)//w:tc[.//text()="Esperienza lavorativa"] return $x//following::text())) return $d }; for $indice at $pos in local:indice() for $nome in local:nome() [$pos] for $indirizzo in local:indirizzo()[$pos] for $telefono in local:telefono()[$pos] for $fax  in local:fax()[$pos] for $email  in local:email()[$pos] for $nazionalita  in local:nazionalita()[$pos] for $datanascita  in local:dataNascita()[$pos] let $init := sql:init("com.mysql.jdbc.Driver"),     $conn := sql:connect("jdbc:mysql://localhost:3306/DbName","user","password''),     $stmt := sql:prepare($conn, "INSERT INTO informazionipersonali(idInformazioniPersonali,nome,indirizzo,telefono,fax,email,nazionalità,dataNascita) VALUES(?,?,?,?,?,?,?,?) ")         let $params:=  <sql:parameters>         <sql:parameter type="int">{$indice}</sql:parameter>        <sql:parameter type="string">{$nome}</sql:parameter>       <sql:parameter type="string">{$indirizzo}</sql:parameter>       <sql:parameter type="string">{$telefono}</sql:parameter>        <sql:parameter type="string">{$fax}</sql:parameter>       <sql:parameter type="string">{$email}</sql:parameter>       <sql:parameter type="string">{$nazionalita}</sql:parameter>        <sql:parameter type="string">{$datanascita}</sql:parameter>      </sql:parameters>  return sql:execute-prepared($stmt,$params)   It works,but it returns only the first row in my database, and i want a row for each value (indice,nome,indirizzo,........) How can i do? --------- Original Message -------- Da: "Maximilian GÃ¤rber" <mgaerber(a)arcor.de> To: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> Oggetto: Re: [basex-talk] problem with prepared Data: 09/09/15 09:12 or using a where statement for $indice at $pos in local:indice() for $nome at $pos2 in local:nome() let $params:= <sql:parameters> <sql:parameter type="int">{$indice}</sql:parameter> <sql:parameter type="string">{$nome}</sql:parameter> </sql:parameters> where $pos2 = $pos return $params 2015-09-09 9:05 GMT+02:00 Maximilian Gärber <mgaerber(a)arcor.de>de>: > Hi, > > when you join (by nesting for statements) you will always get the > combinations unless you provide more constraints. > > You might try something like: > > declare function local:indice() as xs:integer* { > > for $i in (1 to 10) > return $i > }; > > declare function local:nome() as xs:string* { > > for $n in ('a', 'b', 'c', 'd') > return $n > }; > > for $indice at $pos in local:indice() > for $nome in local:nome()[$pos] > > let $params:= <sql:parameters> > <sql:parameter type="int">{$indice}</sql:parameter> > <sql:parameter type="string">{$nome}</sql:parameter> > </sql:parameters> > return $params > > > Regards, Max > > 2015-09-08 16:20 GMT+02:00 <michele.greco2(a)email.it>it>: >> Hi i have following xquery: >> declare function local:indice() as xs:integer* { >> count(for $document in collection("curriculum") >> let $c:= document-uri($document) >> for $a in doc($c) >> order by $c >> return >> for $e in doc($c)//w:tc[.//text()="Nome"] >> return $e/./following::text()except >> (for $x in doc($c)//w:tc[.//text()="Indirizzo"] >> return $x//following::text())) >> }; >> >> declare function local:nome() as xs:string* { >> for $document in collection("curriculum") >> let $c:= document-uri($document) >> for $a in doc($c) >> order by $c >> return >> for $e in doc($c)//w:tc[.//text()="Nome"] >> return $e/./following::text()except >> (for $x in doc($c)//w:tc[.//text()="Indirizzo"] >> return $x//following::text()) >> }; >> for $ indice in local:indice() >> let $init := sql:init("com.mysql.jdbc.Driver"), >> $conn := >> sql:connect("jdbc:mysql://localhost:3306/DBName","user","password''), >> $stmt := sql:prepare($conn, "INSERT INTO >> informazionipersonali(idInformazioniPersonali,nome,indirizzo,telefono,fax,email,nazionalità,dataNascita) >> VALUES(?,?,'null','null','null','null','null','null') ") >> for $nome in local:nome() >> let $params:= <sql:parameters> >> <sql:parameter type="int">{$indice}</sql:parameter> >> <sql:parameter type="string">{$nome}</sql:parameter> >> </sql:parameters> >> return sql:execute-prepared($stmt,$params) >> >> >> which return a combination of index and names, but i want only one row for >> each index and name. >> How can i do? >> >> ---- >> ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per >> tutti i dettagli clicca qui >> >> Sponsor: >> Registra i domini che desideri ed inizia a creare il tuo sito web >> Clicca qui -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Caselle con tuo dominio su piattaforma Zimbra, fino a 30 GB di spazio, sincronizzazione dati e backup Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13324&d=10-9

2 1

problem with prepared
by michele.greco2＠email.it 09 Sep '15

09 Sep '15

Hi i have following xquery: declare function local:indice() as xs:integer* { count(for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text())) };   declare function local:nome() as xs:string* { for $document in collection("curriculum") let $c:= document-uri($document) for $a in doc($c) order by $c return  for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text()) }; for $ indice in local:indice() let $init := sql:init("com.mysql.jdbc.Driver"),     $conn := sql:connect("jdbc:mysql://localhost:3306/DBName","user","password''),     $stmt := sql:prepare($conn, "INSERT INTO informazionipersonali(idInformazioniPersonali,nome,indirizzo,telefono,fax,email,nazionalità,dataNascita) VALUES(?,?,'null','null','null','null','null','null') ") for $nome in  local:nome()   let $params:=  <sql:parameters>        <sql:parameter type="int">{$indice}</sql:parameter>       <sql:parameter type="string">{$nome}</sql:parameter>      </sql:parameters>  return sql:execute-prepared($stmt,$params)     which return a combination of index and names, but i want only one row for each index and name. How can i do? -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Registra i domini che desideri ed inizia a creare il tuo sito web Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13323&d=8-9

2 2

error bxsq0003 in xquery
by michele.greco2＠email.it 09 Sep '15

09 Sep '15

Hi, i have tihsi error :[bxerr:BXSQ0003] Number of parameters differs from number of placeholders in this xquery: declare namespace w="http://schemas.openxmlformats.org/wordprocessingml/2006/main";   declare function local:nome() as xs:string* { for $document in collection("curriculum") let $c:= document-uri($document) order by $c return for $e in doc($c)//w:tc[.//text()="Nome"] return $e/./following::text() except ( for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text()) };   let $init := sql:init("com.mysql.jdbc.Driver"), $conn := sql:connect("jdbc:mysql://localhost:3306/DbName","user","password"), $stmt := sql:prepare($conn, "INSERT INTO person VALUES('',?,'','','','','')") for $nome in local:nome() return sql:ute-prepared($stmt, <sql:parameters> <sql:parameter type="string">{$nome}</sql:parameter> </sql:parameters>)   Why? -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a quelle certificate PEC. Confronta le soluzioni Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13326&d=7-9

2 1

Re: [basex-talk] sql error
by michele.greco2＠email.it 07 Sep '15

07 Sep '15

Hi thanks for help me. Now, i have the following error: [bxerr:BXSQ0003] Number of parameters differs from number of placeholders What can i do to solve it? --------- Original Message -------- Da: "Dimitar Popov" <dp(a)basex.org> To: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> Oggetto: Re: [basex-talk] sql error Data: 05/09/15 21:56 On Saturday, September 05, 2015 10:13:08 AM michele.greco2(a)email.it wrote: > Hi,   Hi!   > where am i wrong?   1. you have an XQuery syntax error; instead of: let $q:= "insert into person values("","||nome||","","","","","","")" it should be (note the different quotation marks): let $q:= "insert into person values(''," || $nome || ",'','','','','','')"   2. you have SQL injection [1] and performance issue by concatenating the value directly into the SQL statement; prepared statements [2] are in this case your friend:   declare namespace w="http://schemas.openxmlformats.org/wordprocessingml/2006/main";   declare function local:nome() as xs:string* { (: I've no idea whatcha doin here pal... :) for $document in collection("curriculum") let $c:= document-uri($document) order by $c return for $e in doc($c)//w:tc[.//text()="Nome"] return $e/./following::text() except ( for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text()) };   let $init := sql:init("com.mysql.jdbc.Driver"), $conn := sql:connect("jdbc:mysql://localhost:3306/DbName","user","password"), $stmt := sql:prepare($conn, "INSERT INTO person VALUES('',?,'','','','','')") for $nome in local:nome() return sql:execute-prepared($stmt, <sql:parameters> <sql:parameter type="string">{$nome}</sql:parameter> </sql:parameters>)   Check the BaseX docs [3] for more info and come back if you need more help :)   Cheers, Dimitar     [1] https://en.wikipedia.org/wiki/Sql_injection [2] https://en.wikipedia.org/wiki/Prepared_statement [3] http://docs.basex.org/wiki/SQL_Module -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a quelle certificate PEC. Confronta le soluzioni Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13325&d=7-9

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk