- BaseX-Talk - mailman.uni-konstanz.de

detection of external variables
by Andy Bunce 30 Mar '16

30 Mar '16

Hi, I am looking for a way to determine for a module what external variables are defined. Neither inspect:module [1] or inspect:xqdoc seem to return this information. I wonder if adding an *external *attribute to the inspect:module o/p for variables (and functions?) would be a solution. e.g. <variable name="samples:test-string" uri="http://basex.org/modules/samples" type="xs:string" *external="true"*> <description>This is a sample string.</description> </variable> /Andy [1] http://docs.basex.org/wiki/Inspection_Module#inspect:module

2 4

Out of memory getting document from Client API
by buddyonweb-software＠yahoo.com 29 Mar '16

29 Mar '16

Using the client API I am trying to retrieve a 600MB file from BaseX. Version I am using is BaseX 8.3. I have successfully stored this document using the client API without issue. As an aside, I have update the basexserver script to include 4GB of memory as Java command line option. Here is the snippet from that script:# Options for virtual machine (can be extended by global options) BASEX_JVM="-Xmx4g $BASEX_JVM" In my Java client side application I have memory set to 3 GB of memory (script snippet below):exec "$JAVACMD" -Xms1g -Xmx3g .....rest of args..... Here is a snippet of my Java code. Note that this works just fine when operation on smaller documents, but I wanted to stress test the code. String query = "doc('theCollectionName/extract.xml')";ByteArrayOutputStream baos = new ByteArrayOutputStream(); ClientSession session = new ClientSession(host, port, user, pwd);session.setOutputStream(baos);ClientQuery cq = session.query(query); cq.execute(); However, I keep getting out of memory with the below stack trace. I would think that the amount of space I am providing in both thebasexserver script (4GB) and my client side app (3GB) would be plenty to read in a 600MB file from BaseX. Is there something I am overlookingor something I am not doing correctly? Any insights/feedback is appreciated. Exception in thread "queue" java.lang.OutOfMemoryError: Java heap space at java.lang.StringCoding$StringDecoder.decode(StringCoding.java:149) at java.lang.StringCoding.decode(StringCoding.java:193) at java.lang.StringCoding.decode(StringCoding.java:254) at java.lang.String.<init>(String.java:534) at java.io.ByteArrayOutputStream.toString(ByteArrayOutputStream.java:221) at org.basex.api.client.ClientSession.exec(ClientSession.java:261) at org.basex.api.client.ClientQuery.execute(ClientQuery.java:102)

1 0

REST-Interface /Openshift/ Security
by Günter Dunz-Wolff 29 Mar '16

29 Mar '16

Hi all, I'm in the beginning of a BaseX basexhttp installation on OpenShift. I'm using Openshift quick start for BaseX from Andy Bunce. For my tests, I'm working with a simple factbook-db. Everything is working, but I can't figure out, how to protect the database to be deleted via the REST-Interface: With a simple curl -i -X DELETE "http://xxx-xxx.rhcloud.com/rest/factbook" the Database is dropped. In the database, there is only the user admin. In web.xml the REST-servlet is configured with <servlet> <servlet-name>REST</servlet-name> <servlet-class>org.basex.http.rest.RESTServlet</servlet-class> <init-param> <param-name>org.basex.user</param-name> <param-value>admin</param-value> </init-param> <init-param> <param-name>org.basex.password</param-name> <param-value>xxx</param-value> </init-param> </servlet> <servlet-mapping> <servlet-name>REST</servlet-name> <url-pattern>/rest/*</url-pattern> </servlet-mapping> What part of the security-management am I missing? Thanks a lot for any help. Best regards, Günter Dunz-Wolff

2 2

async module vs xq-promise
by Maximilian Gärber 28 Mar '16

28 Mar '16

Hi all, I just started to use the async module and I guess I am out of sync about the relation to xq-promise: Basex now has asyn:fork-join which exectues in parallel and comes back with all results xq-promise has p:fork-join which seems to be the previous implementation Could I swap one for the other? Side note: async:eval which works like xquery:eval is great, but I have to do something like this for functions: ``` let $ids := async:eval("declare variable $f external; declare variable $name external; $f($name)", map { 'f': '_:get-meta', 'name' : $name }) return $ids ``` With get-meta being a local function that accepts a single parameter. Is there an easier way to do this? Regards, Max

2 1

Re: [basex-talk] using Xerces2 with schema-validation
by Christian Grün 22 Mar '16

22 Mar '16

Hi Rob (cc to the list), You may be better off using the ZIP distribution. Usually, it’s mostly the basex.jar and basex-api.jar files that need to be updated. Hope this helps, Christian On Tue, Mar 22, 2016 at 3:04 PM, Rob Stapper <r.stapper(a)lijbrandt.nl> wrote: > HI Christian, > > Oops, not too clever. But to my defense, in my original code I use an xsd-file starting with the xml-processor for defining the version: > <?xml version="1.1" encoding="UTF-8"?> > > It turns out that my ignorance of java's classpath and BaseX's installation procedure are the cause of this trouble: > - Environment-variable classpath is ignored when java is started with the -cp option > - Manually copying the Xerces-file to the BaseX-library and changes to the basexgui.bat-file[1] are getting undone when installing a new BaseX-version. > > My solution for the moment is to keep an edited basexgui.bat-file in my document directory which I copy to BaseX-bin directory every time I install a new Basex-version. > > What is the best strategy for preserving for example classpath-extensions when installing a new version of BaseX? > Is it an idea preserving all non BaseX batch-file in BaseX/bin-directory, in my case: "myBasexgui.bat", when executing the BaseX-installation-procedure? > > [1] line added to basexgui.bat: "for %%a in (L:\xerces-2_11_0-xml-schema-1.1-beta\*.jar) do set CP=!CP!;%%a" > > Take care, > Rob > > PS, calling Xerces2's validation works now as does XML-schema's assert. Thanx. > > -----Oorspronkelijk bericht----- > Van: Christian Grün [mailto:christian.gruen@gmail.com] > Verzonden: maandag 21 maart 2016 18:11 > Aan: Rob Stapper > CC: BaseX > Onderwerp: Re: [basex-talk] using Xerces2 with schema-validation > > Hi Rob, > > it seems you forgot the version argument? > > Cheers, > Christian > > > On Mon, Mar 21, 2016 at 12:06 PM, Rob Stapper <r.stapper(a)lijbrandt.nl> wrote: >> Hi, >> >> >> >> I would like to use xerces2 for schema-validation. See attached file, >> but I can’t get it activated from within BaseX. >> >> I’ve read the chapter on validation [1] and followed the instructions : >> copying the 4 files to the library. >> >> I can see that these 4 file are part of the –cp option when calling java. >> >> But the use of assert-element while validating gives an error: >> >> >> >> Stopped at L:/Program Files/BaseX/demo-xsd-validation.xq, 1/14: >> >> [bxerr:BXVA0001] Validation failed: >> file:/C:/Users/Rob/AppData/Local/Temp/BaseX-375999151462208291.tmp, 6:33: >> s4s-elt-invalid-content.1: The content of '#AnonType_assert-demo' is >> invalid. Element 'assert' is invalid, misplaced, or occurs too often. >> >> >> >> [1] http://docs.basex.org/wiki/Validation_Module#XML_Schema_Validation >> >> >> >> What am I doing wrong? >> >> >> >> TIA for your response, >> >> Rob >> >> >> >> PS I’m using the latest or one of the latest snapshot and java 1.8 >> runtime on a windows-Vista machine >

2 1

Calling XLST Module from Java
by Taschner, Jan 22 Mar '16

22 Mar '16

Hello Guys, I´ve been messing around with BaseX for a few days and now I am kind of stuck. I have a XSL 2.0 Transformation sheet which works perfectly fine for a standalone application using Saxon HE. Now I tried to use the XSLT module of BaseX with Java. Here is my code: import java.io.IOException; import org.basex.core.Context; import org.basex.core.cmd.CreateDB; import org.basex.core.cmd.List; import org.basex.core.cmd.XQuery; public class App { public static void main(String[] args) { try { // initialize timer final long time = System.nanoTime(); // create session final BaseXClient session = new BaseXClient("localhost", 1984, "admin", "admin"); System.out.println(session.execute("info")); // create db context Context ctx = new Context(); // create db new CreateDB("stammdaten", "stammdaten2.xml").execute(ctx); // show all databases System.out.print(new List().execute(ctx)); // xls transformation System.setProperty("javax.xml.transform.TransformerFactory", "net.sf.saxon.TransformerFactoryImpl"); String query = "declare option output:method 'xml';" + " declare option db:chop 'no';" + " let $in := db:open('stammdaten')" + " let $style := doc('template.xsl')" + " return xslt:transform($in, $style)"; String result = new XQuery(query).execute(ctx); System.out.println("Result: " + result); ctx.close(); // close session session.close(); // print time needed final double ms = (System.nanoTime() - time) / 1000000d; System.out.println("\n\n" + ms + " ms"); } catch(final IOException ex) { // print exception ex.printStackTrace(); } } } I have started the basexhttp.bat in the bin directory and executed the above code. I get the following console output and stack trace: General Information: Version: 8.4.1 Used Memory: 20405 KB Global options: ASYNCTIMEOUT: 3600 AUTHMETHOD: Basic CACHERESTXQ: false DBPATH: C:/Program Files (x86)/BaseX/data DEBUG: false GLOBALLOCK: false HOST: localhost HTTPLOCAL: false IGNORECERT: false KEEPALIVE: 600 LANG: English LANGKEYS: false LOG: true LOGMSGMAXLEN: 1000 NONPROXYHOSTS: PARALLEL: 8 PASSWORD: PORT: 1984 PROXYHOST: PROXYPORT: 0 REPOPATH: C:/Program Files (x86)/BaseX/repo RESTPATH: RESTXQPATH: SERVERHOST: SERVERPORT: 1984 STOPPORT: 8985 TIMEOUT: 30 USER: WEBPATH: C:\Program Files (x86)\BaseX\webapp Local options ADDARCHIVES: true ADDCACHE: false ADDRAW: false ARCHIVENAME: false ATTRINCLUDE: ATTRINDEX: true AUTOFLUSH: true AUTOOPTIMIZE: false BINDINGS: CASESENS: false CATFILE: CHECKSTRINGS: true CHOP: true COMPPLAN: true CREATEFILTER: *.xml CREATEONLY: false CSVPARSER: DEFAULTDB: false DIACRITICS: false DOTCOMPACT: false DOTPLAN: false DTD: false EXPORTER: FORCECREATE: false FTINCLUDE: FTINDEX: false HTMLPARSER: INLINELIMIT: 100 INTPARSE: false JSONPARSER: LANGUAGE: en LSERROR: 0 MAINMEM: false MAXCATS: 100 MAXLEN: 96 MAXSTAT: 30 MIXUPDATES: false PARSER: xml QUERYINFO: false QUERYPATH: RUNQUERY: true RUNS: 1 SERIALIZE: true SERIALIZER: SKIPCORRUPT: false SPLITSIZE: 0 STEMMING: false STOPWORDS: STRIPNS: false TAILCALLS: 256 TEXTINCLUDE: TEXTINDEX: true TEXTPARSER: TOKENINCLUDE: TOKENINDEX: false UPDINDEX: false WRITEBACK: false XINCLUDE: true XMLPLAN: false Name Resources Size Input Path ----------------------------------------------------------------------------------------------------------------------------- stammdaten 1 812176 D:/Projekte/XYZ/workspaces/workspace_poc/BaseX/stammdaten2.xml 1 database(s). org.basex.core.BaseXException: Stopped at ., 1/154: [FODC0002] "" (Line 1): Vorzeitiges Dateiende. at org.basex.core.Command.execute(Command.java:101) at org.basex.core.Command.execute(Command.java:123) at net.atos.epi.XMLTransformationProofOfConceptBaseX.App.main(App.java:31) Caused by: org.basex.query.QueryException: "" (Line 1): Vorzeitiges Dateiende. at org.basex.query.QueryError.get(QueryError.java:1344) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:39) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:44) at org.basex.query.MainModule.iter(MainModule.java:110) at org.basex.query.QueryContext.iter(QueryContext.java:342) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:81) at org.basex.core.cmd.AQuery.query(AQuery.java:90) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) ... 2 more Caused by: java.io.IOException: "" (Line 1): Vorzeitiges Dateiende. at org.basex.build.xml.SAXWrapper.parse(SAXWrapper.java:83) at org.basex.build.SingleParser.parse(SingleParser.java:33) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.MemBuilder.dataClip(MemBuilder.java:77) at org.basex.build.MemBuilder.build(MemBuilder.java:66) at org.basex.build.MemBuilder.build(MemBuilder.java:61) at org.basex.build.MemBuilder.build(MemBuilder.java:50) at org.basex.build.MemBuilder.build(MemBuilder.java:40) at org.basex.query.value.node.DBNode.<init>(DBNode.java:85) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:37) ... 10 more Caused by: org.xml.sax.SAXParseException; systemId: file:///D:/Projekte/XYZ/workspaces/workspace_poc/BaseX/; lineNumber: 1; columnNumber: 1; Vorzeitiges Dateiende. at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.createSAXParseException(Unknown Source) at com.sun.org.apache.xerces.internal.util.ErrorHandlerWrapper.fatalError(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLErrorReporter.reportError(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLScanner.reportFatalError(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl$PrologDriver.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentScannerImpl.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLNSDocumentScannerImpl.next(Unknown Source) at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source) at com.sun.org.apache.xerces.internal.parsers.AbstractSAXParser.parse(Unknown Source) at com.sun.org.apache.xerces.internal.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at org.basex.build.xml.SAXWrapper.parse(SAXWrapper.java:78) ... 19 more (Vorzeitiges Dateiende = Premature end of file) When I run my standalone application with stammdaten2.xml and my template.xsl everything is fine, so I doubt that the stylesheet is the problem. The stylesheet is rather complex and consists of several subtemplates, which are included with <xsl: include href="xyz.xsl" />. Running the XQuery in the BaseX GUI does not work, since the GUI only provides support for XLST 1.0. Is there a way to change that? The stacktrace tells me that the system tries to open and parse an empty file, but I have no idea why and which file causes the problem. My assumption is the template.xsl causes the problem, since it said that it "Stopped at ." I copied the stylesheets in every folder that was reasonable for me, but I still got this error. Please tell me what I did wrong. Best regards, Jan Taschner

2 3

using Xerces2 with schema-validation
by Rob Stapper 21 Mar '16

21 Mar '16

Hi, I would like to use xerces2 for schema-validation. See attached file, but I can't get it activated from within BaseX. I've read the chapter on validation [1] and followed the instructions : copying the 4 files to the library. I can see that these 4 file are part of the -cp option when calling java. But the use of assert-element while validating gives an error: Stopped at L:/Program Files/BaseX/demo-xsd-validation.xq, 1/14: [bxerr:BXVA0001] Validation failed: file:/C:/Users/Rob/AppData/Local/Temp/BaseX-375999151462208291.tmp, 6:33: s4s-elt-invalid-content.1: The content of '#AnonType_assert-demo' is invalid. Element 'assert' is invalid, misplaced, or occurs too often. [1] http://docs.basex.org/wiki/Validation_Module#XML_Schema_Validation What am I doing wrong? TIA for your response, Rob PS I'm using the latest or one of the latest snapshot and java 1.8 runtime on a windows-Vista machine

2 1

fn:normalize-space question, BaseX v8.4.1
by Bridger Dyson-Smith 21 Mar '16

21 Mar '16

Hi all, I'm running into what looks some odd behavior with fn:normalize-space -- or a gross user/operator error :) -- and was hoping to get some clarification. I've attached a Very Simple Sample Query, as well as an example input document. Note: I'm using BaseX as a query processor, not as a db, but maybe this has to do with a whitespace setting (thanks to the xml IRC channel for the help with this). When I run the attached xq with Saxon (9.1.0.8J), I get the following expected result: fn:normalize-space: Letter, William H. Dennis in Knoxville, TN, to his brother David, 1863 December 12 When I run the attached xq with BaseX (v8.4.1, gui), I get the following unexpected result: fn:normalize-space: Letter,William H. DennisinKnoxville, TN, to his brother David,1863 December 12 Could someone give me an idea about what is happening with this? I'm not sure why the whitespace is chopped like this. Thanks in advance for your time and trouble. Best, Bridger

2 1

Parsing XML within string constructors
by Tim Thompson 21 Mar '16

21 Mar '16

Hello, I have a string that I want to parse using fn:parse-xml-fragment (in BaseX 8.4.1). I noticed that there seemed to be a difference when wrapping the string in a string constructor versus plain quotes. Using the string constructor seems to require a second function call in order to parse the XML. The following three expressions illustrate the difference. Numbers 2 and 3 return parsed XML, whereas number 1 returns the original, unparsed string. Is this the expected behavior when using string constructors? 1. ``[Sed ut perspiciatis]`` => parse-xml-fragment() 2. ``[Sed ut perspiciatis]`` => parse-xml-fragment() => parse-xml-fragment() 3. 'Sed ut perspiciatis' => parse-xml-fragment() -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library

2 1

Catalog Resolution Under Windows
by Eliot Kimber 21 Mar '16

21 Mar '16

I'm trying to make BaseX work under Windows 7 and I don't seem to be able to get catalog resolution to work. (I'm doing a workshop in Japan and the classroom only has 32-bit Windows machines available--since Docker requires 64-bit Windows I'm having to scramble to make the same code work directly under Windows 7 32-bit--ugh.) I'm using BaseX 8.4.1 with Java 8 (the Java supplied with the 32-bit version of oXygenXML). In my .basex file I have these entries: CATFILE = C:/workspace/DITA-OT2.x/catalog-dita.xml" DTD = true SKIPCORRUPT = true CHOP = false Using the DBA Web app I can see that the CATFILE property is set to that value, DTD is checked, CHOP is unchecked, and SKIPCORRUPT is checked, so my settings are clearly being used. However, if I create a database and use the DBA app to load a document that uses a DTD mapped by the catalog (e.g., a DITA document), load fails with a "Can't resolve DTD" message. The document is valid according to oXygen (and it's the same catalog--this is the OT oXygen is using) and of course my OS X and Docker-based versions of the same setup work fine, so it looks like a Windows-specific issue. Is there any known issue with catalog resolution under Windows? Is there anything I can do to try to debug the problem? Thanks, Eliot ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com

2 3

Standalone RUN for .bxs file not working in version 8.4
by Amanda Galtman 21 Mar '16

21 Mar '16

Hi, I'm unable to use RUN in standalone mode in BaseX 8.4, including the latest downloadable snapshot dated yesterday. The same thing in BaseX 8.3 works fine. java -cp BaseX842-20160310.184258.jar org.basex.BaseX C:/Users/username/.basex: writing new configuration file. BaseX 8.4.2 beta 9b9f74a [Standalone] Try 'help' to get more information. > RUN blah.bxs Stopped at ., 1/20: [XPST0003] Incomplete expression. The reference to "1/20" comes up no matter which .bxs file I try to run, even if line 1 is a comment. Did I miss a deliberate change in configuration or syntax? Thanks, Amanda

2 4

Re: [basex-talk] BaseX-Talk Digest, Vol 75, Issue 28
by Christophe Marchand 17 Mar '16

17 Mar '16

So, let's try it ! Le 17/03/2016 14:30, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Hello Christophe, > > that should be absolutely fine. > > Cheers >

1 0

Sharing a read-only database between multiple BaseX instances
by Christophe Marchand 17 Mar '16

17 Mar '16

Hello, I have a collection which is read-only. This collection is used as source for multiple XQuery update operations, operations which do not modify this read-only collection. For performance questions, I want to parallelize my XQuery operations. So I want to have multiple BaseX instances - say 8 - sharing exactly the same read-only collection, each instance performing a XQuery update on a small amount of data As this collection is read-only, may I physically copy files (after import) from an instance to another, if instances are on different hosts, and may I symlink collection files from an instance to another if instances are on the same hosts ? When I import data in the "read-only" collection to initialize it, only one instance is started... Best, Christophe -- Christophe MARCHAND Consultant Formateur cmarchand(a)oxiane.com <mailto:cmarchand@oxiane.com> LD : (+33)1 84 19 19 76 GSM : +33 (0)6 23 41 09 17 oxiane 98, avenue du Général Leclerc 92100 Boulogne-Billancourt Standard : (+33)1 55 60 76 72 Fax : (+33)1 55 60 76 73 www.oxiane.com <http://www.oxiane.com> Notre catalogue formations 2016 Notre catalogue formations 2015 <http://www.oxiane.com/wp-content/uploads/2015/11/OXiane_Catalogue_2016.pdf>

2 1

Repository. Verwendung von Modulen.
by Oleg Duvanayev 15 Mar '16

15 Mar '16

2 1

Re: [basex-talk] Catalog Resolution Under Windows
by Eliot Kimber 13 Mar '16

13 Mar '16

I tried some more experiments. I used the BaseX GUI as follows: 1. Created a new database and used the GUI to select the catalog file directly. 2. Used the add function from the New Database dialog to load a directory, selecting all the .xml, .dita, and .ditamap files. All the DITA files were skipped. I did the same test using 8.4.1 under OS X but against the same source files and catalog and it worked fine. So this seems to be a general issue with catalog resolution under Windows. Cheers, E. ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com On 3/12/16, 6:11 PM, "Eliot Kimber" <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: >I'm trying to make BaseX work under Windows 7 and I don't seem to be able >to get catalog resolution to work. (I'm doing a workshop in Japan and the >classroom only has 32-bit Windows machines available--since Docker >requires 64-bit Windows I'm having to scramble to make the same code work >directly under Windows 7 32-bit--ugh.) > >I'm using BaseX 8.4.1 with Java 8 (the Java supplied with the 32-bit >version of oXygenXML). > >In my .basex file I have these entries: > >CATFILE = C:/workspace/DITA-OT2.x/catalog-dita.xml" >DTD = true >SKIPCORRUPT = true >CHOP = false > > >Using the DBA Web app I can see that the CATFILE property is set to that >value, DTD is checked, CHOP is unchecked, and SKIPCORRUPT is checked, so >my settings are clearly being used. > >However, if I create a database and use the DBA app to load a document >that uses a DTD mapped by the catalog (e.g., a DITA document), load fails >with a "Can't resolve DTD" message. > >The document is valid according to oXygen (and it's the same catalog--this >is the OT oXygen is using) and of course my OS X and Docker-based versions >of the same setup work fine, so it looks like a Windows-specific issue. > >Is there any known issue with catalog resolution under Windows? Is there >anything I can do to try to debug the problem? > >Thanks, > >Eliot > >---- >Eliot Kimber, Owner >Contrext, LLC >http://contrext.com > > > >

3 6

How to check an element's type against an XSD simple type
by Ulrike Schaper - SideStep Business Solutions GmbH 12 Mar '16

12 Mar '16

Hi everybody, I'm trying to compose XML documents for SEPA transactions via BaseX. I would like to check certain data against the corresponding schema before putting them into the document, e.g. BIC identifiers. In the xsd, there's a simpleType definition for BICs: <xs:simpleType name="BICIdentifier"> <xs:restriction base="xs:string"> <xs:pattern value="[A-Z]{6,6}[A-Z2-9][A-NP-Z0-9]([A-Z0-9]{3,3}){0,1}"/> </xs:restriction> </xs:simpleType> I hoped it would be as simple as declare default element namespace "urn:iso:std:iso:20022:tech:xsd:pain.001.003.03"; let $node := <BIC>GEN0DEM1MPW</BIC> return if(string($node) instance of BICIdentifier) then (true() (: process... :)) else (false() (: report error :)) But, as I learned now, BaseX doesn't support import of schemas. Thus, I receive the error message "Unknown type: Q{urn:iso:std:iso:20022:tech:xsd:pain.001.003.03 }BICIdentifier". Is there some workaround (other than rebuilding regular expressions from schema to xquery)? Best regards, Ulrike.

2 4

Using SaxonEE 9.7 XQuery Processor with BaseX
by Jörn Goeke 11 Mar '16

11 Mar '16

Hello together, I just recently startet using BaseX in one of my Projects and since I was developing on the GUI of BaseX I had no Problems with anything. Unfortunately, for reasons, I need to use the Saxon Processor to Query my BaseX DB. I tried different approaches, but, everything endet up with the following error message: XPST0017: Saxon does not allow external function to be declared The query I tried looks as followed: xquery version "3.0"; declare namespace vm = "http://www.viamedici.de"; import module namespace db = "http://basex.org/modules/db" at "test/db.xqm"; (: Retrieve documents from database :) db:open("hades")//template Since I could not get usable information from google I hope some of you guys can help me. Thanks a lot, Jörn Jörn Uli Goeke Projektleiter / Projektentwickler Viamedici Software GmbH Hertzstr. 14 D-76275 Ettlingen Germany Phone: +49(0)7243/9498-36 Fax: +49(0)7243/9498-99 e-mail: j.goeke(a)viamedici.de URL: www.viamedici.de<http://www.viamedici.de> HRB 362615, Amtsgericht Mannheim Geschaeftsfuehrer: Juergen Mueller

2 1

write permission and create permission
by C. M. Sperberg-McQueen 10 Mar '16

10 Mar '16

In a function intended to be called from the REST interface, I have code whose essential expression is db:add('my-db', doc('http://example.com/docs/foo.xml'), 'foo.xml') I was surprised at first that this requires CREATE permission rather than just WRITE permission, but eventually realized that the CREATE is needed not by the db:add() function but by the doc() function. It's not important for my current needs (I can run the query under a userid with CREATE permissions), but in the interests of knowledge I wonder: Is there a way to load a document from the Web that does not require CREATE permission? (And before anyone asks: yes, I could PUT the new document, if I could figure out how to do that from PHP, and if performing the necessary sanity checks were as easy in PHP as it is in XQuery. But neither of those is true at the moment; the first may change, but the second is not ever going to change: given the choice, I'd rather do any work possible in XQuery rather than PHP.) Thanks! Michael Sperberg-McQueen -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

Query plans - feature request
by Hans-Juergen Rennau 09 Mar '16

09 Mar '16

Dear BaseX team, the query plans produced by xquery:parse-uri represent the state reached after resolving all imports. In particular, if module A imports module B and B contains a function F called by A, then function F is contained in the plan of module A, although the definition of function F is contained by module B, not by module A. And I think there is not way of finding out that fact. I understand that the behaviour is exactly what is required for compiling and executing the plans, but for purposes of analysis it would be great if it were possible to determine whether module A CONTAINS OR IMPORTS the definition of function F. A boolean flag (e.g. "<StaticFunc imported='true' ...") would suffice! Then, given a pool of modules, one could determine where to find what. As a hilarious fact, this feature (those boolean flags) would be very helpful in order to repair applications run with (or also with) the Saxon processor and "broken" by recent changes of Saxon: formerly, Saxon was tolerant about calling functions contained by *indirectly* imported modules (e.g. module A imports B, B imports C, A was allowed to call functions in C). This is now changed (A must import C explicitly), and repair of large-scale application would be greatly facilitated if the query plans could be evaluated as sketched. In fact, one could easily produce a report telling exactly which imports to add to which modules. So BaseX could lend a helping hand to Saxon users. Apart from that, of course, the feature would generally be great for supporting applications of code analysis. Cheers,Hans-Jürgen

2 2

Database corruption on Optimize All
by France Baril 09 Mar '16

09 Mar '16

Hi, I'm on 8.2.2, but I just tried it with BaseX 8.4 and got the same result. Here is a simple way to reproduce the error: 1. From BaseX GUI, I create a new database from a folder that contains mostly .xml, .xsd and .dtd files (attached). I use the default options from the GUI except: GENERAL - Input format XML: *.xml, *.xsd - Check 'Add other files as raw' - Uncheck 'Parse files in archives' PARSING - Check 'Use internal XML parser' - Uncheck 'Chop whitespaces' 2. Once the content is loaded, go to the 'Database properties' window for the DB and you'll see that all files are there and that you are able to browse the collections. 3. Click 'Optimize All' and try to browse the collections again. It doesn't work and a 'Stream Closed' error is generated in the terminal windows (details attached)! France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 4

$node//text()[1], why doesn't it return the 1st text node?
by France Baril 08 Mar '16

08 Mar '16

Hi, I was having issues manipulating text nodes. I found a way around my issue, but I'm still thinking that my 1st syntax to get the first text node of a sequence should have worked. My question is given all the example below, is #2 returning the expected value? I was expecting it would work like the syntax for elements in #3 and return the same result as #4 and #5 let $node := allo! Il pleut des clous. let $node2 := <ul><li>1</li><li>2</li></ul> let $text-node := $node//text() return <ul> <li>{$text-node}</li> <li>{$node//text()[1]}</li> <li>{$node2//li[1]}</li> <li>{($node//text())[1]}</li> <li>{$text-node[1]}</li> <li>{$node//text()[1][1]}</li> <li>{for $i in $node//text() return {$i}}</li> <li>{for $i in $text-node return {$i}}</li> </ul> <ul> <li>allo! Il pleut des clous.</li> <li>allo! Il pleut des clous.</li> <li> <li>1</li> </li> <li>allo!</li> <li>allo!</li> <li>allo! Il pleut des clous.</li> <li> allo! Il pleut des clous. </li> <li> allo! Il pleut des clous. </li> </ul> -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 5

Query plans without namespace bindings?
by Hans-Juergen Rennau 08 Mar '16

08 Mar '16

Dear BaseX team, the fabulous query plans delivered by xquery:parse and xquery-parse-uri reference functions with their lexical names, but do not contain the namespace bindings,e.g.: <StaticFuncCall name="i:writeNameFilter" tailCall="false"> <VarRef> <Var name="$deprecate" id="652"/> </VarRef> </StaticFuncCall> It seems to me that using this tool for the analysis of dependencies (e.g. "which modules require function f:foo?", "in which module do I find the definition of function f:bar?"), the namespace bindings would be required. And such analysis would certainly be very useful, especially when dealing with large applications and code bases. What do you think? Cheers,Hans-Jürgen

1 0

Run tests / standards compliance
by Maximilian Gärber 07 Mar '16

07 Mar '16

Hi all, do you have an overview about the tests you typically run for a release? I know there are unit tests but there is also a basex-tests repo which contains other types of tests. The readme says some tests are 'broken' so how to know which ones are good? Regards, Max

2 1

Re: [basex-talk] out of main memory
by michele.greco2＠email.it 04 Mar '16

04 Mar '16

Hi Christian, i solved and managed to increase the memory,changing basex.bat and not basexgui.bat. Thanks for your help. Regards, Michele --------- Original Message -------- Da: "Christian GrÃ¼n" <christian.gruen(a)gmail.com> To: Cc: "Hondros Constantine ELS-AMS" <C.Hondros(a)elsevier.com>om>, "BaseX" <basex-talk(a)mailman.uni-konstanz.de> Oggetto: Re: [basex-talk] out of main memory Data: 03/03/16 14:38 > I Christian, i tried and this is my error: > Error:Could not create the Java Virtual Machine Did you exactly proceed as described in my last mail? How does the modified line in your script look like? > > > --------- Original Message -------- > Da: "Christian GrÃ¼n" <christian.gruen(a)gmail.com> > To: > Cc: "Hondros Constantine ELS-AMS" <C.Hondros(a)elsevier.com>om>, "BaseX" > <basex-talk(a)mailman.uni-konstanz.de> > Oggetto: Re: [basex-talk] out of main memory > Data: 03/03/16 11:57 > >> I tried to do what i suggested Costantine with the value 1024m, but my >> memory is alwais 495m. > > Please try the following: > > 1. Download the ZIP version of BaseX > (http://files.basex.org/releases/latest/) > > 2. Unzip it, edit bin/basexgui.bat (provided that you are using Windows): > > OLD: > set BASEX_JVM=-Xmx512m %BASEX_JVM% > > NEW: > set BASEX_JVM=-Xmx4g %BASEX_JVM% > > 3. Start bin/basexgui.bat > > 4. Click on the lower right memory bar and compare it with the > attached screenshot. > > Does this help? > Christian > > > > On Thu, Mar 3, 2016 at 12:26 PM, <michele.greco2(a)email.it> wrote: >> >> --------- Original Message -------- >> Da: "Christian GrÃ¼n" <christian.gruen(a)gmail.com> >> To: >> Cc: "Hondros Constantine ELS-AMS" <C.Hondros(a)elsevier.com>om>, "BaseX" >> <basex-talk(a)mailman.uni-konstanz.de> >> Oggetto: Re: [basex-talk] out of main memory >> Data: 03/03/16 11:03 >> >> >> >>> queries work. The Query on the extraction of text from files. I 495m >>> available and would like increase it to at least 1024m. >> >> So which value did you assign via -Xmx? Do you start BaseX via >> basexgui.bat? >> >> >>> Michele >>> >>> --------- Original Message -------- >>> Da: "Christian GrÃ¼n" <christian.gruen(a)gmail.com> >>> To: >>> Cc: "Hondros Constantine ELS-AMS" <C.Hondros(a)elsevier.com>om>, "BaseX" >>> <basex-talk(a)mailman.uni-konstanz.de> >>> Oggetto: Re: [basex-talk] out of main memory >>> Data: 03/03/16 10:42 >>> >>> >>> >>> Hi Michele, >>> >>> How much memory do you have available on your system, and how much did >>> you assign? What kind of operations are triggering the out-of-memory >>> errors? >>> >>> Christian >>> >>> >>> >>> On Thu, Mar 3, 2016 at 9:34 AM, <michele.greco2(a)email.it> wrote: >>>> Hi Constantine, thanks for your answer. >>>> I'm trying to do what you suggested but all my tests so far have had no >>>> effect. >>>> Do you have any particular which have to be careful as you suggest? >>>> >>>> Regards, >>>> Michele >>>> >>>> --------- Original Message -------- >>>> Da: "Hondros Constantine ELS-AMS" <C.Hondros(a)elsevier.com> >>>> To: "basex-talk(a)mailman.uni-konstanz.de" >>>> <basex-talk(a)mailman.uni-konstanz.de> >>>> Oggetto: RE: [basex-talk] out of main memory >>>> Data: 01/03/16 10:07 >>>> >>>> Hi Michele, >>>> >>>> 1. Go to <BASEX_INSTALL>/bin >>>> 2. Open basexgui.bat (Windows) or basexgui (*nix) >>>> 3. Increase value of Xmx in BASEX_JVM variable, from 512 MB to >>>> something that your system can support >>>> 4. Restart the GUI >>>> >>>> For example, here is the line from my config I allocate almost 5 >>>> Gigabytes of memory >>>> >>>> set BASEX_JVM=-Xmx5000m %BASEX_JVM% >>>> >>>> Regards, >>>> Cosntantine >>>> >>>> >>>> From: basex-talk-bounces(a)mailman.uni-konstanz.de >>>> [mailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of >>>> michele.greco2(a)email.it >>>> Sent: 01 March 2016 10:48 >>>> To: basex-talk(a)mailman.uni-konstanz.de >>>> Subject: [basex-talk] out of main memory >>>> >>>> Hi, i get the error "out of main memory", when i run my query on a >>>> collection in basex gui. >>>> How can i fix? >>>> How can i increase my memory? >>>> Regards >>>> Michele >>>> >>>> ---- >>>> ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per >>>> tutti i dettagli clicca qui >>>> >>>> Sponsor: >>>> Idee regalo classiche o alternative? Trova l'offerta migliore in un >>>> click >>>> Clicca qui >>>> >>>> ________________________________ >>>> Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The >>>> Netherlands, Registration No. 33156677, Registered in The Netherlands. >>>> >>>> >>>> ---- >>>> ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per >>>> tutti i dettagli clicca qui >>>> >>>> Sponsor: >>>> Idee regalo classiche o alternative? Trova l'offerta migliore in un >>>> click >>>> Clicca qui >>> >>> >>> ---- >>> ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per >>> tutti i dettagli clicca qui >>> >>> Sponsor: >>> Caselle con tuo dominio su piattaforma Zimbra, fino a 30 GB di spazio, >>> sincronizzazione dati e backup >>> Clicca qui >> >> >> ---- >> ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per >> tutti i dettagli clicca qui >> >> Sponsor: >> Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a >> quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a >> quelle certificate PEC. Confronta le soluzioni >> Clicca qui > > > ---- > ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per > tutti i dettagli clicca qui > > Sponsor: > Idee regalo classiche o alternative? Trova l'offerta migliore in un click > Clicca qui -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a quelle certificate PEC. Confronta le soluzioni Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13326&d=4-3

1 0

Export database to SQL?
by Bhander, Gurbakhash S. 03 Mar '16

03 Mar '16

Hi, Is there any way to export data from the database to other databases? Thanks -Raj From: basex-talk-bounces(a)mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] On Behalf Of Klavs Prieditis Sent: Wednesday, March 02, 2016 11:21 AM To: Christian Grün <christian.gruen(a)gmail.com>; Dirk Kirsten <dk(a)basex.org> Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> Subject: Re: [basex-talk] Parallel execution Hi, Thanks Dirk and Christian! My apologies for using such a strong word to describe such a minor issue. It is not my intention to underestimate your work. My main concern is that `async:fork-join()` is too heavy. I mean, in essence, I am solving the same problem in these two examples. ```xquery for $i in 1 to 10 return fetch:text("http://example.com/magic-story/for-number/" || $i) ``` ```xquery async:fork-join( for $i in 1 to 10 return function() {fetch:text("http://example.com/magic-story/for-number/" || $i)} ) ``` If you solve the same problem in Java 8 using Streams API you get the following two solutions. ```java rangeFrom1To10AsList.stream().map(fetchText).collect(...); ``` ```java rangeFrom1To10AsList.parallelStream().map(fetchText).collect(...); ``` Considering these two Java 8 solutions, I guess what I actually want is the `async` keyword. So that the second Java example could be rewritten as follows. ```xquery for async $i in 1 to 10 return fetch:text("http://example.com/magic-story/for-number/" || $i) ``` Problem here is that you need to introduce a new keyword to the language. I am just trying to figure out if there could be a solution like this. ```xquery for $i in 1 to 10 return fetch:text-with-implicit-parallel-execution-characteristics("http://example.com/magic-story/for-number/" || $i) ``` Thanks for your input! Currently I lack in-depth knowledge on XQuery, I'll try to get a spare time to study the XQuery specification so that I am able reason about the various consequences. 2016-03-02 11:36 GMT+02:00 Christian Grün <christian.gruen(a)gmail.com<mailto:christian.gruen@gmail.com>>: Hi Klāvs, Dirk already gave some good reasons why implicit parallelization is not the default in BaseX, although it may seems to be the most natural and desirable choice. Indeed it’s fairly easy to create FLWOR expressions which are slower when executed in parallel. The XQuery specification, by the way, does not say anything about parallelization, so it’s completely up to the implementation to choose the most promising evaluation strategy. You asked if it was not possible to introduce sth. like a `can-be-optimized-for-parallel-execution` flag, and you may be interested to hear that we had some first thoughts on an 'async' keyword, which could be used in FLWOR expressions [1]. In the GitHub issue, only the most basic cases have been considered so far, but if we manage to push this further, we would have a syntax that will be more easily accessible to most users. Ideally, some time in future, we could then apply this pattern automatically if it will be absolutely clear that parallelization leads to faster results. Everyone: If you notice that the async:fork-join function makes your code faster, don’t hesitate and send us your queries. Hope this helps, Christian [1] https://github.com/james-jw/xq-promise/issues/15 On Wed, Mar 2, 2016 at 10:05 AM, Dirk Kirsten <dk(a)basex.org<mailto:dk@basex.org>> wrote: > Labrīt Klāvs, > > well, I would the word "broken" is a strong word for something, which > still works correctly and returns the correct result. It might not be > perform optimal, but broken is something different. Also, given that the > feature is still not even one day old, you might have to be a bit more > patient with us in applying optimization techniques. > > The problem here has several dimensions: > - XQuery returns results in order. So in order to not break BaseX we > would have to cache the results of the fetch and return it in the > correct order > - This caching might be much more complex, if it is a more complicated > expression > - It might not always be desirable to turn on parallelisation. In this > case you call an external HTTP server 10 times, in this case there might > be a speedup. But using fetch:text() could also point to a local URI and > to parallelize I/O is not always beneficial. > > So given the many different use cases here I don't think an implicit > parallelization will work here to the satisfaction of everyone. > Also, I invite you to read this closely related question about Haskell > on SO and the linked research: > https://stackoverflow.com/questions/15005670/why-is-there-no-implicit-paral… > > Cheers > Dirk > > On 03/02/2016 01:41 AM, Klāvs Priedītis wrote: >> Hello, BaseX team and community! >> >> Disclosure: I am not yet an expert on these issues and I have not >> fully studied the specs of XQuery. >> >> Now that Async Module is incorporated, I am wondering about some basic >> properties of xquery. >> >> Example: >> ```xquery >> for $i in 1 to 10 >> return fetch:text("http://example.com/magic-story/for-number/" || $i) >> ``` >> >> It feels to me that the xquery processor is broken if it cannot figure >> out on its own that the fetch can be done in parallel. >> Why does this not work out of the box? Can it work out of the box? >> Wouldn't it be able to do this in parallel if a flag >> `can-be-optimized-for-parallel-execution` was defined for the >> `fetch:text`? >> >> -- >> Veiksmi vēlot, >> Klāvs Priedītis > > -- > Dirk Kirsten, BaseX GmbH, http://basexgmbh.de > |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz > |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: > | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle > `-- Phone: 0049 7531 91 68 276, Fax: 0049 7531 20 05 22 > -- Veiksmi vēlot, Klāvs Priedītis

3 6

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk