- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Is there a C++ Implementation
by Maximilian Gärber 04 Apr '14

04 Apr '14

Hi, there is a .NET version called nxdb. I converted the jars using IKVM some time ago myself and it run just fine. Also, since it is BSD licensed, one could use Excelsior JET to generate native code. If you just want a processor (not a xmldb) you could try Zorba XQuery as well, that is C++ Regards, Max 2014-04-04 6:49 GMT+02:00 Alex Taylor <support(a)novixys.com>: > Hi > > This software BaseX is excellent. Really good at processing large files. > > I would like to know if there is a C++ implementation of the core engine, or > there are plans for developing a C++ implementation? > > Thanks in advance. > -- > Alex Taylor > Senior Developer > Novixys Software > http://www.novixys.com > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

1 0

Is there a C++ Implementation
by Alex Taylor 04 Apr '14

04 Apr '14

Hi This software BaseX is excellent. Really good at processing large files. I would like to know if there is a C++ implementation of the core engine, or there are plans for developing a C++ implementation? Thanks in advance. -- Alex Taylor Senior Developer Novixys Software http://www.novixys.com

2 1

Re: [basex-talk] server class trouble
by Dirk Kirsten 03 Apr '14

03 Apr '14

Hi Jason, I am glad you figured it out - Problems that solve themselve are my favorite ones :-) I just cc'ed the mail to the mailing list so everyone can benefit from the information. I still want to point out that the problem is not the opening of the database, but the way you do it. You did use the local way and the local database access and client/server way are not synchronized, so you run into this error. Instead the content of your openDB() function you could have initialized your session before and then executed: session.execute("Open adsss") This way, the transaction monitor would be taking care of the synchronization. Cheers, Dirk On 03/04/14 18:52, Jason Ricles wrote: > I actually figured it out, when I opened up the database in the open db > method, I made a lock be put on the database. > > > On Thu, Apr 3, 2014 at 12:03 PM, Jason Ricles < > jason.ricles(a)mikrossystems.com> wrote: > >> Here is the rest of the code minus the import statements. I added some >> comments as well to help you. Also how can I invoke this parallel through >> the java program or do I send a command to the server telling it how many >> parallel to run with the keyword parallel? >> public class Basex{ >> //where i invoke the context class >> static Context context = new Context(); >> static ClientSession session=null; >> static BaseXServer server = null; >> public static void main(String[] args) throws IOException, >> InterruptedException { >> System.out.println("Sample of BaseX used with server client:"); >> Context context = new Context(); >> if(context.databases.listDBs().isEmpty() == true) >> { >> buildDB(); >> } >> else >> openDB(); >> //where i make the server and the session >> BaseXServer server = new BaseXServer(); >> session = new ClientSession(context, "admin", "admin"); >> queryDB(server); >> System.out.print("program exit and clean up\n"); >> programExit(server); >> } >> >> //builds the database if one does not exist >> public static void buildDB() throws BaseXException >> { >> System.out.println("Creating a database and populating"); >> new CreateDB("adsss").execute(context); >> new Add("adsss","/home/jricles/Desktop/adss.xml").execute(context); >> new Optimize().execute(context); >> } >> >> >> >> public static void programExit(BaseXServer server) throws IOException >> { >> context.closeDB(); >> context.close(); >> server.stop(); >> session.close(); >> } >> >> //opens the database so that it may be queried >> public static void openDB() throws IOException >> { >> String db = new Open("adsss").execute(context); >> } >> >> //queries the database on the server >> public static void queryDB(BaseXServer server) throws IOException, >> InterruptedException >> { >> try >> { >> session.setOutputStream(System.out); >> session.execute("XQUERY doc('/home/jricles/Desktop/adsss.xml')"); >> session.query("doc('adsss')/*").execute(); >> System.out.println(); >> } >> catch(IOException e) >> { >> System.out.println("clean exit"); >> System.out.println(e); >> server.stop(); >> System.exit(0); >> } >> } >> } >> >> On Thu, Apr 3, 2014 at 11:48 AM, Dirk Kirsten <dk(a)basex.org> wrote: >> >>> Hello Jason, >>> >>> this class exist, but it is a testing class, so it is not included in >>> the jar file. See here for the source code of the class: >>> >>> https://github.com/BaseXdb/basex/blob/master/basex-core/src/test/java/org/b… >>> >>> I guess the OverlappingFileLockException should not occur. Do you do >>> anything besides that code snippet, like executing other quires as well >>> in parallel. Are you properly using the same context for this? >>> A small SSCCE might help to reproduce this. >>> Maybe you can also set PARALLEL (see >>> https://docs.basex.org/wiki/Options#PARALLEL) to 1. >>> >>> Cheers, >>> Dirk >>> >>> On 03/04/14 16:24, Jason Ricles wrote: >>>> To whom it may concern, >>>> >>>> I am trying to see what stuff I can do with the server class and keep >>>> running into a org.basex.core.BaseXException: >>>> java.nio.channels.OverlappingFileLockException error. With the following >>>> code >>>> >>>> session.setOutputStream(System.out); >>>> session.execute("XQUERY doc('/home/jricles/Desktop/adsss.xml')"); >>>> session.query("doc('adsss')/*").execute(); >>>> System.out.println(); >>>> >>>> To figure out the problem and correct it through trial and error to >>> learn >>>> how to use BaseX in java better, I am trying to use the following class >>>> from the import server.* statement I imported at the beginning of the >>> code >>>> http://docs.basex.org/javadoc/org/basex/server/LockingTest.html. >>> However it >>>> gives me an error that this class does not exist in the Server import. >>> I am >>>> curious if this javadoc is out of date, or if it is incorrect in >>> something >>>> that I might be doing in my code. >>>> >>>> Thanks, >>>> >>>> Jason Ricles >>>> >>>> >>>> >>>> _______________________________________________ >>>> BaseX-Talk mailing list >>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>>> >>> >>> -- >>> Dirk Kirsten, BaseX GmbH, http://basex.org >>> |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz >>> |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: >>> | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle >>> `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 >>> >> >> > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

logging in basex-api (restxq)
by Maximilian Gärber 03 Apr '14

03 Apr '14

Hi, I'd like to use log4j with basex-api but cannot figure out how to make this work. Currently, everything goes to the console. The basex-api POM defines a dependency on slf4j-nop which as far as I undertand logs to dev/null Do I need to change the basex-api POM file to replace it with the slf4j log4j adapter? And: what setting do I need to change the target output of the trace() function? My web app POM contains these settings: .... <dependency> <groupId>log4j</groupId> <artifactId>log4j</artifactId> <version>1.2.17</version> </dependency> <dependency> <groupId>org.eclipse.jetty</groupId> <artifactId>jetty-server</artifactId> <version>${jettyVersion}</version> </dependency> <dependency> <groupId>org.basex</groupId> <artifactId>basex-api</artifactId> <version>${BaseXVersion}</version> ... Regards, Max

3 2

Performance of matches() vs castable as xs:integer
by Hondros, Constantine (ELS-AMS) 03 Apr '14

03 Apr '14

Hello all, I'm scanning millions of XML records imported from CSV looking for instances of 'bib_rec_id' which are non-numeric. Which of these two is if-statements likely to complete earlier? for $a in (/csv/record/bib_rec_id) return if ($a castable as xs:integer) then ... blah or if (matches($a, '^[0-9]+$')) then ... blah Yes - I'm trying it out now, but I suspect it will be quicker to ask than wait for either query to complete. TIA. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 1

server class trouble
by Jason Ricles 03 Apr '14

03 Apr '14

To whom it may concern, I am trying to see what stuff I can do with the server class and keep running into a org.basex.core.BaseXException: java.nio.channels.OverlappingFileLockException error. With the following code session.setOutputStream(System.out); session.execute("XQUERY doc('/home/jricles/Desktop/adsss.xml')"); session.query("doc('adsss')/*").execute(); System.out.println(); To figure out the problem and correct it through trial and error to learn how to use BaseX in java better, I am trying to use the following class from the import server.* statement I imported at the beginning of the code http://docs.basex.org/javadoc/org/basex/server/LockingTest.html. However it gives me an error that this class does not exist in the Server import. I am curious if this javadoc is out of date, or if it is incorrect in something that I might be doing in my code. Thanks, Jason Ricles

1 0

Multiple db:replace() = slower updates with 7.8
by France Baril 02 Apr '14

02 Apr '14

Hi, We run batch processes on our files in order to send them out to translation in xliff format (xml format for translations). I run a piece of code that: 1. applies transformations 2. file:writes the resulting files (for debug purposes) 3. and then db:replaces the resulting files. If I send 5 files into the process, it takes a few seconds before the files appear on the file system. Yet full process with the db:replace takes 2 minutes to complete. When I send 60 files... the process never ends. All files are available on the file system and are valid, which means I am fairly certain that the freeze doesn't occur because of an error in one of the files. There is no error message in the terminal window. Is possible that something was changed after 7.7 that would affect performance? On our production server, which is on 7.7 we can run 100+ files in just a few minutes. Maybe there are new server settings that we missed? For reference, here is the code. I understand that updates are all performed at the end of the process, which is why we get the debug files first, but the lag time between the time where we get all files on the file system and the db:replace seems huge. *declare* *updating* *function* *translation:transform-to-xliff*(*$menu-id* *as **xs:string*, *$lang* *as **xs:string**, *$package-number* *as **xs:string* ){ *let **$menu* := *menu:xml-get-menu*(*$menu-id*, 'en-us') (: Need to translate menu and its topics without getting duplicated topics twice:) (: Always send the reusable strings from writers and from dev... doesn't cost anything if no new string anyway :) *let* *$file-ids* := (*$menu-id*, *for **$id* *in **distinct-values*( *$menu*/descendant::*[*name*()='topicref']/*data*(*@id-ref*))[1] *return * *$id*, 'stringreferences', 'stringreferencestransform') *return *(*for **$file-id* *in **distinct-values*(*$file-ids*) *let* *$file* := *db:open*('en-us')/*[*@id*=*$file-id*] *let* *$skl-href* := 'skeletons/' || *$package-number* || '/'|| *substring-after*(*$file*/*base-uri*(), 'en-us/') *let* *$file-with-preserve* := *copy* *$copy* := *$file* *modify*(*if* (*exists*(*$copy*/*@xml:space*)) *then *() *else **insert* *node* *attribute* {'xml:space' }{'preserve'} *into* *$copy*) *return **$copy* *let* *$all-trans-files* := *xliff-transformer:create-translation-files*(*$file-with-preserve*, *$package-number*, *$menu-id*, *$lang*, *$skl-href*) *let* *$skeleton* := *$all-trans-files*[1] *let* *$xliffs* := *for **$xliff* *in **$all-trans-files*[ *position*() != 1] *return **$xliff* *let* *$debug* := *file:write*('Debug-xliff/skls/' || *tokenize*(*$skl-href*, '/')[*last*()], *$skeleton*) *return *(*db:replace*('Translation-management', *$skl-href*, *$skeleton*), *for **$xliff* *in **$xliffs* *let* *$target-lang* := *$xliff*/descendant::*[*name* ()='file']/*data*(*@target-language*) *let* *$lang-pack-name* := *concat*(*$target-lang*,'_', *$package-number*) *let* *$file-loc-end* := *$menu-id* || '/' || *$lang-pack-name* ||'/' || *substring-after*(*$file*/*base-uri*(), 'en-us/') (:let $debug := file:append('debug-ids.xml', '
' || $file-loc-end):) *let* *$file-loc* := *if* (*exists*(*$xliff*/ descendant::*[*@translate*='yes'])) *then *'xliff-to-translate/' || *$file-loc-end* *else *'xliff-no-new-segment/' || *$file-loc-end* *let* *$debug* := *file:write*('Debug-xliff/' || *tokenize*(*$file-loc*, '/')[*last*()], *$xliff*) *return **db:replace*('Translation-management', *$file-loc*, *$xliff*) ) ) }; -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 6

Attribute cannot be serialized !!
by John Best 02 Apr '14

02 Apr '14

Dear Team, I have downloaded the latest source code of BaseX, by latest I mean just a half hour ago. When I run it through Eclipse, I am getting error - [SENR0001] Attributes cannot be serialized:db:open-pre("docdb",7). This comes when, I try to get ONLY attributes .... -- Have a nice day JBest

4 6

WEBDAV bug when changing admin password in 7.8.1
by Maud Ingarao 02 Apr '14

02 Apr '14

Hi :) We are experiencing a strange bug in 7.8.1 After installing and before changing the admin password is everything ok (client connexion, rest and restxq connexions, webdav connexion...) But as soon as we change the admin password (best practice ? :p), the webdav connexion becomes impossible, and so the restxq connexion with a 404, while the rest connexion remains ok, like the client one. WEBDAV example : With the admin/admin password : mingarao@l100318:~$ cadaver http://localhost:8984/webdav Authentication required for BaseX on server `localhost': Username: admin Password: dav:/webdav/> ls Listing collection `/webdav/': succeeded. Coll: input 0 avril 1 16:49 Coll: my 0 avril 1 16:50 Coll: test 0 avril 1 16:49 dav:/webdav/> After changing the admin password mingarao@l100318:~$ cadaver http://localhost:8984/webdav Could not open collection:*-> doesn't even ask for a login/password* Impossible de s'authentifier auprès du serveur: missing realm in Basic challenge dav:/webdav/? ls The `ls' command can only be used when connected to the server. Try running `open' first (see `help open' for more details). dav:/webdav/? open http://localhost:8984/webdav Could not open collection: Impossible de s'authentifier auprès du serveur: missing realm in Basic challenge dav:/webdav/? Thanks a lot :) Maud -- /« Ne travaillez jamais »/ *Maud Ingarao* IHPC (UMR 5037) Institut d'histoire de la pensée classique, de l'Humanisme aux Lumières Ecole Normale Supérieure de Lyon - Site Descartes - Bureau R322 15 Parvis René Descartes - BP7000 - 69342 Lyon CEDEX 07 +33 4 37 37 65 79 - maud.ingarao(a)ens-lyon.fr /Je suis absente le vendredi | Out of office on Fridays/ http://pensee-classique.ens-lyon.fr | http://institutdesanti.ens-lyon.fr http://ahn.ens-lyon.fr | http://forge.cbp.ens-lyon.fr/ http://www.mutec.huma-num.fr | http://www.projet-plume.org http://www.cahier.paris-sorbonne.fr/

4 6

bug or requirement
by Rob Stapper 30 Mar '14

30 Mar '14

Hi there, In order to maintain consistency in my solution-patterns I seem to end up with the need for cyclicly chained/imported modules: module "A" imports module "B" which imports module "A". Too bad that the "import module" command of Basex can't handle this type of structure. Now I can't access the functionality of "A" within module "B". What are the chances in solving this issue? Have a nice weekend, Rob Stapper --- Dit e-mailbericht bevat geen virussen en malware omdat avast! Antivirus-bescherming actief is. http://www.avast.com

2 1

Runnable jar not running properly..
by John Best 29 Mar '14

29 Mar '14

Dear Christian I have downloaded BaseX source code from BaseX Github. Then imported the source code into Eclipse IDE and configured Maven. When I run the project, it runs properly. Then I export the project to create a runnable jar th rough Eclipse. Jar file is created smoothly, but when I run the jar, GUI is not starting. NO ERROR messages.. !!! Can you put some light on this issue ? -- Have a nice day JBest

2 1

Is there any mechanism of version control of objects, kept in BaseX database?
by Moshe Zuisman 29 Mar '14

29 Mar '14

Hi. I am right now using BaseX to analyse My XML files that keep installations pseudo-code(XMLs of IzPack open source installer). Procedure is quite entangled. I keep my XML source in files.. I periodically recreate BaseX database from folder that contain all my XML files and use it to perform queries, that analyse my data. When I find something I need - I have to go back to file, and perform search there to find once more therexml element . already retrieved at BaseX query. I weight to move from files to BaseX database and keep all info there. But... Here is a catch: Files I can keep in version control system (IBM Rational Cynnergy system) Is there some way to keep versions track of data - kept in BaseX database? Some interface with standard Version control systems, or any other way?

2 1

Accessing DOCTYPE information after DB creation?
by Hondros, Constantine (ELS-AMS) 28 Mar '14

28 Mar '14

Hi all, I would really like to be able to query a large corpus of documents to get names and counts of the DTDs which are declared in the (somewhat old-fashioned now) DOCTYPE declaration: <?xml version="1.0" encoding="utf-8"?> <!DOCTYPE converted-article PUBLIC "-//ES//DTD journal article DTD version 4.5.2//EN//XML" "art452.dtd" [ ]> <converted-article>  Is there any way to get BaseX to preserve this information? Can I rewrite the doctype declaration into some sort of element node as the DB is being created so that this info can be queried? Thanks for any tips, Constantine. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

4 4

NullPointerException when executing geo:distance query
by Jesse Clark 27 Mar '14

27 Mar '14

Hi All, I am writing a feature that will rely on geo:distance to give me the distance between two points of latitude and longitude. I am a total n00b to GIS and GML so I may have messed this up, but based on a bit of research to figure out how to define the coordinate system and based on the example query from the BaseX docs I came up with the following query as a test: import module namespace geo = "http://expath.org/ns/geo"; declare namespace gml='http://www.opengis.net/gml'; let $vancouver := <gml:Point srsDimension="2" srsName="http://www.opengis.net/def/crs/EPSG/0/4326"> <gml:pos>49.40 -123.26</gml:pos> </gml:Point> let $seattle := <gml:Point srsDimension="2" srsName="http://www.opengis.net/def/crs/EPSG/0/4326"> <gml:pos>47.68 -122.37</gml:pos> </gml:Point> return geo:distance($vancouver, $seattle) I have this in a file and am trying to execute it from the CLI with: 'RUN [/path/to/file]' It pukes with this error: Stopped at [/path/to/file], 12/21: [GEO:GEO0002] java.lang.NullPointerException I am running off of the zip distribution of BaseX so I believe the geo module should be included. Any guidance would be greatly appreciated. Best, -Jesse

3 4

Re: [basex-talk] Class loading error
by Erol Akarsu 27 Mar '14

27 Mar '14

Sorry, throw this question, that is my fault. I have another question. Until now, I was able to read huge xml file (several Gbytes) through partition it and parse it with basex part by part. Do we have any new utility that can read 3-5G xml file and parse through basex? Thanks Erol Akarsu On Wed, Mar 26, 2014 at 10:16 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Sorry the mail sent incomplete. When I run, I am getting this exception. > Actually, I have added all libs to project and eclipse compiles project > successfully. but when I run, getting exception. I send in previous email > the eclipse project description. > > Exception in thread "main" java.lang.NoClassDefFoundError: BaseXException > Caused by: java.lang.ClassNotFoundException: BaseXException > at java.net.URLClassLoader$1.run(URLClassLoader.java:202) > at java.security.AccessController.doPrivileged(Native Method) > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) > at java.lang.ClassLoader.loadClass(ClassLoader.java:247) > > > On Wed, Mar 26, 2014 at 10:14 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > >> I am trying to run WikiExample coming as examples in eclipse. I moved >> all basex jars into lib folder of eclipse project that includes WikiExample >> basex application. But when I run >> >> >> >

2 3

Fwd: Re: whitespaces in import
by Dirk Kirsten 27 Mar '14

27 Mar '14

Sorry, mail was supposed to be send to the mailing list... Information is the same as in Leos mail -------- Original Message -------- Subject: Re: [basex-talk] whitespaces in import Date: Wed, 26 Mar 2014 17:59:12 +0100 From: Dirk Kirsten <dk(a)basex.org> To: Stefan Sechelmann <sechel(a)math.tu-berlin.de> Hello Stefan, On 26/03/14 17:51, Stefan Sechelmann wrote: Is there some kind of whitespace normalization > going on during import? Yes, it is. Can I set options that influence this behavior or is this a bug? Yes, you can. Set the CHOP option to false (see https://docs.basex.org/wiki/Options#CHOP for details) or start BaseX with the -w flag (which sets CHOP to false). Hope that helps. Cheers, Dirk -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

5 10

Oracle SQL set up for extracting XML Clobs
by Bednar, Scott E 26 Mar '14

26 Mar '14

Just sharing some information I've learned over the past week about using BaseX with Oracle using the SQL Module... in particular, to extract XML out of CLOB fields in Oracle you need to jump through a couple hoops: To get things set up, the following jars need to be on the classpath (I just put them into the BaseX lib directory which gets picked up if you start BaseX using one of the .bat scripts): - ojdbc6.jar - xdb6.jar - xmlparserv2.jar With this last jar, xmlparserv2.jar, there are a few things to watch for. First, you need a later version of the jar. Earlier versions are smaller (the jar for 11g is about 1350KB, the jar you have should probably be at least that big), and the filename isn't different for different versions. Be sure of what you have... you can find it in Oracle distributions here: {ORACLE_HOME}/oracle/produce/{VERSION_NUMBER}/lib/xmlparserv2.jar The jar can also be found under /lib in the Oracle client distributions. Next, you will need to reconfigure the out-of-the-box xmlparserv2.jar to use some standard java components rather than Oracle's: Change the entries in the files in the META-INF/services as follows: - for javax.xml.parsers.DocumentBuilderFactory replace oracle.xml.jaxp.JXDocumentBuilderFactory with com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl - for javax.xml.parsers.SAXParserFactory replace oracle.xml.jaxp.JXSAXParserFactory with com.sun.org.apache.xerces.internal.jaxp.SAXParserFactoryImpl - for javax.xml.transform.TransformerFactory replace oracle.xml.jaxp.JXSAXTransformerFactory with com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl The answer on this thread has complete instructions on reconfiguring the jar: http://stackoverflow.com/questions/11853967/errors-with-xmlparserv2-jar-and… Finally, you will need to add the following property setting to the startup script you are using (basex.bat, basexhttp.bat, basexgui.bat): -Doracle.jdbc.getObjectReturnsXMLType="false" This tells Oracle to return the java standard java.sql.SQLXML type that BaseX is expecting rather than the proprietary oracle.xdb.XMLType. See: http://docs.oracle.com/cd/E18283_01/java.112/e16548/jdbcvers.htm#BABGHBCC Here's how I added it to the script: set PROPS=-Doracle.jdbc.getObjectReturnsXMLType="false" java -cp "%CP%" "%PROPS%" %VM% org.basex.BaseX %* Once you have done all of that, you should be able to run an XQuery like this to get XML out of Oracle: sql:init("oracle.jdbc.OracleDriver"), let $conn := sql:connect("jdbc:oracle:thin:@myoracledb.org:1523:mydbsid", "username","password") return sql:execute($conn, "SELECT xmltype(MyXMLClob) from MyTable") If you get escaped XML in you results, you still need to reconfigure your xmlparserrv2.jar as shown above. As a side note: the above configuration is also necessary to make the basexhttp.bat script successfully start the server. If you use the un-configured xmlparserrv2.jar it will not start. Hope this helps! Cheers, Scott Bednar -----Original Message----- From: Bednar, Scott E Sent: Sunday, March 23, 2014 5:43 PM To: 'basex-talk(a)mailman.uni-konstanz.de' Subject: XML clob w/ SQL module I'm trying to extract XML stored in a CLOB from an oracle database using the sql module for BaseX. When I select the clob value, I get this sort of thing: <sql:column name="MSG">oracle.sql.CLOB@49458ef3</sql:column> I've tried casting it to XMLType (similar message) and to char (buffer size too small for the XML I'm dealing with). Is there a way of doing this short of creating a specialized Java module for it? Thanks, Scott

1 0

Re: [basex-talk] whitespaces in import
by Stefan Sechelmann 26 Mar '14

26 Mar '14

Thank you Dirk and also Leo for the quick response. I can work with that but I have to agree with Graydon that this was unexpected using the default settings. Best Stefan Stefan Sechelmann DFG-Forschungszentrum Matheon Mathematik für Schlüsseltechnologien Technische Universität Berlin Sekretariat MA 8-3 Tel. 030/314 29 486 Straße des 17. Juni 136 Fax 030/314 79 282 10623 Berlin sechel(a)math.tu-berlin.de http://www.math.tu-berlin.de/~sechel Am 26.03.2014 um 17:59 schrieb Dirk Kirsten <dk(a)basex.org>: > Hello Stefan, > > On 26/03/14 17:51, Stefan Sechelmann wrote: > Is there some kind of whitespace normalization >> going on during import? > > Yes, it is. > > Can I set options that influence this behavior or is this a bug? > > Yes, you can. Set the CHOP option to false (see > https://docs.basex.org/wiki/Options#CHOP for details) or start BaseX > with the -w flag (which sets CHOP to false). > > Hope that helps. > > Cheers, > Dirk > > -- > Dirk Kirsten, BaseX GmbH, http://basex.org > |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz > |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: > | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle > `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

whitespaces in import
by Stefan Sechelmann 26 Mar '14

26 Mar '14

Hi BaseX Team, this may be a bug: I have an xml file: <?xml version="1.0" encoding="UTF-8"?> <Test>foo <Inner/></Test> note the whitespace between the text foo and the node <Inner/>. Importing this into basex and running a query yields <Test>foo<Inner/></Test> without whitespace. Is there some kind of whitespace normalization going on during import? Can I set options that influence this behavior or is this a bug? Best regards Stefan Stefan Sechelmann DFG-Forschungszentrum Matheon Mathematik für Schlüsseltechnologien Technische Universität Berlin Sekretariat MA 8-3 Tel. 030/314 29 486 Straße des 17. Juni 136 Fax 030/314 79 282 10623 Berlin sechel(a)math.tu-berlin.de http://www.math.tu-berlin.de/~sechel

2 1

possible bug - using inline functions in unit tests
by Jan Techter 25 Mar '14

25 Mar '14

Dear basex team, running the following unit test involving a simple anonymous function declare %unit:test function local:test-inline-function() { let $f := function($x) {$x+1} return unit:assert-equals( $f(5), 6) }; raises a java exception [exec] Improper use? Potential bug? Your feedback is welcome: [exec] Contact: basex-talk(a)mailman.uni-konstanz.de [exec] Version: BaseX 7.8 [exec] Java: Oracle Corporation, 1.7.0_51 [exec] OS: Linux, i386 [exec] Stack Trace: [exec] java.lang.ClassCastException: org.basex.query.value.type.AtomType cannot be cast to org.basex.query.value.type.FuncType [exec] at org.basex.query.func.InlineFunc.item(InlineFunc.java:261) [exec] at org.basex.query.func.InlineFunc.value(InlineFunc.java:280) [exec] at org.basex.query.QueryContext.value(QueryContext.java:367) [exec] at org.basex.query.gflwor.Let$LetEval.next(Let.java:230) [exec] at org.basex.query.gflwor.GFLWOR$2.next(GFLWOR.java:73) [exec] at org.basex.query.iter.Iter.value(Iter.java:64) [exec] at org.basex.query.expr.ParseExpr.value(ParseExpr.java:71) [exec] at org.basex.query.QueryContext.value(QueryContext.java:367) [exec] at org.basex.query.func.StaticFunc.invValue(StaticFunc.java:203) [exec] at org.basex.query.func.FuncCall.invoke(FuncCall.java:96) [exec] at org.basex.query.func.FuncCall.value(FuncCall.java:138) [exec] at org.basex.query.func.StaticFunc.invokeValue(StaticFunc.java:215) [exec] at org.basex.query.util.unit.Unit.eval(Unit.java:210) [exec] at org.basex.query.util.unit.Unit.test(Unit.java:127) [exec] at org.basex.query.util.unit.Unit.test(Unit.java:51) [exec] at org.basex.query.func.FNUnit.test(FNUnit.java:100) [exec] at org.basex.query.func.FNUnit.item(FNUnit.java:40) [exec] at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) [exec] at org.basex.query.MainModule.iter(MainModule.java:96) [exec] at org.basex.query.QueryContext.iter(QueryContext.java:310) [exec] at org.basex.query.QueryProcessor.iter(QueryProcessor.java:81) [exec] at org.basex.core.cmd.AQuery.query(AQuery.java:89) [exec] at org.basex.core.cmd.XQuery.run(XQuery.java:22) [exec] at org.basex.core.Command.run(Command.java:329) [exec] at org.basex.core.Command.execute(Command.java:94) [exec] at org.basex.server.LocalSession.execute(LocalSession.java:121) [exec] at org.basex.server.Session.execute(Session.java:37) [exec] at org.basex.core.Main.execute(Main.java:146) [exec] at org.basex.BaseX.<init>(BaseX.java:119) [exec] at org.basex.BaseX.main(BaseX.java:38) [exec] updating to basex 7.8.1 didnt make any difference. Is this a bug? Best regards. Jan

4 9

XML clob w/ SQL module
by Bednar, Scott E 25 Mar '14

25 Mar '14

I'm trying to extract XML stored in a CLOB from an oracle database using the sql module for BaseX. When I select the clob value, I get this sort of thing: <sql:column name="MSG">oracle.sql.CLOB@49458ef3</sql:column> I've tried casting it to XMLType (similar message) and to char (buffer size too small for the XML I'm dealing with). Is there a way of doing this short of creating a specialized Java module for it? Thanks, Scott

2 3

Re: [basex-talk] multi-threaded XQueries
by Christian Grün 24 Mar '14

24 Mar '14

Hi Ying, > e.g. the dataset I use is DBLP, one of the example query is > > for $x in db:open('dblp_2013')/dblp/article[child::pages and child::title] > let $y := count($x/author) > return concat($y, "/t", db:node-id($x)) Yes, I agree there is not much that can be done to speed up this query. > It is true that these queries are competing for the same resource. > So you mean that each query causes a lot of disk I/O? Exactly. All DBLP articles need to be parsed by this query, and > 1 million result strings will be generated, resulting in a query time of appr. 0.005 ms per result. Hope this helps, Christian > However all these queries are read-only. It there any room to improve this? > -- > Regards > > Shanshan > > School of Computing > National University of Singapore

2 3

BaseX: Upcoming Features
by Christian Grün 24 Mar '14

24 Mar '14

Dear BaseX aficionados, An upcoming version of our software (7.9 or 8.0) will make it much easier to perform updates and return items at the same time [1]. It will also contain an xquery:update function and will bring xquery:eval and xquery:evaluate together again [2] Another exciting and sophisticated feature we are working on is query precompilation [3], which will particularly speed up large XQuery applications and allow for more request-specific optimizations. Next, we are working on a Database Administration interface based on RESTXQ, and we will also drop out the confusing client/server dialog from the GUI. Feature 1 and 2 are already available via a feature branch [4]. If you are working with the git sources, we are excited to get your feedback! Christian [1] https://github.com/BaseXdb/basex/issues/873 [2] https://github.com/BaseXdb/basex/issues/878 [3] https://github.com/BaseXdb/basex/issues/874 [4] https://github.com/BaseXdb/basex/tree/issue873

3 6

multi-threaded XQueries
by Ying Shanshan 23 Mar '14

23 Mar '14

Hi All, I created one database of 1GB in size, and have a batch of *read-only*queries to be performed. Each query is quite simple, so there is not much room to improve. All the queries are executed through *XQJ api.* If these queries are sequentially executed, it costs 5~8 seconds per query. To speed it up, I tried to executed it in a multi-thread way. But turns out to be much slower than the sequential one. This is what I wrote for each thread: public void run() { try { XQConnection conn = ds.getConnection(); XQSequence rs = conn.prepareExpression(input) .executeQuery(); //process the query result conn.close(); } } catch (Throwable e) { e.printStackTrace(); } } Anyone has the idea on how to improve the batch of queries. Thanks, -- Regards Shanshan School of Computing National University of Singapore

2 1

Confusing error using GROUP BY
by Charles Duffy 23 Mar '14

23 Mar '14

Howdy -- I've run into a somewhat confusing error message using GROUP BY in BaseX 7.8.1, while trying to answer a question on StackOverflow ( http://stackoverflow.com/questions/22585865/grouping-with-counts-in-xquery). Against the database at http://www.ibiblio.org/xml/examples/shakespeare/hamlet.xml, I'm running the following query: for $line in //SPEECH/LINE let $speaker := $line/../SPEAKER/text()[1] group by $speaker return <speaker name="{$speaker}" count="{count($line)}"/> ...and receiving the error: [XPTY0004] Single item expected, (db:open-pre("hamlet",748), db:open-pre("hamlet",750)) found. I've gone over the GROUP BY docs several times, and not seeing my error in the above. Could someone enlighten?

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk