- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Proxy port with basex
by Christian Grün 18 Sep '14

18 Sep '14

Hi Furqan (cc to the list), sorry for letting you wait. > how ever what i intend to do is that,after the query is issued from the web > application for the basex -db running on port 8984,i want to capture it > before it hits the database,in order to evaluate malacious queries..... What should happen in your opinion if a query is malicious? Would you like to prevent its execution, or would you rather want to be able to track that a malicious query has been evaluated at some stage? In the latter case, you could check out the log files [1], in which all commands and server requests will be listed. > So i was wondering if this would be possible using a reverse-proxy in front > of basex-db,such that all the traffic intended for the database would be > passed thrugh my proxy......say on port 80 > Or if there is any other way i could do it. > Basex comes with an option of proxy port and proxy host...will they work for > the scenerio that i described. > i mean if i set the proxy port of basex to be port 80 :where my appache or > nginx server would be running > ,will the queries from web application (xpath n xquery),pass through that > server running on port 80...... I guess that the BaseX proxy options won't help you there, because these mainly exist to handle firewall restrictions. Hope this helps, Christian [1] http://docs.basex.org/wiki/Logging > i tried out nginx without setting proxy port of basex ,but it gives n error > as nginx runs on port 80 and i want it to monitor traffic of port > 8994(basix),and at this port already basex server is running cuz of which my > nginx server cant listen to traffic (the error i got was a access > /permission error)n i guess it was cuz basex had permission rights over the > port.... > > i would greatly n highly appritiate any help and suggestions. > regards > > On Fri, Sep 12, 2014 at 8:50 AM, Christian Grün <christian.gruen(a)gmail.com> > wrote: >> >> Hi Furquan, >> >> do you use the classical REST interface to send your XQuery >> expressions to the server? In that case, you could either check out >> the logging facilities by the applied web server (possibly Jetty) or >> play around with another proxy like nginx [1]. >> >> You will be more flexible by using RESTXQ [2] and writing server-side >> XQuery code. The XQuery Module [3] or the Client Module [4] can be >> used to evaluate the received query. >> >> Hope this helps (and thanks for writing to the mailing list), >> Christian >> >> [1] http://nginx.org/ >> [2] http://docs.basex.org/wiki/RESTXQ >> [3] http://docs.basex.org/wiki/XQuery_Module >> [4] http://docs.basex.org/wiki/Client_Module > >

1 0

validate:xsd-info & xs:import
by Hans-Juergen Rennau 16 Sep '14

16 Sep '14

Dear BaseX team, I face a problem with the "validate" module. My impression when using "validate:xsd-info" is the following: (a) if the XSD is supplied as argument - xs:import is NOT resolved (b) if the XSD is inferred from xsi:schemaLocation - xs:import IS resolved It would be wonderful if imports/includes could be automatically resolved - the "validate" module could then be extremely useful! Best regards, Hans-Juegen PS: My experiment: ====================================================== let $docURI := '... a document URI ...' let $xsdURI := '... the corresponding schema URI ...' let $xsd := doc($xsdURI) let $tns := $xsd/xs:schema/@targetNamespace let $doc1 := doc($docURI) let $doc2 := document { element {node-name($doc1/*)} { attribute xsi:schemaLocation {concat($tns, ' ', $xsdURI)}, $doc1/*/(@*, node()) } } return <results>{ <result1>{validate:xsd-info($doc1, $xsd)}</result1>, <result2>{validate:xsd-info($doc2)}</result2> }</results> ====================================================== => <results> <result1>Fatal:src-resolve: Name "communication:ShoppingCartFetchRS" kann nicht als "type definition"-Komponente aufgelöst werden.</result1> <result2/> </results>

4 9

Multiple war instances
by Jérôme Chauveau 15 Sep '14

15 Sep '14

Hi, i would like to run 2 separate war instances in the same Tomcat server. Each instance must embbed its own data repository. I tried to use the HTTPLOCAL flag but i am not able to manage separatly the 2 instances with a basexclient command line tool. How can I manage an HTTPLOCAL instance from a basexclient? Another solution might be that each webapp instance runs its own basexserver on 2 differents port. How can I set the 1984 default port used by a basex webapp? Regards, Jérôme C. -- Jérôme Chauveau - SAIC-CERTIC - Campus 4 Université de Caen Basse-Normandie

4 7

declare copy-namepaces - "inherit" ignored!
by Hans-Juergen Rennau 13 Sep '14

13 Sep '14

Dear BaseX team, I have a problem with a subtle bug which has been introduced with version 7.8, it seems. In 7.7, the declare copy-namespaces ..., inherit; was implemented correctly - see below for example code and result. But from 7.8 on, copy namespaces mode "inherit" is ignored. I would greatly appreciate if you could restore the correct behaviour, as I have code running which must be compatible with XQuery 1.0 and which needs to "add" in-scope namespaces dynamically. (And in XQuery 1.0 I see no alternative to the pattern shown below.) Kind regards - Hans-Juergen Example code: ================================ declare copy-namespaces preserve, inherit; declare function local:addNamespace($elem, $prefix, $uri) { let $qname := QName($uri, concat($prefix, ':dummy')) return <A>{ attribute {$qname} {""}, $elem }</A>/* }; let $elem := <foo/> return local:addNamespace($elem, 'z', 'http:example.com') ================================ => BaseX 7.7: <foo xmlns:z="http:example.com"/> BaseX >= 7.8: <foo/>

2 4

db documents metadata
by Marc van Grootel 12 Sep '14

12 Sep '14

Hi, I was looking through the feature list in the issue tracker to see what's in the pipeline. I suddenly remembered a feature from an xml database I used a couple of years ago called Qizx. This had a very neat feature where every database document and collection could have a special map with metadata properties. These do not affect the XML content in any way but they can be accessed via special API calls or Qizx specific extension module. A better explanation of this feature can be read in the Qizx manual (for example here http://kiwi.emse.fr/DN/qizx-manual.pdf on page 18 and 57). I have used such metadata properties on nodes to implement syncing XML documents in a SCM (Subversion). I stored revision id's and other SCM control data in those properties. Authors would work in Subversion and certain directories where kept synced to a Qizx database so we could easily create PDF publications of the latest XML with zero impact on the XML itself. Maybe BaseX already uses something like that under the hood, I don't know. If so extending it or opening it for use would be useful I think, and generally cool :-) -- --Marc

4 22

Proxy port with basex
by Furqan Khan 12 Sep '14

12 Sep '14

i was wondering if u could suggest how to use the proxy port option that comes wit basiX. Or is there any way by which i can capture the xpath queries issued from a web application ,before the actually hit the BasiX database at back end (Sort of proxy between a web app and database server 'basix in this case'.). Any suggestions would be highly appreciated.....

2 1

Best way to understand Query result type
by Marco Lettere 12 Sep '14

12 Sep '14

Hello all, I'm in the situation where I'd have to execute an XQuery on a different Server from an external Java code (check the small example provided). What is the best way of transforming the resulting bytestream into BaseX' Value model (item()*, node()*, xs:string* whatever is returned by the query) in order to be able to treat the result as if it was generated inside the calling XQuery itself? Would the HTTPClient that ships with Basex be of any help? Or do I have to do everything manually? I hope the question is stated clearly enough anyway here is a short example (probably not working directly ;-)) that demonstrates the concept. declare namesapce ext = "my.externalClass.EC"; let $out := ext:eval("http://otherhost:8984/rest" "{1 to 10 ! <a/>}") return <total count={count($out)}> {$out} </total> EC has few methods most importantly: private String queryToXML(String query){ return "<query xmlns=\"http://basex.org/rest\">" + "<text><![CDATA[" + query + "]]></text>" + "</query>"; } public static void eval(String address, String query) { try { URL url = new URL(address); HttpURLConnection conn = (HttpURLConnection)url.openConnection(); conn.setRequestMethod("POST"); conn.setDoOutput(true); conn.getOutputStream().write(this.query.getBytes()); ByteArrayOutputStream baos = new ByteArrayOutputStream(); InputStream is = conn.getInputStream(); byte[] buf = new byte[1024]; int len = is.read(buf,0,buf.length); while(len != -1){ baos.write(buf, 0, len); len = is.read(buf,0,buf.length); } is.close(); byte[] = baos.toByteArray(); baos.close(); } catch (Exception e) { result = e; } } The Question translates to what should eval's return type be and how to generate it from ByteArrayOutputStream. Thank you. M.

2 1

BaseX CMS functionality
by Philipp Burger 11 Sep '14

11 Sep '14

Hello, I study print and media technology in the 6th semester with focus on digital publishing at the Stuttgart Media University. As a part of my Bachelor thesis following question popped up: Are there existing BaseX functions or third-party solutions for typical CMS functionalities like rights and role management, versioning, document check in and check out,… for XML files? Thanks for your help With best regards Philipp Burger Hallo, ich studiere Druck- und Medientechnologie im 6. Semester mit dem Schwerpunkt Digital Publishing an der Hochschule der Medien in Stuttgart. Im Rahmen meiner Bachelor-Arbeit ist folgende Frage aufgetaucht: Gibt es für BaseX bestehende Funktionen oder Lösungen von Drittanbietern um typische CMS Funktionalitäten wie Rechte-Rollenverwaltung/Versionierung/Dokument einchecken/auschecken im Mehrbenutzerbetrieb, Locking usw. für XML-Dateien zu realisieren? vielen Dank schon mal im Voraus gruß Philipp Burger

1 0

arrow operator, no big deal!
by Rob Stapper 11 Sep '14

11 Sep '14

Hi, I was playing with the arrow-operator and found that it doesn't work on anonymous functions, see example. ('A', 'B', 'C') => function( $sequence) { count( $sequence)} No idea why you should use a construction like this but I, kind of, expected it to work. Maybe something for a next release( together with the "apply-function";-). Regards, Rob Stapper --- Dit e-mailbericht bevat geen virussen en malware omdat avast! Antivirus-bescherming actief is. http://www.avast.com

3 3

fn:apply function for XQuery 3.1?
by Marc van Grootel 10 Sep '14

10 Sep '14

Latest change to the W3C issue tracker indicates that this is going to be in XQuery 3.1, yay! See https://www.w3.org/Bugs/Public/show_bug.cgi?id=26585 --Marc

1 0

basex 7.9 - red hat package?
by Olivier JEULIN 10 Sep '14

10 Sep '14

Hello, when do you plan to release a package for RedHat? The repository has only v7.8. FYI, 7.9 solves a bug that we just found in 7.8, so, good work! :-)

4 7

Error while acceessing embedded databases through client-server.
by Kunal Chauhan 05 Sep '14

05 Sep '14

Hello, I have created embedded database using java API. Now, while opening the databases using XQJ client-server architecture. Exception in thread "main" javax.xml.xquery.XQException: BXCE001 - Stopped at ., 1/245: [BXDB0002] The database format has changed; please use a newer version. at HelloWorld.main(HelloWorld.java:39) I started the BaseXServer and while running BaseXClient from command prompt, following is the output of "list" command. > list name Resources Size Input Path ------------------------------------- testDB 0 0 Error but I am able to open the same database through Java API. So, my question is can we use databases which are created in embedded mode and use it through client-server architecture ? Thanks, -- *Kunal Chauhan* mail4ck(a)gmail.com [+918655517141]

2 1

QUERYINFO through java API
by Kunal Chauhan 03 Sep '14

03 Sep '14

Hello, I am trying to print queryinfo through java code. I am using following query : declare namespace db ='http://basex.org/modules/db'; declare option db:queryinfo 'true'; for $i in 1 to 1 return db:open('testDB')/* I am using Java API's QueryProcessor to execute an above query. can anybody help to print queryinfo through java API ? Thanks, -- *Kunal Chauhan* mail4ck(a)gmail.com [+918655517141]

2 1

RestXQ and file paths
by Lars Johnsen 02 Sep '14

02 Sep '14

There seems to be a difference in file referecense when using %rest:path("/show/{$welcome}") %method("html") vs. %rest:path("/show") %rest:form-param("welcome", "{$welcome}") %method("html") In the first version it appears that references within to folder /static inside the BaseX web directory are not found (images stylesheets etc.), while it works nicely using parameter. This snippet may illustrate, the secon shows the logo, the other won't: module namespace page = 'http://basex.org/modules/web-page'; declare %rest:path("/show/{$welcome}") %output:method("html") function page:show($welcome) { <html><body><img src="static/logo.png"/><p>{$welcome}</p></body></html> }; declare %rest:path("/show") %rest:form-param("welcome", "{$welcome}") %output:method("html") function page:showparam($welcome) { <html><body><img src="static/logo.png"/><p>{$welcome}</p></body></html> };

2 2

BaseX v7.9 Tomcat Issues
by Bridger Dyson-Smith 02 Sep '14

02 Sep '14

Hi all, I'm exploring webapps and BaseX using Tomcat 7.0.53 and I'm running into an odd error, or set of errors, with v7.9. For example, visiting localhost:8080/BaseX79 the page isn't styled [1] and trying the test in Example 2 fails [2]. This isn't a huge deal, as I also have v7.8.2 which works fine. For my current level of tinkering it is more than sufficient. However, I was wondering if there was something I needed to change in v7.9. In both versions I simply downloaded the .war and dropped it into my $tomcat/webapps directory. Best, Bridger [1] [2]

2 2

A good way to backup/restore database to/from an external file
by Ioan Fericel 02 Sep '14

02 Sep '14

Hi all, I would ask you to give me an opinion on what would be the simplest solution, when pressing a button in a web page that triggers the function "db:create-backup" of BaseX, to have the possibility of saving the resulting file in a location chosen by the user, including the name generated from the concatenation of timestamp. Possibly with the option to not be saved in the default location. And also the reverse way: restore a database from a backup file (zip), showing the path to it, with the file upload. Thanks for any ideas, Ioan

2 1

Is there an XML based collaborative curation environment?
by Martin Mueller 29 Aug '14

29 Aug '14

I have sent this post simultaneously to the eXist, baseX, and TEI lists in the hope that I will get some useful advice on how to cobble together an XML-based collaborative curation platform. If there is something "out there" that meets some of my requirements I would love to hear about it. Phil Burns, Craig Berry, and I have been engaged in an informal project that I call Shakespeare His Contemporaries (SHC). The source texts for SHC are the TCP transcriptions, transformed into TEI P5 with Abbot and linguistically with MorphAdorner. To goal is to produce "good enough" texts (in original and standardized spellings) through collaborative curation, enlisting the help of educated amateurs as well as professional scholars. A group of Northwestern undergraduate on summer internships fixed about 70% of some 45,000 known errors in almost 500 Early Modern non-Shakespearean plays and demonstrated that you don't need to have a Ph.D. to make valuable contributions to scholarship. My curation framework has been a mixture of XML and SQL. MorphAdorner can spit out its data as a TEI file or in a tabular format.(http://morphadorner.northwestern.edu). The latter is easily turned into a MySQL database. AnnoLex, our curation tool (http://annolex.at.northwestern.edu), was built by Craig Berry. It is a Django web site that talks to an underlying MySQL database and lets registered users make emendations that are kept in a separate table for subsequent review and integration into the XML files. MorphAdorner includes scripts for updating XML files in the light of approved emendations. It also keeps track of changes made. This system works well in environments where curators operate in a controlled and work-like environment, cycling through textual phenomena selected by some criteria likely to return incomplete or incorrect text. It works well because most of the errors in the TCP transcriptions are of a very simple kind that lends itself to an 'atomic' word by word treatment.The combination of Django and a relational database makes it very easy to keep track of who did what where and when, and who approved or rejected an emendation. These are non-trivial virtues, and there are many TCP errors that can be fixed by this method before you run up against its limits. On the other hand, this method does not support what I call "curation en passant," readers reading "with a pencil" or its digital equivalent, stopping here or there to question a word or passages and offering a diagnosis or emendation as a marginal gloss. I would like to have an curation environment that looks like a page that supports reading of the common garden variety but through a click on a word shows a pop-up window that lists the properties of a token and offers a template for structured and free-form annotation. The current model also fails when it comes to making changes in the XML structure. In terms of the immediate needs of a project that focus on EEBO-TCP drama texts, the most common errors involve just the correction of a tag name: turning <stage> into <l> or the other way round. There are ways in which these errors could be corrected by extending AnnoLex, but it would be clumsy, and it would not support more substantial changes in the XML structure. So you want a curation environment that lets you manipulate the XML structure as well as the words inside elements. For instance, half the plays in the EEBO-TCP collections are not divided into acts and scenes because such a division is lacking in the printed source. Adding scene divisions (with an appropriate notation that they are supplied by an editor) is an important step towards making the texts more "machine actionable," and a proper digital corpus should be both human readable and machine actionable. The best curation environment would be XML based, but I wonder about scale. As I understand it, 'scale' in an XML application is a function of the number of documents, their size, and the complexity of encoding. The SHC corpus has about 500 documents and could grow to 1,000 if one interpreted "contemporaries" more generously or decided to include Shakespeare's Restoration heirs. Most plays fall in a range between 15,000 and 25,000 words. In a linguistically annotated corpus the typical leaf node is a <w> or <pc> element with a set of attributes, such as <w xml:id="A04632_0500750" lemma ="Cleopatra", ana="#npg1">Cleopatraes</w> The modal XPath of such a leaf node goes like TEI/text/body/div@act/div@scene/sp/l/w There are about 12 million Xpaths in the SHC corpus, and it is important for readers to be able to move quickly from one to the other within and across plays so as to support what I call "cascading curation," where the diagnosis of an error in one play leads to the question whether there are similar errors elsewhere. So much for scale, and I don't know whether it is a big problem, a small problem, or no longer a problem at all. If you want to extend a curation model from 500 plays to the eventually 70,000 texts in the EEBO TCP corpus there might be a scale problem. On the other hand, if you think of collaborative curation in a humanities environment and you think of scholarly data communities that organize themselves around some body of texts, it may be that something like 1,000 texts or 50 millon words words is a good enough upper limit: breaking down the big city of a large corpus into "corpus villages" (perhaps with some overlap) may be technically and socially preferable. I don't have a very clear idea how a permissions regime would work in an XML environment. It is clear to me that a change of any kind should take the form of an annotation and that the integration of such an annotation into the source text would be the work of an editor with special privileges. There needs to be a clear trail of the 'who, what, when, and where' of any textual change, and as much a possible of this detail should be logged automatically. The scholarly communities I'm familiar with are unlikely to accept texts as curated unless there are familiar seals of good housekeeping that they recognize as the equivalent of the assurances that come with a reputable printed text. I could go on in considerable detail about the needs of our project (and similar ones), but I hope I have outlined enough of the requirements in sufficient detail. Thanks in advance for any advice Martin Mueller Professor emeritus of English and Classics Northwestern University

2 1

Reg : Over Laping Exception
by Chandrasekhar 29 Aug '14

29 Aug '14

Dear Team We are getting the below exception wen xquery executing.Please do the needful org.basex.core.BaseXException: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.9 Java: Oracle Corporation, 1.7.0_07 OS: Windows 7, x86 Stack Trace: java.nio.channels.OverlappingFileLockException at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255) at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152) at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:1017) at org.basex.io.random.TableDiskAccess.lck(TableDiskAccess.java:188) at org.basex.io.random.TableDiskAccess.sharedLock(TableDiskAccess.java:175) at org.basex.io.random.TableDiskAccess.<init>(TableDiskAccess.java:88) at org.basex.data.DiskData.init(DiskData.java:122) at org.basex.data.DiskData.<init>(DiskData.java:92) at org.basex.core.cmd.Open.open(Open.java:68) at org.basex.query.QueryResources.open(QueryResources.java:263) The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.

2 5

query across multiple databases.
by Kunal Chauhan 28 Aug '14

28 Aug '14

Hello, I want to fire an XQuery across multiple databases. how to achieve this ? -- *Kunal Chauhan* mail4ck(a)gmail.com [+918655517141]

2 3

Looking for something that may not exist...
by France Baril 27 Aug '14

27 Aug '14

Hi, I'm working on improving our tracking capabilities. I was hoping to find a function that would do the equivalent of what the code bellow does, but for internal functions that are not called through the rest interface. *string-join*(*for **$name* *in **request:parameter-names*() *return **$name* || ': ' || *string-join*(*request:parameter*(*$name*), '; '), '
') In short, I was wondering if there is way I can read the function's parameters and their values without listing each one explicitly. I searched the documentation without success. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

4 13

Cannot add schema (xsd) files
by irisDeveloper 27 Aug '14

27 Aug '14

Hi all Command Add /tmp/schemaAndXml/ above command only adds .xml files not xsd files. Can you suggest to make it add xsd files also Thanks Samby

2 2

Error while adding
by irisDeveloper 27 Aug '14

27 Aug '14

Hi all, Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.8 Java: Sun Microsystems Inc., 1.6.0_30 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 48280236 - #used blocks: 188573 - #total locks: 188573 - access: 188572 (188573 > 188572] at org.basex.util.Util.notExpected(Unknown Source) at org.basex.io.random.TableDiskAccess.cursor(Unknown Source) at org.basex.io.random.TableDiskAccess.read5(Unknown Source) at org.basex.data.Data.textOff(Unknown Source) at org.basex.data.DiskData.text(Unknown Source) at org.basex.index.resource.Docs.paths(Unknown Source) at org.basex.index.resource.Docs.insert(Unknown Source) at org.basex.index.resource.Resources.insert(Unknown Source) at org.basex.data.Data.insert(Unknown Source) at org.basex.core.cmd.Add.run(Unknown Source) at org.basex.core.Command.run(Unknown Source) at org.basex.core.Command.execute(Unknown Source) at org.basex.server.LocalSession.execute(Unknown Source) at org.basex.server.Session.execute(Unknown Source) at org.basex.core.Main.execute(Unknown Source) at org.basex.core.Main.execute(Unknown Source) at org.basex.core.Main.console(Unknown Source) at org.basex.BaseX.<init>(Unknown Source) at org.basex.BaseX.main(Unknown Source) Thanks Samby

2 2

Lucene implementation?
by Rameshwar Nagpure 27 Aug '14

27 Aug '14

Hi there >From this link https://github.com/BaseXdb/basex/pull/986 , I cam to know that hereafter BaseX will have Lucene XQuery Module. Thanks a lot. Please tell me, with which version can I use it ?

2 1

request:http()
by Ioan Fericel 27 Aug '14

27 Aug '14

Hi, congratulations for the job well done on this project! I'm having a problem that I hope you can help me with some guidance. A form made with XForms send data from a instance - with submission, POST method - in a function xq from BaseX, to be saved in the database, and can not find how to retrieve data from the request. We found here ( http://exquery.github.io/expath-specs-playground/request-modules-1.0-specif… ) specifications for request:http() function, that seems to be taking all content submitted by post, but not yet implemented. Are likely to be implemented soon, and really do this? What other methods would be to get body content? I found this guidance ( https://www.mail-archive.com/basex-talk%40mailman.uni-konstanz.de/msg03171.… ) to function http: send-request, but I did not understand how they could solve this. Many thanks, Ioan

2 2

fn:trace improvement
by Marc van Grootel 26 Aug '14

26 Aug '14

Hi, Would it be possible to add automatic serialization of map and array types in fn:trace? When using it should be transparent but currently providing a map or array fails. To trace it I now use awkward code to do it since I have to call map:serialize and array:serialize myself. E.g. (fn:trace(map:serialize($map, 'X: ')), func($map))[2] Cheers, --Marc

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk