BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Re: [basex-talk] Xquery collections
by michele.greco2＠email.it 15 Sep '15

15 Sep '15

Hi, i tried this xquery: for $e in db:open("dbName")//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in db:open("dbName")//w:tc[.//text()="Indirizzo"] return $x//following::text())   but only returns the result of the first document. How do i do it for all the documents? --------- Original Message -------- Da: "Dirk Kirsten" <dk(a)basex.org> To: Cc: basex-talk(a)mailman.uni-konstanz.de Oggetto: Re: [basex-talk] Xquery collections Data: 03/09/15 18:08 Ciao Michele, welcome to the community :-) Collections in BaseX are basically databases. You can simply open a database e.g. by issueing the XQuery db:open('mydatabase'). This will use all documents in your database. You can find some more examples at http://docs.basex.org/wiki/Databases It might also be helpful for you to read some of the Tutorials given at http://docs.basex.org/wiki/Getting_Started like BaseX for Dummies, given a concise introduction to BaseX. Spero che sia d'aiuto Dirk On 09/03/2015 05:48 PM, michele.greco2(a)email.it wrote: Hello I Michele i'm new to basex, i created a collection with different documents .xml. I want to know how to query the entire collection e its documents at one xquery. I'm trying,but i can't.   Thanks. MG   ---- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli clicca qui Sponsor: Idee regalo classiche o alternative? Trova l'offerta migliore in un click Clicca qui -- Dirk Kirsten, BaseX GmbH, http://basexgmbh.de |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Soluzioni di email hosting per tutte le esigenze: dalle caselle gratuite a quelle professionali su piattaforma Zimbra, da quelle su proprio dominio a quelle certificate PEC. Confronta le soluzioni Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13325&d=4-9

3 2

Validate module and catalogs
by Lizzi, Vincent 14 Sep '15

14 Sep '15

It appears that the Validate module is not using catalogs. I'm working with XML that contains a DTD DOCTYPE declaration with a public identifier and a system identifier that contains the filename of the DTD, and I have set up a catalog that provides the DTD location. Here is a rough example: declare option db:chop 'false'; declare option db:dtd 'true'; declare option db:catfile 'schemas/catalog.xml'; let $xmlFile := 'path/to/file.xml' let $parsed := doc($xmlFile) let $report := validate:dtd-report($xmlFile) return ($report, $parsed) This fails on the validate:dtd-report line. The error report indicates that BaseX is trying to find the DTD in the same folder as the XML file. I know the catalog is working because the doc() call is parsing the XML and populating default attributes, and if I remove the db:catfile option declaration the doc() call fails. If I add a path to the DTD in the second parameter in validate:dtd-report($xmlFile, 'path/to/dtd.dtd') the validation works. I'm not sure why this is needed because the XML contains a DOCTYPE and the catalog should be resolving the DTD location. Is this intentional? There are use cases to require that validation is done using a specific DTD and not simply any DTD that the XML happens to declare. In other cases however it is easier to validate using the DTD that is already identified in the DOCTYPE of the XML file. Is this a bug? Thanks, Vincent

3 3

Out of Main Memory - Inconsistent DB
by Martín Ferrari 14 Sep '15

14 Sep '15

Hi all, I think one of our DB seems to have gotten corrupt. I wonder if there's a command that will recover it. Issuing REPLACE or OPTIMIZE on it will result in "Out of Main Memory" errors. We have DBs that occupy more space and have more documents, so I assume the problem must be that this DB broke somehow. I've tried raising the -Xmx parameter to 1024m, but still get the same "Out of Main Memory" error. Thanks, Martín. INSPECT Checking main table (11292441 nodes):- 0 invalid node kinds- 0 invalid parent references- 87 wrong parent/descendant relationships (pre: 10932445,..)Warning: Database is inconsistent. INFO DB Database Properties Name: OrderInquiryV2_1 Size: 2138 MB Nodes: 11292441 Documents: 251980 Binaries: 0 Timestamp: 2015-09-10T16:40:29.000Z Resource Properties Timestamp: 2015-09-08T23:11:28.497Z Encoding: UTF-8 CHOP: false Indexes Up-to-date: false TEXTINDEX: false ATTRINDEX: false FTINDEX: false LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: false AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96

2 1

Re: [basex-talk] size on collection in the time (Marc)
by cmarchand＠oxiane.com 14 Sep '15

14 Sep '15

I confirm the problem : on another database (same data, same script.xbs, different server), we have exactly the same problem : the database grows each time the script is run. I'm going to prepare a test-case with small public data tonight. Best regards, Christophe Hello Dirk, We use a BaseX script (.xbs) with a list of REPLACE. We try to investigate this point if this is reproducable or not. If I find this problem again, I take a copy of the collection before to delete her. Thank you for answer. Marc Le 03/09/2015 09:52, Dirk Kirsten a ?crit : > Hello Marc, > > sure, a replace should lead to a true replace, i.e. the old data will be > dropped. So this sounds like a bug, but it is difficult to replicate > from what you describe. > > Do you think it would be possible to make the issue reproducable, maybe > also with a smaller data set? Also, how exactly do you add documents or > do you also do any queries and maybe other updating queries? > > Cheers > Dirk > > On 09/02/2015 05:36 PM, Marc wrote: > >> Hi, >> I have a remark about the size of the files of a collection. >> We do a lot of updates (REPLACE) with an attributes index but without >> a text index. >> I see that the size of the files grows up in the time we arrive until >> 30Go until the limit of the filessytems quota. >> When I drop the collection and recreate it from the last version of >> the files the size was only 6Go. >> >> We will redo the test with the time, but I just want to know if the >> program clears the disk use when he does a REPLACE? >> >> Marc ------------------------------ Message: 4 Date: Thu, 3 Sep 2015 10:01:05 +0200 From: Marc <Marc.Liste(a)free.fr> To: Dirk Kirsten <dk(a)basex.org> Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> Subject: Re: [basex-talk] (no subject) Message-ID: <55E7FE41.5080205(a)free.fr> Content-Type: text/plain; charset=iso-8859-15; format=flowed I forgot to give this precision, we use the 7.9 version on this server. Marc Le 01/01/1970 01:00, a ?crit : > Hello Dirk, > We use a BaseX script (.xbs) with a list of REPLACE. > We try to investigate this point if this is reproducable or not. > If I find this problem again, I take a copy of the collection before to > delete her. > > Thank you for answer. > > Marc > Le 03/09/2015 09:52, Dirk Kirsten a ?crit : Hello Marc, > > sure, a replace should lead to a true replace, i.e. the old data will be > dropped. So this sounds like a bug, but it is difficult to replicate > from what you describe. > > Do you think it would be possible to make the issue reproducable, maybe > also with a smaller data set? Also, how exactly do you add documents or > do you also do any queries and maybe other updating queries? > > Cheers > Dirk > > On 09/02/2015 05:36 PM, Marc wrote: Hi, > I have a remark about the size of the files of a collection. > We do a lot of updates (REPLACE) with an attributes index but without > a text index. > I see that the size of the files grows up in the time we arrive until > 30Go until the limit of the filessytems quota. > When I drop the collection and recreate it from the last version of > the files the size was only 6Go. > > We will redo the test with the time, but I just want to know if the > program clears the disk use when he does a REPLACE? > > Marc End of BaseX-Talk Digest, Vol 69, Issue 5 *****************************************

2 1

size on collection in the time
by Marc 14 Sep '15

14 Sep '15

Hi, I have a remark about the size of the files of a collection. We do a lot of updates (REPLACE) with an attributes index but without a text index. I see that the size of the files grows up in the time we arrive until 30Go until the limit of the filessytems quota. When I drop the collection and recreate it from the last version of the files the size was only 6Go. We will redo the test with the time, but I just want to know if the program clears the disk use when he does a REPLACE? Marc

3 4

Schematron validation
by Lizzi, Vincent 14 Sep '15

14 Sep '15

I have just released a module that provides an easy way to use Schematron in BaseX. It's is available on GitHub at https://github.com/vincentml/schematron-basex. This module is a convenience wrapper around the standard ISO Schematron XSLTs. In addition, a version of this module for eXist-db is available at https://github.com/vincentml/schematron-exist Vincent "Everything should be made as simple as possible, but not simpler."

2 1

Fastest way to get resources starting with path
by Martín Ferrari 14 Sep '15

14 Sep '15

Hello: I wonder if there's a fast way to get the contents or names of the resources that start with a certain path. We have something like this: string query = @"for $doc in collection() where substring-after(document-uri($doc), '/') = '" + documentName + @"' return $doc/Root"; But our db has millions of resources so this doesn't scale too well. I'd like a way to get the contents (or names) of resources in which the names start with a certain pattern without having to check all names. Is it possible? The alternative would be to add a field inside the xml resources, index on it, and perform a query. Thanks, Martín.

3 3

Erstellen eines XLSX Sheet mittels Apache POI in einer XQuery Rest Funktion
by Arthur Stocker 14 Sep '15

14 Sep '15

Hallo Zusammen Ich möchte in einer REST Funktion Daten als XLSX zurück geben. Via Java Bindings wollte ich in der Xquery Funktion die Apache POI nutzen und habe mal versucht das einfache Beispiel der JSP Seite zu übersetzen, scheitere nun aber an der Meldung "[XPST0017] Several implementations found for …. „ beim Aufruf der Funktion createSheet(). Einfacher Versuch - XQ Funktion. import module namespace xlsx = "org.apache.poi.xssf.usermodel.XSSFWorkbook"; declare %rest:path('/test') function root:test( ) { let $sheet := xlsx:createSheet() let $row := $sheet:createRow(0) let $cell := $row:createCell(0) return $cell:setCellValue("Some text“) }; JSP Source: <%@page import="org.apache.poi.xssf.usermodel.*" %><%@page import="java.io.*" %><% // create a small spreadsheet if xls then HSSF.... instead of XSSF.... for xlsx XSSFWorkbook wb = new XSSFWorkbook(); XSSFSheet sheet = wb.createSheet(); XSSFRow row = sheet.createRow(0); XSSFCell cell = row.createCell(0); cell.setCellValue("Some text"); // write it as an excel attachment ByteArrayOutputStream outByteStream = new ByteArrayOutputStream(); wb.write(outByteStream); byte [] outArray = outByteStream.toByteArray(); //response.setContentType("application/ms-excel"); response.setContentType("application/vnd.openxmlformats-officedocument.spreadsheetml.sheet"); response.setContentLength(outArray.length); response.setHeader("Expires:", "0"); // eliminates browser caching //response.setHeader("Content-Disposition", "attachment; filename=testxls.xls"); response.setHeader("Content-Disposition", "attachment; filename=testxls.xlsx"); OutputStream outStream = response.getOutputStream(); outStream.write(outArray); outStream.flush(); %> Die Dokumentation konnte mir das weitere Vorgehen nicht so ganz aufzeigen. Hat jemand das Apache POI schonmal in XQuery genutzt? Beim Lesen der Doku und den Beispielen bekomme ich den Eindruck, nicht um das Schreiben einer eigenen JAVA Klasse herum zu kommen. VG Arthur

2 1

DELETE Performance
by Martín Ferrari 14 Sep '15

14 Sep '15

Hi: I have a DB with around a million records. Adding resources to it takes some milliseconds. However, executing DELETE on a resource takes more than 60 seconds. Am I doing something wrong? Is this by design? Thanks! Martín.

3 3

http:request timeout
by Marco Lettere 13 Sep '15

13 Sep '15

Hello all, I think there is a mismatch in the semantics of timeout for the http:request datastructure. expath says it's in seconds where as the basex impl treats it as milliseconds. Could you confirm this? The expath states: [...] |timeout|is the maximum number of seconds to wait for the server to respond. If this time duration is reached, an error is thrown[err:HC006] <http://expath.org/spec/http-client#errHC006>. [...] whereas in the HttpClient (lines 168 and 169) the code for setting the timeout is the following: [...] final String timeout = request.attribute(TIMEOUT); if(timeout != null) conn.setConnectTimeout(Strings.toInt(timeout)); [...] conn being an instance of HttpUrlConnection and the documentation of setConnectTimeout states it to be in milliseconds. If this is not my bad interpretation, maybe a note in the docs should be provided ... Regards, Marco.

3 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk