BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Query Execution Taking Too Long...
by ankit kumar 23 Mar '15

23 Mar '15

Hi, I am trying to get all distinct start element '/products/p:category/start' nodes of a big file. I have written a query which is given below. It is taking to long to get the result. I am attaching the query info and the xml file. After Running couple of minutes, I stopped the execution. Query is trying to get all the distinct start elements There are 3 lac category elements. declare namespace functx = "http://www.functx.com"; declare namespace p="a:b:c"; declare function functx:is-node-in-sequence( $node as node()? , $seq as node()* ) as xs:boolean {some $nodeInSeq in $seq satisfies deep-equal($nodeInSeq,$node)}; declare function functx:distinct-nodes( $nodes as node()* large.xml <https://docs.google.com/file/d/0B_pB7l14skhVLWxvZGNyMnFwc0k/edit?usp=drive_…> ) as node()* {for $seq in (1 to count($nodes))return $nodes[$seq][not(functx:is-node-in-sequence(.,$nodes[position() < $seq]))]} ; let $diff_starts := functx:distinct-nodes(/products/p:category/start) return $diff_starts Please let me know if you require further details.

2 1

Issues posting/putting JSON content with markup in it via http module.
by James Wright 23 Mar '15

23 Mar '15

Hello everyone, First, I want to say that I really like the JSON improvements in BaseX 8.0. Great job. I am however having an issue when posting JSON with markup in it. For example: let $out := map { name: 'myView', markup: "<div name='value'>Some other stuff</div>" } http:send-request(<http:request method="POST" />, uri, $out) The issue is that the resulting JSON body being posted has the 'markup' property xml escaped. IE: { "name": "myView", "markup": "<div name='value'>Some other ..... " } I had a similar issue with file:write but resolved that by using file:write-string. I have tried calling json:serialize on $out manually as well as declaring the option output:method to 'json'. I even tried changing the request object by inserting a http:body. IE: <http:request method="GET"> <http:body content-type="application/json"> {json:serialize($out)} </http> </http> Lastly, I have tried declaring the cdata-section option: declare option output:cdata-section-elements 'http:body'; Still no go... Is this not possible? One option would be to serialize the content using file:write and then call curl. This is a workaround I have used in the past however I was hoping I was behind that now with the latest improvements to XQuery 3.1. Maybe I need to send the http:request object as a map instead of an xml node? Thanks again for your time on all of this. - James

2 2

Bug in evaluating conditionals? Not short-circuiting?
by Marc van Grootel 23 Mar '15

23 Mar '15

Hi, I think I found a bug in 8.0.3 (and earlier) declare function local:shortcircuit($a) { if ($a castable as xs:double and xs:double($a) gt 0) then $a else () }; local:shortcircuit('foo') => [FORG0001] Cannot cast to xs:double: "foo". In http://www.w3.org/TR/xpath/#booleans "An and expression is evaluated by evaluating each operand and converting its value to a boolean as if by a call to the boolean function. The result is true if both values are true and false otherwise. The right operand is not evaluated if the left operand evaluates to false." Haven't tested it for other conditionals. --Marc

2 1

My BaseX GUI shows huge font and icons after upgrade
by Kristian Kankainen 21 Mar '15

21 Mar '15

Hello! After updating BaseX I got a strange looking GUI. Most fonts and icons are huge as can be seen from the screen shot. I use Fedora 21 and the package from your OpenSUSE repo. Could it be some missing fonts or other depending packages? My package information: Installed Packages Name : basex Arch : noarch Version : 8.0.2 Release : 1.1 Size : 2.8 M Repo : installed From repo : home_basex_opensuse And the repo file is the following (as you provide) [home_basex_opensuse] name=BaseX openSUSE Build (Fedora_20) type=rpm-md baseurl=http://download.opensuse.org/repositories/home:/basex:/opensuse/Fed… gpgcheck=1 gpgkey=http://download.opensuse.org/repositories/home:/basex:/opensuse/Fedo… enabled=1 /etc/yum.repos.d/home_basex_opensuse.repo (END) Best regards Kristian K

1 0

Reading standard input
by Hans-Juergen Rennau 19 Mar '15

19 Mar '15

Dear BaseX team, if I understand the documentation correctly, the processing of standard input is currently restricted to "-i-", that is, reading standard input as an XML document providing the context item, e.g. so: myCmd | basex -i- -q //foo Nice, but how about standard input which corresponds, for example, to a JSON document or a CSV document? Wouldn't it be useful to be able to apply functions to standard input,. e.g. json:parse, csv:parse or simple fn:unparsed-text? Example use case: NAGIOS commands piping the output of a command into BaseX. Whereas the context item can have any item type, the command line option -i accepts only documents, and that is the problem. I experimented with the "declare context item" declaration, but it did not work. And, at any rate, I would appreciate the conciseness of using an atomic context item without having to add the "declare context item" declaration. One solution were a new command line option (e.g. -j) which represents the context item as xs:untypedAtomic, and which also understands "-" to denote standard input. Then one could do this: myCmd | basex -j- json:parse(.)//foo That would be very nice and broaden the scope of BaseX again by a meter or two. Cheers,Hans-Jürgen

2 2

Fwd: Re: How to process very long node sequences
by Leonard Wörteler 19 Mar '15

19 Mar '15

Wrong mail account... -------- Weitergeleitete Nachricht -------- Betreff: Re: [basex-talk] How to process very long node sequences Datum: Wed, 18 Mar 2015 19:26:00 +0100 Von: Leo Wörteler <lw(a)basex.org> An: Hans-Juergen Rennau <hrennau(a)yahoo.de> Kopie (CC): basex-talk(a)mailman.uni-konstanz.de <basex-talk(a)mailman.uni-konstanz.de> Dear Hans-Jürgen, Am 18.03.2015 um 15:23 schrieb Hans-Juergen Rennau: > I want to persuade the processor to visit, process and forget the nodes > one after the other, rather than to attempt loading all nodes into > memory before proceeding to process them. BaseX already uses iterative processing as default mode. It only falls back to caching if it has to, e.g. for sorting, reversing or duplicate elimination. Calls to user-defined functions are currently also blocking, but we are currently investigating if that can be changed. > Schematically: > > declare function f:processNode($node as node()) as empty-sequence() {...}; > > for $node in doc('huge-doc')/a/b/c > return f:processNode($node) The example you gave will always be evaluated without caching the node sequence. The `for` clause requests the result of its argument iteratively, and the XPath expression you used only contains child steps, which can be evaluated in document order without duplicates. > Well, in some cases it works, in others in doesn't. Is there any safe > way how to enforce sequential visit-process-forget processing? When the XPath expression becomes more complex, it is not as easy to predict if it uses caching internally. BaseX tries quite hard to detect paths that do not need it, the algorithm can be seen in [1]. If you see a `CachedPath` in the Info View of the GUI, you can try to reformulate the query. > I call this problem general because it is a critical aspect of dealing > with huge documents. XQuery does not have a dedicated *streaming mode* like that of XSLT 3.0 [2] (yet), but it would definitely be possible to check if some part of a query (e.g. marked by a pragma) is evaluated without caching. It would however be quite some work. Hope that helps, Leo [1] https://github.com/BaseXdb/basex/blob/0b828a8/basex-core/src/main/java/org/… [2] http://www.w3.org/TR/xslt-30/#dt-guaranteed-streamable

4 4

How to process very long node sequences
by Hans-Juergen Rennau 18 Mar '15

18 Mar '15

Dear BaseX team, can you help me with the following, very general problem? I have a huge document in a database and want to iterate over many nodes which it contains, performing for each one an action which does not produce a value - for example, storing it in a SQL database. I want to persuade the processor to visit, process and forget the nodes one after the other, rather than to attempt loading all nodes into memory before proceeding to process them. Schematically: declare function f:processNode($node as node()) as empty-sequence() {...}; for $node in doc('huge-doc')/a/b/creturn f:processNode($node) ~ ~ ~ Well, in some cases it works, in others in doesn't. Is there any safe way how to enforce sequential visit-process-forget processing? I call this problem general because it is a critical aspect of dealing with huge documents. Cheers,Hans-Jürgen

1 0

Unexpected format-integer result
by Neven Jovanović 16 Mar '15

16 Mar '15

Hello, when BaseX 8.0 performs the following XQuery expression: format-integer(556, '#,##1') I expect to see just: 556 -- but I get the following: ,556 Am I misreading something in the format-integer() chapter of XPath and XQuery Functions and Operators 3.0[1], or is this a bug? Best, Neven [1] <http://www.w3.org/TR/xpath-functions-30/#func-format-integer>

2 2

Large Document Upload Performance
by Jonathan Clarke 16 Mar '15

16 Mar '15

Hi, I hope you can help me. I am using BaseX to underpin a complex distributed system, which also requires storage of xml document in soft real-time. At the moment, I'm getting storage times for a 4Mb XML file of about 500ms. Can you advise how I might be able to bring that down, please, by at least 75%? I have tried tweaking the systems for BaseX 8, including turning off autoflush, and each setting that I try actually seems to increase the processing time. I also tried to use AddCache, and that just crashed the latest production release of the server. Many thanks for your help in advance, Dr Jonathan Clarke.

3 9

DITA project
by France Baril 14 Mar '15

14 Mar '15

Hi, I'm working on a new DITA project. The DITA standard is used for technical documentation. It creates XML models with inheritance by using @class="ancestor parent child". If the child should behave like it's ancestor the XSL would say: <template match="contains(@class, 'ancestor')"> ... </template> The advantage is that the model can evolve and when new elements are added, you only need to code transformations for the differences. I am trying to figure out if I can use type switching with contains in attribute. Search gets me no syntax for something like this: typeswitch ($node) case attribute(contains(class, 'ancestor')) Maybe I should register to the xquery group to get an answer, but since I'm already here, I though I should ask, and maybe there is a BaseX specific option. I mean other that an unmanageable number of 'if then else' statements. Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 5

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk