BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5245 discussions

Re: [basex-talk] Initial xquery for full text and geospatial search of ISO 19115 docs
by David Stuebe 02 Jan '13

02 Jan '13

Hi Chris I did look at the Query Info in the Gui and it seems you are correct. The complex query I created is not utilizing the full text index. Details here: https://gist.github.com/4438473 The gist contains query info for the complex search that I created and for a simple one that just executes the 'contains text' clause. The compile statement for the simple query includes the following line: "applying full-text index" The complex query does not… So what to do now? How do I figure out why basex is not using the full text index as the initial step in limiting the results of my search? Thanks David From: "basex-talk-request(a)mailman.uni-konstanz.de<mailto:basex-talk-request@mailman.uni-konstanz.de>" <basex-talk-request(a)mailman.uni-konstanz.de<mailto:basex-talk-request@mailman.uni-konstanz.de>> Reply-To: "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Date: Tue, 1 Jan 2013 06:00:02 -0500 To: "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: BaseX-Talk Digest, Vol 37, Issue 1 Message: 1 Date: Mon, 31 Dec 2012 20:56:01 +0100 From: Christian Gr?n <christian.gruen(a)gmail.com<mailto:christian.gruen@gmail.com>> To: David Stuebe <DStuebe(a)asascience.com<mailto:DStuebe@asascience.com>> Cc: Kyle Wilcox <KWilcox(a)asascience.com<mailto:KWilcox@asascience.com>>, "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: Re: [basex-talk] Initial xquery for full text and geospatial search of ISO 19115 docs Message-ID: <CAP94bnPneuWguMGL-k2ZMw6gCD4WQNc82KBR5es8h+BrZ1fs2Q(a)mail.gmail.com<mailto:CAP94bnPneuWguMGL-k2ZMw6gCD4WQNc82KBR5es8h+BrZ1fs2Q@mail.gmail.com>> Content-Type: text/plain; charset=windows-1252 Hi David, thanks for the insight into your project. It may be that the full-text index is not utilized by your XQuery expression. Did you have a look at the query info (e.g. via GUI, InfoView, or -V on command line)? Did you manage to write simpler queries that are processed faster? Best, Christian ___________________________ On Mon, Dec 31, 2012 at 7:31 PM, David Stuebe <DStuebe(a)asascience.com<mailto:DStuebe@asascience.com>> wrote: Hi Basex Folks I have written a simple minded xquery script which can be used in a post to search ISO 19115 metadata documents. As I am a newbie to xquery and basex I expect that is much that I could do to improve performance, but currently searches take up to 15 seconds. The server hardware is not blazing fast and we are running inside tomcat? but that is certainly not acceptable for a database which is still quiet small. Initially it was fine, responding in less than a second, but when we expanded from less than 100 docs to about 35000 the time grew at least linearly. I am hoping this is due to my poor xquery programming or a setting on the server. Here is the query we are running using a post request with the declared variables at the bottom filled in by the UI: https://github.com/asascience-open/glos_catalog/blob/master/queries/full_se… Here are some of the ISO xml documents that we have in our basex DB: https://github.com/asascience-open/glos_catalog/tree/master/ISOs It is used by this site: http://explorer.glos.us/ To provide geospatial metadata search. Fill in a text value like "water" or "temperature" in the search box in the top right? The server is here: http://64.9.200.113:8080/BaseX73/ User Name: user Password: glos ACL: read only I am hoping it is as simple as a setting on the basex server. Here is the current server info: info database Database Properties Name: glos Size: 422 MB Nodes: 17045388 Documents: 34922 Binaries: 0 Timestamp: 27.12.2012 00:58:03 Resource Properties Timestamp: 22.12.2012 01:43:05 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON Full-Text Index: ON The index info is available here: https://github.com/asascience-open/glos_catalog/blob/master/queries/glos_in… David Stuebe Scientist & Software Engineer ? RPS ASA 55 Village Square Drive South Kingstown, RI 02879-8248 Tel: +1 (401) 789-6224 Email: David.Stuebe(a)rpsgroup.com<mailto:David.Stuebe@rpsgroup.com> www: asascience.com | rpsgroup.com A member of the RPS Group plc _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de<mailto:BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 2

Fwd: concat string in for loop
by Jarosław Kowalewski 02 Jan '13

02 Jan '13

Hi, I've a problem with concatation strings in for loop. e.g. xquery concat("text",'
',"additional text"), '
', '
', for $i in <root><a>element-a</a><b>element-b</b></root>/* return concat($i,'
') give me the result " text additional text element-a element-b " with additional space before "element-a" and "element-b" but the concatation in the first row works fine. I tried it in GUI mode version 7.3 and 7.5. Jarek

2 1

how to know creation options of a database
by Fabrice Etanchaud 02 Jan '13

02 Jan '13

Dear all at BaseX, How can I know the creation options of a given database ? When I open a database created with a few non default options (MAXCATS set to 10000) for example, GET MAXCATS seems to always return the last value set with SET MAXCATS. Regards, Fabrice Etanchaud Questel-Orbit

2 3

UPDINDEX
by pw＠themail.co.uk 02 Jan '13

02 Jan '13

Hello List I am working with 7.5 and am looking for guidance on setting UPDINDEX If I run the basex http server from the command line and GET UPDINDEX it is initially false. If I then open the client and GET UPDINDEX it is also false (as expected). Through the client I can then set it with the command "set updindex true". This time GET UPDINDEX returns true through the client but false through the httpserver. How do I set the updindex option so that it it operational for the REST service? Thanks Peter

2 1

Re: [basex-talk] http server ... outsider localhost
by Andy Bunce 02 Jan '13

02 Jan '13

Peter, Good to know it worked. Christian, I think this change should be made to the github source /Andy On Tue, Jan 1, 2013 at 2:00 AM, <pw(a)themail.co.uk> wrote: > Andy > changing the default to 0.0.0.0 worked. Many thanks > > Peter > > ---- Original Message ---- > From: bunce.andy(a)gmail.com > To: pw(a)themail.co.uk > Subject: Re: [basex-talk] http server ... outsider localhost > Date: Mon, 31 Dec 2012 11:34:48 +0000 > > >Hi Peter, > >I wonder if this problem is related to a change I suggested to the > >webapps/WEB_INF/jetty.xml file. > >Do you still get the problem if you remove the line below and > >restart? > > <Set name="host"><SystemProperty name="org.basex.serverhost" > >default=""/></Set> > > > >Or if you change default="" to default="0.0.0.0" as suggested here > > > >http://osgeo-org.1560.n6.nabble.com/Cannot-connect-to-server-host-IP- > >unless-it-s-localhost-td3861103.html > > > >Regards > > > >/Andy > > > >On Sun, Dec 30, 2012 at 5:30 PM, <pw(a)themail.co.uk> wrote: > > > >> Hi Christian > >> > >> I just downloaded the BaseX 7.5 zip archive and ran the > >> httpserver.bat file ... On the local machine I was able to access > >> using the localhost or machine name as URLs, but access from > >> elsewhere on the network got to the Jetty server (it logged "access > >> denied") but apparently no further. > >> > >> Peter > >> > >> > >> > >> > >> > >> Hi Peter, > >> > >> the combination of BaseX and Jetty is successfully applied in many > >> productive client/server environments. Can you provide us with some > >> more details on how to reproduce the issue? > >> > >> > >> Thanks, > >> Christian > >> ___________________________ > >> > >> > hello list --- Happy Christmas & New Year > >> > > >> > If I run the http server (Basex 7.5) then I can access through > >> Jetty. > >> > When I try to access the same across the network I get nothing > >> > through and "Access denied" in the Basex logs. What's the > >solution? > >> > > >> > Many thanks > >> > Peter > >> > > >> > _______________________________________________ > >> > BaseX-Talk mailing list > >> > BaseX-Talk(a)mailman.uni-konstanz.de > >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >> _______________________________________________ > >> BaseX-Talk mailing list > >> BaseX-Talk(a)mailman.uni-konstanz.de > >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >> > >> > >> _______________________________________________ > >> BaseX-Talk mailing list > >> BaseX-Talk(a)mailman.uni-konstanz.de > >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >> > > >

2 1

Re: [basex-talk] how to pass raw bytes intact?
by jidanni＠jidanni.org 02 Jan '13

02 Jan '13

Our mission today is to use Basex to remove tags injected right between the bytes of multibyte UTF-8 characters. http://www.couchsurfing.org/group_read.html?gid=430&post=13986932 >>>>> "CG" == Christian Grün <christian.gruen(a)gmail.com> writes: CG> Have you tried method=raw, as mentioned in our documentation CG> (http://docs.basex.org/wiki/Serialization)? Sorry. Try it yourself: echo '<A>你好</A>'|perl -pwle 's![^[:ascii:]]!$&<wbr/>!'|basex -q ' declare option db:parser "html"; declare option output:method "raw"; doc("/dev/stdin")//*:wbr/..' There is no way to cleanly restore the shattered UTF-8. I would also like to try declare option output:encoding "RAW"; or "BYTES" or "NONE" but on http://docs.basex.org/wiki/Serialization it just says "all encodings supported by Java" So one is supposed to look at http://www.google.com/search?q=all+encodings+supported+by+Java etc. etc. Why doesn't basex have a command that would output the current "all encodings supported by Java" that it is using.

3 7

XQuery Update using IF Condition...
by John Best 02 Jan '13

02 Jan '13

Dear Team, I am getting error - If expression : no updating expression allowed - while trying to update the "Data" DB. I need to update the DB, if it is not already updated... for $c in doc('2012')/Docs/Doc/No/@n return if (string-length(doc('Data')/Docs/Doc[No/@n=$c]/Title/Name/text()) eq 0) then insert node $c into doc('Data')/Docs else <l>{''}</l> -- Have a nice day JBest

2 1

Initial xquery for full text and geospatial search of ISO 19115 docs
by David Stuebe 31 Dec '12

31 Dec '12

Hi Basex Folks I have written a simple minded xquery script which can be used in a post to search ISO 19115 metadata documents. As I am a newbie to xquery and basex I expect that is much that I could do to improve performance, but currently searches take up to 15 seconds. The server hardware is not blazing fast and we are running inside tomcat… but that is certainly not acceptable for a database which is still quiet small. Initially it was fine, responding in less than a second, but when we expanded from less than 100 docs to about 35000 the time grew at least linearly. I am hoping this is due to my poor xquery programming or a setting on the server. Here is the query we are running using a post request with the declared variables at the bottom filled in by the UI: https://github.com/asascience-open/glos_catalog/blob/master/queries/full_se… Here are some of the ISO xml documents that we have in our basex DB: https://github.com/asascience-open/glos_catalog/tree/master/ISOs It is used by this site: http://explorer.glos.us/ To provide geospatial metadata search. Fill in a text value like "water" or "temperature" in the search box in the top right… The server is here: http://64.9.200.113:8080/BaseX73/ User Name: user Password: glos ACL: read only I am hoping it is as simple as a setting on the basex server. Here is the current server info: info database Database Properties Name: glos Size: 422 MB Nodes: 17045388 Documents: 34922 Binaries: 0 Timestamp: 27.12.2012 00:58:03 Resource Properties Timestamp: 22.12.2012 01:43:05 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON Full-Text Index: ON The index info is available here: https://github.com/asascience-open/glos_catalog/blob/master/queries/glos_in… David Stuebe Scientist & Software Engineer – RPS ASA 55 Village Square Drive South Kingstown, RI 02879-8248 Tel: +1 (401) 789-6224 Email: David.Stuebe(a)rpsgroup.com<mailto:David.Stuebe@rpsgroup.com> www: asascience.com<http://www.asascience.com/> | rpsgroup.com<http://www.rpsgroup.com/> A member of the RPS Group plc

2 1

Re: [basex-talk] http server ... outsider localhost
by pw＠themail.co.uk 31 Dec '12

31 Dec '12

Hi Christian I just downloaded the BaseX 7.5 zip archive and ran the httpserver.bat file ... On the local machine I was able to access using the localhost or machine name as URLs, but access from elsewhere on the network got to the Jetty server (it logged "access denied") but apparently no further. Peter Hi Peter, the combination of BaseX and Jetty is successfully applied in many productive client/server environments. Can you provide us with some more details on how to reproduce the issue? Thanks, Christian ___________________________ > hello list --- Happy Christmas & New Year > > If I run the http server (Basex 7.5) then I can access through Jetty. > When I try to access the same across the network I get nothing > through and "Access denied" in the Basex logs. What's the solution? > > Many thanks > Peter > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 1

http server ... outsider localhost
by pw＠themail.co.uk 30 Dec '12

30 Dec '12

hello list --- Happy Christmas & New Year If I run the http server (Basex 7.5) then I can access through Jetty. When I try to access the same across the network I get nothing through and "Access denied" in the Basex logs. What's the solution? Many thanks Peter

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk