BaseX-Talk

basex-talk@mailman.uni-konstanz.de

4 participants
5268 discussions

http:request post parameter bug? basex 7.01
by Andy Bunce 15 Jan '12

15 Jan '12

Hi, Could there be an encoding issue with http:request post requests? I send.. let $r:=<http:request method='post' > <http:body media-type="application/x-www-form-urlencoded" method="text">a=3&b=4</http:body> </http:request> return http:send-request($r,"http://posttestserver.com/post.php")[2] http://www.posttestserver.com/ reports the parameters as.. Post Params: key: 'a' value: '3' key: 'amp;b' value: '4' Empty post body. /Andy

2 7

Re: [basex-talk] line number and column
by Dave Glick 15 Jan '12

15 Jan '12

I had a similar requirement a while back and ended up solving it in two ways: The first attempt I wrote a routine that would take a node and scan for all text nodes along the preceding axis. I would then add the length of each text node to a counter (I wanted offset), but counting new lines shouldn't be much different. I used the API, but I don't think it would be too tough to write an XQuery expression or function that does the same thing. Alternatively you could use the BaseX functionality to call Java code from XQuery to write it up in code. This worked okay in isolated cases, but I needed the info very frequently (I was writing a text editor backed by XML, so I was constantly getting offsets for the caret) and scanning the preceding axis each time took too long. I ended up going through every node in sequence for a new document and caching the information. The idea was the same though - every time I hit a text node, I incremented a counter and used the value for following nodes (until I hit another text node). Not sure if that helps - hopefully it does... Dave -----Original message----- From: "Christian Grün" <christian.gruen(a)gmail.com> To: Anders Hessellund <anders.hessellund(a)gmail.com> Cc: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> Sent: Sat, Jan 14, 2012 11:38:06 GMT+00:00 Subject: Re: [basex-talk] line number and column Dear Anders, maybe there's another way to achieve what you want; what do you exactly need line and column information for? Christian ___________________________ On Sat, Jan 14, 2012 at 12:21 PM, Anders Hessellund <anders.hessellund(a)gmail.com> wrote: > Thanks for your replies, > > the line number and column info is pretty important for us. Is there perhaps > some part of the parser code that I could hack/fork? > > -- Anders > > > On Thu, Jan 12, 2012 at 11:59 AM, Christian Grün <christian.gruen(a)gmail.com> > wrote: >> >> Dear Anders, >> >> I'm sorry: information on the original line and columns gets lost as >> soon as a database, or a main memory instance of a document, is >> created. If you look for ways to address the same XML nodes multiple >> times, you may want to have a look at the fn:path(); it returns an >> XPath expression to the adressed nodes [1]. A simple example: >> >> for $item in doc('http://files.basex.org/xml/xmark.xml')//item >> return path($item) >> >> If you have create a database from your files, you can also use the >> BaseX-specific db:node-pre() and db:open-pre() functions to directly >> address nodes [2]. >> >> Hope this helps, >> Christian >> >> [1] http://www.w3.org/TR/xpath-functions-30/#func-path >> [2] http://docs.basex.org/wiki/Database_Module >> ___________________________ >> >> On Wed, Jan 11, 2012 at 11:28 PM, Anders Hessellund >> <anders.hessellund(a)gmail.com> wrote: >> > Hi, >> > >> > we are experimenting with BaseX as a database for a large set of local >> > XML >> > files (3000-4000). When we query for individual elements and attributes >> > in >> > this portfolio of XML documents, is there any way to get location >> > information about concrete elements and attributes. Specifically, we >> > need to >> > know filename, line number and column of element (start tags) and >> > attributes. Is this possible? And if so, how? >> > >> > Thanks, >> > Anders > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 1

xquerydoc support for BaseX
by Andy Bunce 14 Jan '12

14 Jan '12

Hi, The https://github.com/xquery/xquerydoc project is looking like a good tool to generate Xquery documentation. Currently it is failing on some BaseX extensions. See https://github.com/xquery/xquerydoc/issues/6#issuecomment-3491893. Is there a EBNF source for the map module syntax available somewhere? /Andy

2 1

line number and column
by Anders Hessellund 14 Jan '12

14 Jan '12

Hi, we are experimenting with BaseX as a database for a large set of local XML files (3000-4000). When we query for individual elements and attributes in this portfolio of XML documents, is there any way to get location information about concrete elements and attributes. Specifically, we need to know filename, line number and column of element (start tags) and attributes. Is this possible? And if so, how? Thanks, Anders

4 5

RegExp bug
by Mark Boon 10 Jan '12

10 Jan '12

It's been a while since I did anything with BaseX. The last version I used was BaseX 6.5. Today I downloaded the latest version 7.0.2 and ran into a problem when trying to revive an old project. I get messages saying " [FORX0002] Invalid escape character: '\b'". Since the use of \b is rather essential to my project I had little choice but to investigate, so I retrieved the BaseX source code to see if I could determine the problem. I found the following in RegEx.java, line 88: if("0123456789cCdDniIrsStwW|.-^$?*+{}()[]\\".indexOf(c) == -1) REGESC.thrw(input, c); I believe that's a mistake and should include 'b' and read: if("0123456789bcCdDniIrsStwW|.-^$?*+{}()[]\\".indexOf(c) == -1) REGESC.thrw(input, c); When I make that modification my program works again as before. There may be more missing? I'm not especially a RegExp expert. And I'd like to make sure this modification didn't inadvertantly break something else that I just haven't noticed yet. Mark Boon

3 3

Spatial XQuery?
by Schildmann, Ingo 09 Jan '12

09 Jan '12

Hi, Our company evaluates BaseX for our project. A new requirement is to show spatial data with a geographic information system. Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist? http://exist-db.org/extensions.html#module_spatial Regards, Ingo Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de <http://www.karb.de/> Mail: schildmann(a)karb.de <mailto:schildmann@karb.de> Skype: ischildmann

7 12

function to give the current file being processed?
by jidanni＠jidanni.org 07 Jan '12

07 Jan '12

{comment {"Made by noise.xq, will get OVERWRITTEN"}} gives me $ basex noise.xq <?xml version="1.0" encoding="UTF-8"?> <kml xmlns="http://www.opengis.net/kml/2.2">  <Document>... Is there any function to enable me not to need to hardwire the name into the file?

2 4

basex with ext3 vs ext4, [kjournald]
by Adrian Hossu 07 Jan '12

07 Jan '12

Hi all, I'm been running basex on two environments, one is my laptop with an SSD drive and ext4, the other is a server with raid-1 HDD and ext3. Using iotop, I am watching the disk access of the server and laptop, and comparing the two. After some update queries, I notice that the server (ext3) has a process, [kjournald], which writes for about 20 seconds at 600-1000KB/sec. This only begins after the update is complete and the java process actually stops writing. I am not experiencing such a thing on my laptop. If I do too many of these queries on the server, it will eventually hang for 20-30 seconds. I've copied the exact data on both the laptop and the server. Are there any recommended filesystem types for basex? Does it sound like I've configured something incorrectly, or should I add some more drives to my server and have them using ext4? Or is the difference SSD vs HDD? I never saw my SSD write speed go above 200KB/sec or so during the same queries. Any help would be greatly appreciated! - Adrian

2 2

Re: [basex-talk] Query Across/Many XML Files With BaseX
by Lukas Lewandowski 02 Jan '12

02 Jan '12

Hi Jon, Currently I work on querying distributed XML collections. Therefore I tested also the local BaseX instance (without distribution) for some query performance. My used collection consists of about 1,600,000 XML news articles, each 10 KB size. One of my queries searches for news articles which contain a special keyword (using the full text index). It takes about 100ms for the evaluation. Happy new year. Lukas On 01.01.2012, at 22:53, Jon Morehouse wrote: > Hello Lukas, > Thanks for your response. I am simply looking at storing text in my xml articles. I would be recreating articles with xml and all pictures would be hyperlinked on an external server. I would say each file would be no larger than say 20 kB max. > I am also looking at simply recreating a localized search engine. In terms of scalability, in your opinion, do you think that Basex would be more sufficient for scaling and searching through content. I am hoping my local database grows to hold hundreds of thousands, maybe millions of articles and would like to access any single article by searching with keywords for my users. > > Anyways, I appreciate your response. Have a good new year. > > > > > Jon Morehouse > Moeller High School Class of 2009 > Pepperdine University 2009-2010 > University of Southern California Class of 2013 > > > <Signature Final (2).jpg> > > On Jan 1, 2012, at 8:59 AM, Lukas Lewandowski wrote: > >> Hi Jon Morehouse, >> >> You can use BaseX to create a database (a collection) of all your XML files. You can find some information here [1]. >> Additionally you can create a full-text index to support fast access of keywords within text nodes, see also [2]. >> >> Afterwards you can access/query your database e.g., using the REST API [3] or a client API [4,5]. >> >> Which size does one XML file have? >> >> regards >> Lukas >> >> [1] http://docs.basex.org/wiki/Commands#CREATE_DATABASE >> [2] http://docs.basex.org/wiki/Full-Text >> [3] http://docs.basex.org/wiki/REST >> [4] http://docs.basex.org/wiki/Clients >> [5] https://github.com/BaseXdb/basex-api/tree/master/src/main/php >> >> >> On Jan 1, 2012, at 9:12 AM, Jon Morehouse wrote: >> >>> I am new to BaseX and am excited to be moving forward with this product. Right now I am setting up a website where I want to be able to query across millions of xml files. For instance, if each file contains different keywords, I would like to query across each file to match them with a list of say, my top 50 keywords, to find which files have the most keywords present, the most amount of times. Would something like this be possible with basex? It seems like it would be a simple xquery piece using php (the list of keywords is coming from mysql) but with each xml being its own xml file, would it be possible to search across each and every database/file. >>> >>> >>> >>> >>> >>> Jon Morehouse >>> Moeller High School Class of 2009 >>> Pepperdine University 2009-2010 >>> University of Southern California Class of 2013 >>> >>> >>> <Signature Final (2).jpg> >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >

1 0

Query Across/Many XML Files With BaseX
by Jon Morehouse 01 Jan '12

01 Jan '12

I am new to BaseX and am excited to be moving forward with this product. Right now I am setting up a website where I want to be able to query across millions of xml files. For instance, if each file contains different keywords, I would like to query across each file to match them with a list of say, my top 50 keywords, to find which files have the most keywords present, the most amount of times. Would something like this be possible with basex? It seems like it would be a simple xquery piece using php (the list of keywords is coming from mysql) but with each xml being its own xml file, would it be possible to search across each and every database/file. Jon Morehouse Moeller High School Class of 2009 Pepperdine University 2009-2010 University of Southern California Class of 2013

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk