BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Search interface for Mailing Lists
by Christian Grün 05 Feb '11

05 Feb '11

Dear all, as has been discussed some days ago, the search for postings in our mailing lists is a tedious job: Mailman does not offer any search features, and the search engines seem to be too phlegmatic to browse the archives more frequently. To fix this, I've created the following page… http://basex.org/open-source/search/ …which allows you to search through all contents of our mailing lists. Full-text indexing, searching and result creation is all done by the BaseX engine, and the database and index is updated every hour. Feedback is welcome, Christian

3 4

Re: [basex-talk] Including the "doc" information in the RETURN clause
by David leigh 03 Feb '11

03 Feb '11

Ok, I got it figured out from this page: http://docs.basex.org/wiki/Database_%26_Collection. So, in my return concat, I need to use the "base-uri" of $song to get the actual file path. So, my query will look something like: for $song in collection("OpenSongSearch") where $song/song/lyrics[ . contains text "baloche"] or $song/song/title[ . contains text "baloche"] or $song/song/author[ . contains text "baloche"] order by $song/song/title return concat(base-uri($song),string('|'), $song/song/title,string('|'),$song/song/author,string('|'),replace(replace($ song/song/lyrics,'\n','^line^'),'\[\w+\]',''),string('
')) Yep, that works! Sorry to bug you all with a question that's documented! Are there other options than base-uri? For instance, base-uri has the file name. Is there a function like that with just the path but not the file name? If not, I can certainly work with base-uri. (I couldn't find any, but thought I'd ask) Thanks!

2 3

XML validation with BaseX
by Vishwas 03 Feb '11

03 Feb '11

Hi, Does BaseX support XML Validation (like http://exist-db.org/validation.html) ? If so, could you please point me to the relevant documentation. -- Thanks& Regards, Vishwas 9986077286

2 2

this mailing list's Google search index: last (only) update around Jan 26?
by Imsieke, Gerrit, le-tex 03 Feb '11

03 Feb '11

Michael, I was wondering why the most recent posts don't seem to be indexed. If you pick examples from the January list , you'll probably notice that the most recent posts are from Jan. 25: [1] indexed, [2] not indexed. Maybe this is because the bot (if it ever returned after initial indexing) looked at [3] and didn't notice any change, so it didn't descend further. If this is the case and the bot returns daily or so, we should see some change soon because February is new on [3]. But I doubt that the bot ever came back after Jan 26. You could try to submit a changed sitemap.xml each month, pointing to that month's message overview page and specifying a changefreq of 'daily' [4] for that page. Don't know whether Googlebot will take this into account though. But other ways such as the infamous revisit-after meta tag won't work at all, I was told. -Gerrit [1] https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/001072.ht… [2] https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/001073.ht… [3] https://mailman.uni-konstanz.de/pipermail/basex-talk/ [4] http://www.google.com/support/webmasters/bin/answer.py?answer=183668

2 1

Including the "doc" information in the RETURN clause
by David leigh 02 Feb '11

02 Feb '11

I may be doing this completely wrong to begin with, so try not to be too shocked at my examples! ;c) My BaseX database consists of songs. They were loaded from individual XML files that are stored in a directory structure. I'm searching for songs that contain given lyrics. So far so good. I'm NOT returning XML format data, but tabular data. I'm using the "return" clause with the concat() function of XQuery to formulate each results row. For instance "song title", "author", "lyrics", etc. One row per song that is found from my search. What I'd like to be able to do is to have that results row also contain the information in the "doc" node so that in addition to selected contents of the XML file, the results row would also contain the file name and the relative directory path (which I see are in the "doc" node when I use the BaseX GUI). Here's a real-life example of a query that works well for me to return rows of elements found WITHIN the XML file: for $song in collection("OpenSongSearch") where $song/song/lyrics[ . contains text "baloche"] or $song/song/title[ . contains text "baloche"] or $song/song/author[ . contains text "baloche"] order by $song/song/title return concat($song/song/title,string('|'),$song/song/author,string('|'),replace(re place($song/song/lyrics,'\n','^line^'),'\[\w+\]',''),string('
')) The program that invokes the BaseX call parses these results to put into a listbox in a dialog. The only thing that I knew to try to add the "doc" node was: return concat($song/doc,string('|'), $song/song/title,string('|'),$song/song/author,string('|'),replace(replace($ song/song/lyrics,'\n','^line^'),'\[\w+\]',''),string('
')) This did not give me an error but simply added the additional vertical bar at the beginning and no "doc" node info. I know this is more of a XQuery question than a BaseX question per se, but any hints for novice would be greatly appreciated. Thanks! <mailto:david@leighweb.com> DavidEmailSig

1 0

Force default file type to XML during "add to" command?
by Chad Lancour 02 Feb '11

02 Feb '11

Hello- Just want to start out with KUDOS on the project, contributors, and technology. Amazing. We are importing 300K+ xml & binary files from a file system with 30k in nested hierarchical folder structures into basex. The auto-magical capabilities of basex to suck in this data (and the speed at which is does it) is kick-a%$. Question: All of the 300k+ xml files do NOT have a file extension. Is there a way to have BaseX default to xml if there is no file type? Is there perhaps some other way to handle this other than recursively renaming all the files? Fyi -Here is the simple batch file I am using to import the data: java -Xmx1024m -cp %devbase%\basex65\BaseX.jar org.basex.BaseX -Vc "drop db metadata" java -Xmx1024m -cp %devbase%\basex65\BaseX.jar org.basex.BaseX -Vc "create db metadata; alter user admin xxxxxxx" java -Xmx1024m -cp %devbase%\basex65\BaseX.jar org.basex.BaseX -Vc "open metadata; SET INTPARSE ON; add to \set1 %devbase%\code\basex\import\webcat" java -Xmx1024m -cp %devbase%\basex65\BaseX.jar org.basex.BaseX -Vc "open metadata; SET INTPARSE ON; add to \set2 %devbase%\code\basex\import\rpd" java -Xmx1024m -cp %devbase%\basex65\BaseX.jar org.basex.BaseX -Vc "open metadata; create index text; create index attribute; create index fulltext; create index path" Regards, Chad chad(a)helmetcameracentral.com

3 5

Questions concerning backups
by Fabrice Etanchaud 31 Jan '11

31 Jan '11

Dear all at DBIS, the SHOW BACKUPS command does not seem to work. Is there a way to choose which backup to restore ? best regards, Fabrice Etanchaud Senior Software Engineer CT Corsearch / Edital, a Wolters Kluwer business Berkenlaan 1 1831 Diegem Belgium <skype:fabrice.etanchaud?call> skype:fabrice.etanchaud Get Skype <http://www.skype.com/go/download> and call me for free. fetanchaud(a)edital.com <mailto:fetanchaud@edital.com> <http://www.edital.com/> www.edital.com (website) <http://www.ctcorsearch.com/> www.ctcorsearch.com (website) Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

BaseX 6.5.1 - BaseXGUI - error in Manage/Restore when database name contains hyphens
by Fabrice Etanchaud 31 Jan '11

31 Jan '11

Dear all, It seems there is an error in the BaseXGUI/Manage/Restore menu when restoring a dabase whose name contains hyphens. Changing hyphens to underscores solves the problem. Maybe because hyphen was chosen as information separator in the backup filename (mydbname-2011-01-31-11-54-20.zip). best regards, Fabrice Etanchaud Senior Software Engineer CT Corsearch / Edital, a Wolters Kluwer business Berkenlaan 1 1831 Diegem Belgium <skype:fabrice.etanchaud?call> skype:fabrice.etanchaud Get Skype <http://www.skype.com/go/download> and call me for free. fetanchaud(a)edital.com <mailto:fetanchaud@edital.com> <http://www.edital.com/> www.edital.com (website) <http://www.ctcorsearch.com/> www.ctcorsearch.com (website) Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

1 0

Problems using Python API and resolution (RuntimeError: maximum recursion depth exceeded)
by Jan Vlčinský (CAD) 31 Jan '11

31 Jan '11

Hi I was trying to use new Python API, looking forward to use binding variables, but all my calls were failing File "D:\var\projects\BaseXFilter\TomTom\BaseXClient.py", line 96, in receive return self.receive() File "D:\var\projects\BaseXFilter\TomTom\BaseXClient.py", line 96, in receive return self.receive() File "D:\var\projects\BaseXFilter\TomTom\BaseXClient.py", line 96, in receive return self.receive() File "D:\var\projects\BaseXFilter\TomTom\BaseXClient.py", line 96, in receive return self.receive() File "D:\var\projects\BaseXFilter\TomTom\BaseXClient.py", line 95, in receive self.init() RuntimeError: maximum recursion depth exceeded I compared old and new version of BaseXClient.py and noticed, that old calls readString() were changed to receive() And on line 96 is call to self.receive() inside of class method receive() so never ending call is here. Renaming receive call to readString as it used to be resolved the problem. Attached is corrected Python file. If you want to call it as usual, you shall rename it to BaseXClient.py Jan -- *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky

2 1

Re: [basex-talk] DB comuni
by Christian Grün 30 Jan '11

30 Jan '11

Hi Pablo (cc to the mailing list), sorry for the long delay; here's finally my detailed answer. I spent some time in revising the "AnyAllOptions" (any word, all words, phrase, ...), and I noticed that not all combinations delivered the expected scoring results. The issue should now be solved; feel free to tell me if you need a jar build of the latest build; or check out the latest version from the repository. > Hello Christian, thanks por you prompt response. Enclosed I > send you the Comuni file for Italy, that we use to perform the math of > others 32000, with the final purpose of validate its. > […] Thanks for reporting on your usage scenario. One way to speed up your queries might be to create a full-text index (note, however, that the AnyAllOptions are not supported by the index). The improved performance gain after the first call, which you observed, might be due to the caching of results. To get better performance, I'd recommend to switch to the client/server architecture of BaseX. Apart from that, it's difficult to give you general guidelines on how to handle your amounts of data. Some questions might have to be answered first, such as… – do you plan to store the data and perform repeated queries, or will you just process it once/on the fly? – what's the total size of your XML documents? how many documents/XML snippets will you look at? Hope this helps, Christian

1 0

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk