BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

New version for RBaseX
by Ben Engbers 13 Mar '20

13 Mar '20

Hi, I am glad that version 0.2.4 from my R-package 'RBaseX' has been accepted by CRAN (https://cran.r-project.org/package=RBaseX)! Large parts of the earlier version from the R-package 'RBaseX' have been rewritten and the resulting code is much cleaner. I have added tests and thanks to those test, I found (and fixed) several bugs. To my knowledge, the full server-protocol has now been implemented. One of the main differences concerns error-handling. All client-requests to the basexserver end with either a \00 byte or a \01. I have used this feature to add an extra layer of error-handling. The default is still the regular tryCatch method. But after setting 'intercept' to TRUE, you can now define your reaction upon errors. See the following example: Session <- BasexClient$new("localhost", 1984L, username = "admin", password = "admin") Session$set_intercept(TRUE) Session$Execute("drop DB TestDB") Session$Execute("Open TestDB") if (!Session$get_success()) { Session$Create("TestDB") Session$Add("Test.xml", "<Line_1 line='1'>Content 1</Line_1>") } Session$Execute("Close") Session$restore_intercept() I am already working on a new version in which I will implement more specific R-related topics (populating dataframes with XQuery-results. Ben

1 0

Re: [basex-talk] Should it be possible to declare a function in the client?
by Ben Engbers 03 Mar '20

03 Mar '20

Op 27-02-2020 om 22:03 schreef Majewski, Steven Dennis (sdm7g): > Also: is ‘(&nbsp;)’ what you want as part of you regex to also catch the ampersand ? > I’m just guessing your intent here. > You could also try ‘(\W|&nbsp;)+’ - i.e. non-word, but I’m kind of assuming that it handles non-normalized unicode accented characters correctly and reads them as word chars and not delimiters. That would be, of course, the right thing, but I’ld probably test it first. > > — Steve. I just copied the regex-expression from this page "https://en.wikibooks.org/wiki/XQuery/Tag_Cloud" (using regex always gives me headaches ;-( ). But even after removing the "|[n][b][s][p][;]" from the regex, basexgui still returns 5843. Ben

3 8

Huge No of XML files.
by Sreenivasulu Yadavalli 03 Mar '20

03 Mar '20

Hi Team, We have a big problem for creating the collection bcoz of large no of xmls. Every day we are moving collections around 55k to 60k no of xml files large account. Its taking more than 18 hours. At that time we want access the collection for generating report its on lock mode and scrip that collection. Please help and do needful. Regards, YSL

4 22

How to improve the efficiency of data storing and data retrieving
by Ramzi Hammouda 02 Mar '20

02 Mar '20

Hello BaseX team, First of all, thank you for giving such a tremendous effort to help BaseX users, we appreciate it. We’re developing an application that has the sole use of exchanging XML messages with other clients, we chose BaseX to store messages in their xml format and used its RESTful APIs to update the database. Currently storing data in one xml document in one database, but this is not efficient because with time the document will be very large, thus storing and retrieving data from it will take more time. * Can I select a number of xml nodes from the document without the rest? For example returning only the last 200 xml messages ? if yes how to make it happen with REST methods? I thought about the solution of using multiple documents, so there is the possibility of retrieving data from one document at a time, but didn’t find a way to make this process automatic because there are number of issues I didn’t find a solution for: * How can the application know the number and names of existing documents in the database , didn’t find an xquery for this. Can you suggest better solutions ? Thank you. P Respectons ensemble l'environnement. N'imprimez ce message que si nécessaire. Let's respect the environment together. Only print this message if necessary.

2 1

Database specific xquery modules
by DYER Chris 02 Mar '20

02 Mar '20

I am looking for some ideas on some architecture surrounding xquery modules. Our situation is that we have multiple client applications in various languages that will connect to a database. We will have some reasonably complex xqueries to extract data in certain structures that will be used by each of these clients. So to avoid having to duplicate the query logic we would like the xqueries to reside "in" the database. Additionally, we would like to use the same BaseX installation for multiple databases, corresponding to multiple projects. The data in each of these databases may be against a different schema and our xqueries are essentially tied to the schema of the data. Thus, each database may need slightly different xqueries. The xquery library modules looks to be global for the BaseX instance, as does the loading of main modules off of disk. Is there any way to tie the query module or file to a specific database? We are trying to avoid being limited to 1 database per BaseX instance. An alternative would be to embed the xqueries within our client applications, but that involves duplication. Also, we are not sure if there are any performance difference with having the queries stored in the repo vs client side? For background, we are looking at migrating from oracle to BaseX. So, we are effectively looking for an equivalent of multiple clients connecting to a userspace and using stored procedures which are specific to that userspace. Any ideas on how to achieve this currently? Or is this something that BaseX could support? Cheers, Chris

5 20

Broken links to papers on http://basex.org/about/publications/
by Majewski, Steven Dennis (sdm7g) 28 Feb '20

28 Feb '20

Links to papers on http://basex.org/about/publications/ <http://basex.org/about/publications/> are broken. It looks like the URL string is broken off early at the first whitespace character. I can access directory http://files.basex.org/publications/ <http://files.basex.org/publications/> And it looks like the entire text in parenthesis should be the filename in the URL. — Steve M.

2 1

DB with MS Word .docx files breaks on base-uri()
by Majewski, Steven Dennis (sdm7g) 28 Feb '20

28 Feb '20

With a database containing MS Word .docx zip (and other) files: collection('BOV') ! base-uri(.) Returns => Error: Stopped at ., 1/29: [XQST0046] URI '/BOV/DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/[Content_Types].xml' is invalid. I’m guessing it doesn’t like the brackets as part of a URI, but since I’m adding the whole docx container, I can’t specify a different path when creating the DB. collection('BOV') ! db:path(.) However, works as a workaround: DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/[Content_Types].xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/_rels/.rels DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/_rels/document.xml.rels DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/document.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/footer3.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/header1.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/footer1.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/endnotes.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/footnotes.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/_rels/header1.xml.rels DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/header2.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/_rels/footer2.xml.rels DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/footer2.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/theme/theme1.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/settings.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/styles.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/customXml/itemProps1.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/numbering.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/customXml/_rels/item1.xml.rels DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/customXml/item1.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/docProps/core.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/fontTable.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/webSettings.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/word/stylesWithEffects.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.docx/docProps/app.xml DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.tei DCP-66/2015_AUG_BOV_RETREAT_MINS/2015_AUG_BOV_RETREAT_MINS.dc.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/[Content_Types].xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/_rels/.rels DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/_rels/document.xml.rels DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/document.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/footer3.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/header1.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/footer2.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/footer4.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/footer1.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/footnotes.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/endnotes.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/theme/theme1.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/settings.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/styles.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/numbering.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/customXml/_rels/item1.xml.rels DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/customXml/itemProps1.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/customXml/item1.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/docProps/core.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/fontTable.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/word/webSettings.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.docx/docProps/app.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.dc.xml DCP-66/2010_FEB_BOARD_MINUTES/2010_FEB_BOARD_MINUTES.tei ...

2 1

jobs
by Ветошкин Владимир 27 Feb '20

27 Feb '20

2 3

Call for assistance : BaseX as a preprocessor ?
by maxzor 27 Feb '20

27 Feb '20

Hello, Thank you for your software which GUI has been my savior every time I needed to deal with XML. I would like to know if I can stream xml transforms, to pipe wikimedia XML dumps into a format acceptable by postgres copy ? I know very well SQL, but nothing about XPath or XQuery I managed to mock a XPath (or is it XQuery ? :/) snippet from postgres itself, but obviously this would need rewriting for basex CLI : https://stackoverflow.com/questions/60361030/how-to-transform-and-stream-la… Best regards, Maxime Chambonnet

4 5

Should it be possible to declare a function in the client?
by Ben Engbers 27 Feb '20

27 Feb '20

Hi, My RBaseX client is finally stable enough to use it for real development. All regular commands are executed without errors. But now I am facing another problem. In a client-session, I want to use the following function: fn_get_words_txt <- "declare function local:cloudWords( $Veld as xs:string) as xs:string* { let $base := collection('IncidentRemarks/Incidents')/csv/record let $txt := string-join( $base/*[name() = $Veld]/text(), ' ') let $words := tokenize($txt,'(\\s|[,.!:;]|[n][b][s][p][;])+') return ($words)};" (Doubling the '\' in the regular expression-string is R-specific.) Session$Execute(fn_get_words_txt) returns: Gestopt bij , 1/8: Onbekend commando: declare. Probeer 'help'. Error in Session$Execute(fn_get_words_txt) : Gestopt bij , 1/8: Onbekend commando: declare. Probeer 'help'. fn_get_words_Query <- Session$Query(fn_get_words_txt) fn_get_words_Query$queryObject$ExecuteQuery() returns: Error in private$default_query_pattern(match.call()[[1]]) : Gestopt bij ., 5/20: [XPST0003] Expecting expression. Since fn_get_words_txt neither represents a regular command nor a regular function-all, I understand these errors. Before I even start trying to implement this in my package, my question is if it should be able to create local functions for that session? If so, any idea how to tackle this problem? Could the problem be genaralized to the question how a prolog can be added or changed? Cheers, Ben

3 6

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk