- BaseX-Talk - mailman.uni-konstanz.de

A first RESTXQ function
by Nicholas 21 Nov '20

21 Nov '20

For this example: module namespace page = 'http://basex.org/examples/web-page'; declare %rest:path("hello/{$who}") %rest:GET function page:hello($who) { <response> <title>Hello { $who }!</title> </response> }; https://docs.basex.org/wiki/RESTXQ where/how is this function stored or saved? thanks, Nick

2 2

testing of updating functions in basex
by dudzikp＠yahoo.com 18 Nov '20

18 Nov '20

Dear all, I have not found a way to make basex unit module to test updating functions. I have a function site:add-movies which results in several db:add instructions. I try to achieve something like: declare %unit:test %updating function test-site:download-movies() { let $result := site:add-movies( $test-site:site-db, test-site:fake-fetch-file#1, 7 ) return unit:assert-equals(1, 1) (: here I am going to check if db contains expected elements :) }; But let command is not valid for updating expression. Basex docs mention something about update:output and update:cache which may be of some use here but no exhaustive example is given for. Anyone had similar problem? BR

2 2

importing data from powershell
by Nicholas 18 Nov '20

18 Nov '20

for some simple data as: PS /home/nicholas> PS /home/nicholas> $data = @{ >> customer = 'something' >> name = 'whatever' >> } PS /home/nicholas> PS /home/nicholas> ($data | ConvertTo-Xml).OuterXml <?xml version="1.0" encoding="utf-8"?><Objects><Object Type="System.Collections.Hashtable"><Property Name="Key" Type="System.String">name</Property><Property Name="Value" Type="System.String">whatever</Property><Property Name="Key" Type="System.String">customer</Property><Property Name="Value" Type="System.String">something</Property></Object></Objects> PS /home/nicholas> what would be some different ways of importing this data into BaseX? Certainly, the above XML can simply be written to a file, but what might something, from within powershell, a bit more automated? thanks, Nick

2 1

- in comments
by Giuseppe G. A. Celano 17 Nov '20

17 Nov '20

Hi, /data() is printed as - , while "-” as - (even if both are xs:string): is there a reason? In any case, is there a function to convert  into - ? Thanks. Best, Giuseppe

2 1

BaseX GUI and remote editing
by Marco Lettere 16 Nov '20

16 Nov '20

Hello all! We are in the slightly uncomfortable condition to do some remote coding. Means write XQ code that has to be kept on a server different from our PCs. We don't want to slow down our very agile development workflow by passing everytime from a Git repo ... Has anyone here some experience with remote editing of this kind? Using BaseX Gui is out of discussion, isn't it? Thanks, Marco.

4 4

Dr. Mike Kay's proposals for XPath and XQuery 4.0
by Bridger Dyson-Smith 16 Nov '20

16 Nov '20

Hi all - I imagine that Dr. Kay has posted about this in multiple places, but I don't know if he's posting on the BaseX list much. He shared the following links with his thoughts on XPath, XSLT, XQuery, and F&O version 4.0 [1] - I don't know how many implementers we have on this list, outside of Christian and co., but thought you all might find it interesting. Hope everyone is having a lovely day. Best, Bridger PS I found this announcement on the XML.com Slack channel, fyi. [1] Mike Kay's post from Slack: I've been working on fleshing out my ideas for XSLT/XPath 4.0, based on my XML Prague paper earlier this year. I'm hoping to gather together a community group of some kind to take this forward; meanwhile I've published a very preliminary set of drafts: XSLT: https://www.saxonica.com/qt4specs/XT/Overview-diff.html F&O: https://www.saxonica.com/qt4specs/FO/Overview-diff.html XPath: https://www.saxonica.com/qt4specs/XP/xpath-40-diff.html XQuery: https://www.saxonica.com/qt4specs/XQ/xquery-40-diff.html Preparing for the rotten tomatoes: let me know what you think and whether you want to participate. NOTE: each document has a summary of changes at the end. It's probably best to go there first.

4 4

Bind context to stdin: -i-
by Majewski, Steven Dennis (sdm7g) 14 Nov '20

14 Nov '20

I just thought I would share this, as it was non-obvious to me. I wanted to use xpath expressions in a shell script pipeline, and was looking to see if there was a way to bind context to stdin. It wasn’t clear from the documentation, so I just tried the common convention of using “-“ and: Pipeline commands producing XML output “| basex -i- “ followed by a path or query works! And it works better that the PERL xpath command. — Steve Majewski

1 0

grouping by fuzzy match?
by Graydon Saunders 12 Nov '20

12 Nov '20

Hello -- Is there some way to assign the abstraction of a fuzzy match to a variable, so that something like for $x in //p let $key := get-fuzzy-match-value($x) group by $key return <similar-paragraphs>{$x}</similar-paragraphs> would be possible? I'm supposing this is one of those things that's either easy or impossible. Thanks! Graydon

7 12

Progress bar
by Giuseppe G. A. Celano 11 Nov '20

11 Nov '20

I have written a BaseX script (which applies a few functions to files in a directory), which I run at the command line. Is there a "trick" to get a progress bar for that (other than calling BaseX from a different programming language having some progress bar library)? Thanks. Best, Giuseppe

2 3

Versioning in BaseX
by Rob 10 Nov '20

10 Nov '20

Hi all, I first created an Github Issue for this question, but that’s not the right play :) So hereby my question: I was wondering how versioning works in BaseX. So I have a XML file, I store another version of that same XML file and within BaseX there is some kind of versioning so I can retrieve both versions of the XML file. I look into your mail archive, and I found the following mail: https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg07369.ht… <https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg07369.ht…> Here it states that with using database metadata (Database Module, https://docs.basex.org/wiki/Database_Module <https://docs.basex.org/wiki/Database_Module>), you can achieve versioning. But I don't see anything about it in the documentation. So I was wondering if it is a thing in BaseX (versioning), and how it's accomplished 👍 Thanks! Kind regards, Rob Tjalma

3 5

archive:extract-text($archive, $entries) not returning all expected items
by James Ball 01 Nov '20

01 Nov '20

Hello, I’m getting unexpected results using the Archive module when extracting multiple entries in one call: archive:extract-text($archive,$entries) For example what I’m doing is taking an archive with, say, 1000 entries, selecting a subset of those, say 100, and then calling archive:extract-text with that subset. I’d expect to get 100 results but I get perhaps 97. I know that all the content is in the archive - if I try to extract one of the missing items directly it’ll be returned. It seems to be an issue asking for lots at once. Has anyone come across this? What is staring me in the face that I’m missing? I’ve put a small SSCE at the end of this message that shows the issue - I get something like this returned: "Entries found: 100 Number of content items returned (bulk): 97 Number of content items returned (individual): 100" Many thanks for any help. Regards, James Running BaseX 9.4, 9.4.3 on macOS. let $zipPath := "demo.zip" let $start := 0 let $number := 100 (: Create a zip file with 1000 entries - each entry being just a UUID as the same path :) let $uuids := (1 to 1000) ! random:uuid() let $zipOut := file:write-binary($zipPath,archive:create($uuids,$uuids)) (: Read the zip file :) let $archive := file:read-binary($zipPath) (: Get all the entries that meet the criteria - here based on position :) let $entries := archive:entries($archive)[$start < position() and position() <= $start+$number] let $count := count($entries) let $contents := archive:extract-text($archive,$entries) let $contents2 := for $entry in $entries return archive:extract-text($archive,$entry) return concat( "Entries found: ", count($entries), " Number of content items returned (bulk): ", count($contents), " Number of content items returned (individual): ", count($contents2) )

3 3

Afmelden
by Ben Engbers 01 Nov '20

01 Nov '20

Ik ben me er niet van bewust dat ik me ooit aangemeld heb voor 'redhetpensioenstelsel' en kan me ook niet voorstellen dat ik een account aangemaakt heb. Wel weet ik dat ik met regelmaat lastig gevallen worden door deze lijst. Kunt u het adres 'Ben.Engbers(a)Be-Logical.nl' verwijderen van de lijst? Ben Engbers

1 0

Docker Image fails on initialization
by Moishy Uminer 22 Oct '20

22 Oct '20

Hi, I downloaded the basex/basexhttp docker image, and upon running docker run --name basexhttp basex/basexhttp:latest --publish 8984:8984 --volume "$HOME/basex/data":/srv/basex/data I received the following error message: /usr/local/bin/mvn-entrypoint.sh: exec: line 50: illegal option -- after which the container exits. Did I do something wrong (in which case I'll be happy to hear of my error), or is this a bug (in which case I'd appreciate it if this were fixed). Thanks in advance!

3 2

Re: [basex-talk] BaseX-Talk Digest, Vol 130, Issue 13
by Rob Stapper 21 Oct '20

21 Oct '20

I see that my attachment is missing, so I'll try again. And for extra I'll drop the code her in the mail too. Here we go: ------------------------------------------------------------------------------ [1] "test.xqm" import module namespace BASE-TYPE = "BASE-TYPE" at "./BASE-TYPE.xqm" ; let $object := 12 return $object => $BASE-TYPE:method_1( ) -------------------------------------------------------------------------- [2] "BASE-TYPE.xqm" module namespace BASE-TYPE = "BASE-TYPE" ; import module namespace SUPER-TYPE = "SUPER-TYPE" at "./SUPER-TYPE.xqm" ; declare variable $BASE-TYPE:method_1 := BASE-TYPE:method_1#1 ; declare %private function BASE-TYPE:method_1( $i) { if ( $i > 0) then ( $i,( $i - 1) => $SUPER-TYPE:method_1( )) else () } ; ----------------------------------------------------------------------- [3] "SUPER-TYPE.xqm" module namespace BASE-TYPE = "SUPER-TYPE" ; import module namespace SUPER-TYPE = "SUPER-SUPER-TYPE" at "./SUPER-SUPER-TYPE.xqm" ; declare variable $BASE-TYPE:method_1 := BASE-TYPE:method_1#1 ; declare %private function BASE-TYPE:method_1( $i) { if ( $i > 0) then ( $i,( $i - 1) => $SUPER-TYPE:method_1( )) else () } ; ------------------------------------------------------------------------------------------------------------------------- [4] "SUPER-SUPER-TYPE.xqm" module namespace BASE-TYPE = "SUPER-SUPER-TYPE" ; import module namespace SUPER-TYPE = "BASE-TYPE" at "./BASE-TYPE.xqm" ; declare variable $BASE-TYPE:method_1 := BASE-TYPE:method_1#1 ; declare %private function BASE-TYPE:method_1( $i) { if ( $i > 0) then ( $i,( $i - 1) => $SUPER-TYPE:method_1( )) else () } ; -------------------------------------------------------------------------------------------------------------------------- Yes, the content of the module-files is identical except for the imported module-file. Best, Rob > Op 21-10-2020 12:00 schreef basex-talk-request(a)mailman.uni-konstanz.de: > > > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. recursively used variables (Rob Stapper) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 20 Oct 2020 17:19:36 +0200 > From: Rob Stapper <r.stapper(a)lijbrandt.nl> > To: "basex-talk(a)mailman.uni-konstanz.de" > <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] recursively used variables > Message-ID: <aa8b70e7-12e7-11eb-8513-005056998788(a)smtp.kpnmail.nl> > Content-Type: text/plain; charset="utf-8" > > Hi, > > For those who follow this discussion and find it an interesting case, hereby an example of the problem I?m facing. > > The example throws an error: Static variable depends on itself: ?? > > The example concerns a 3-step cyclic construct: > ?BASE-TYPE.xqm? -> ?SUPER-TYPE.xqm? -> ?SUPER-SUPER-TYPE.xqm? -> ?BASE-TYPE.xqm?, > starting of from ?test.xq?. > > I need the solution to comply with four rules: > - The module-functions must be %private and may only be addressed from outside the module through a public module-$variable. This way inheritance between modules can simply be implemented by the use of variables. > - The internal structure of a module-function must be completely hidden for use outside the module. So if the module-function calls another function it is not allowed to pass this called upon function or its name in the module-function?s parameterlist. That is why I can?t use Leo solution here. > - The 3-step cycle structure can not be changed. > - I need a generic solution. > > The solution is of course that it just works; Christian is having a look at it, but I thought it an interesting enough case to share and maybe somebody comes up with an solution that does complies to these rules as a temporary ? work around. My solution for the time being is violating my first rule. > > Have fun, > Rob Stapper > > PS for using the example, just extract it and copy the extracted directory in BaseX?s src-directory. Start "test.xq? from within BaseX and it should work > > Sent from Mail for Windows 10 > > > > -- > This email has been checked for viruses by Avast antivirus software. > https://www.avast.com/antivirus >

1 0

recursively used variables
by Rob Stapper 20 Oct '20

20 Oct '20

Hi, For those who follow this discussion and find it an interesting case, hereby an example of the problem I’m facing. The example throws an error: Static variable depends on itself: …… The example concerns a 3-step cyclic construct: “BASE-TYPE.xqm” -> “SUPER-TYPE.xqm” -> “SUPER-SUPER-TYPE.xqm” -> “BASE-TYPE.xqm”, starting of from “test.xq”. I need the solution to comply with four rules: - The module-functions must be %private and may only be addressed from outside the module through a public module-$variable. This way inheritance between modules can simply be implemented by the use of variables. - The internal structure of a module-function must be completely hidden for use outside the module. So if the module-function calls another function it is not allowed to pass this called upon function or its name in the module-function’s parameterlist. That is why I can’t use Leo solution here. - The 3-step cycle structure can not be changed. - I need a generic solution. The solution is of course that it just works; Christian is having a look at it, but I thought it an interesting enough case to share and maybe somebody comes up with an solution that does complies to these rules as a temporary 😉 work around. My solution for the time being is violating my first rule. Have fun, Rob Stapper PS for using the example, just extract it and copy the extracted directory in BaseX’s src-directory. Start "test.xq” from within BaseX and it should work Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

1 0

Re: [basex-talk] recursively used variables
by Rob Stapper 20 Oct '20

20 Oct '20

Hi Leo, Thank you for your reply. I’m aware of these kind of solutions, I use them frequently allthough I have to admit that these slipped my mind here. Great solutions by the way. But getting the code working is not my problem. What I’m looking for is a generic solution for some sort of inheritance mechanism( see attachment for an example). The code-snippet is just meant to supply the BaseX-team with an basic executable example of the bare issue. I’m not even sure if it is a bug because I don’t know if it is behavior by design. But now the BaseX-team is aware of the situation. Probably I should have said that the functions can be activated cyclically in stead of just recursively. Where cyclical can be interpret as indirect recursive. And in that case the solution doesn’t hold. Best, Rob Sent from Mail for Windows 10 From: Leo Studer Sent: Monday, October 19, 2020 7:19 PM To: Rob Stapper Subject: Re: [basex-talk] recursively used variables … and you do not even need the variable declare %private function local:test( $i, $test) { if ( $i > 0) then ($i, $test( $i - 1, $test)) else() } ; local:test( 10, local:test#2) Cheers Leo On 8 Oct 2020, at 14:17, Rob Stapper <r.stapper(a)lijbrandt.nl> wrote: Hi, The code[1] below and send as attachment generates a error message: “Static variable depends on itself: $Q{http://www.w3.org/2005/xquery-local-functions}test”. I use these variables to refer to my private functions in my modules so I can easyly refer to them in a inheritance situation. It’s not a big problem for me but I was wondering if the error-triggering is justified or that it should work. [1]=========================================== declare variable $local:test := local:test#1 ; declare %private function local:test( $i) { if ( $i > 0) then $local:test( $i - 1) } ; $local:test( 10) =========================================== Kind regards, Rob Stapper Sent from Mail for Windows 10 Virus-free. www.avast.com <test.xq> -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 1

stemming chinese texts
by Duncan Paterson 19 Oct '20

19 Oct '20

Dear Christian, I’d be happy to chime in on the quality of basexs Chinese language full-text capabilities. Chinese sources are my primary research area. What exactly do you have in mind? Greetings Duncan Ceterum censeo exist-db.org esse conriganda > > > Today's Topics: > > 1. Re: stemming chinese texts (Philippe Pons) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 14 Oct 2020 12:30:59 +0200 > From: Philippe Pons <philippe.pons(a)college-de-france.fr> > To: basex-talk(a)mailman.uni-konstanz.de > Subject: Re: [basex-talk] stemming chinese texts > Message-ID: > <d40e4b6e-29ab-f62f-1617-505db18e96a2(a)college-de-france.fr> > Content-Type: text/plain; charset="windows-1252"; Format="flowed" > > Hi Christian, > > I suppose some of my colleagues would be able to judge the quality of > your full-text search results. > > On the other hand, on code level, I'm not sure I know how to implement > an additionnal class that extends abstract Tokenizer class. > > Thank you for your help > Philippe > > > Le 14/10/2020 ? 11:00, Christian Gr?n a ?crit?: >> Hi Philippe, >> >> Thanks for your mail in private, in which I already gave you a little >> assessment on what might be necessary to include the CJK tokenizers in >> BaseX: >> >> The existing Apache code can be adapted and embedded into the BaseX >> tokenizer infrastructure. On code level, an additional class needs to >> be implemented that extends abstract Tokenizer class [1]. >> >> As far as I can judge, the 3 Lucene CJK analyzers could all be applied >> to traditional and simplified Chinese. If we found someone who could >> rate the linguistic quality of our full-text search results, that?d >> surely be helpful. >> >> Hope this helps, >> Christian >> >> [1] https://github.com/BaseXdb/basex/blob/master/basex-core/src/main/java/org/b… >> >> >> >> On Tue, Oct 13, 2020 at 12:32 PM Philippe Pons >> <philippe.pons(a)college-de-france.fr> wrote: >>> Dear Christian, >>> >>> Thank you very much for this quick and enlightening response. >>> >>> Without having had (yet) the opportunity to test it, I have indeed read the Japanese text tokenizer. >>> Supporting Chinese tokenization would also be a great help. >>> >>> I have never tested what Lucene offers, especially since I have to manage texts in traditional Chinese and simplified Chinese (without reading either one myself). >>> I would like to test Lucene's analyzers, but I don't know how to do it in BaseX? >>> >>> Best regards, >>> Philippe Pons >>> >>> >>> >>> Le 12/10/2020 ? 12:01, Christian Gr?n a ?crit : >>> >>> Dear Philippe, >>> >>> As the Chinese language rarely uses inflection, there is usually no >>> need to perform stemming on texts. However, tokenization will be >>> necessary indeed. Right now, BaseX provides no tokenizer/analyzer for >>> Chinese texts. It should be possible indeed to adopt code from Lucene, >>> as we?ve already done for other languages (our software licenses allow >>> that). >>> >>> Have you already worked with tokenization of Chinese texts in Lucene? >>> If yes, which of the 3 available analyzers [1] have proven to yield >>> the best results? >>> >>> As you may know, one of our users, Toshio HIRAI, has contributed a >>> tokenizer for Japanes texts in the past [2]. If we decide to include >>> support for Chinese tokenization, it might as well be interesting to >>> compare the results of the Apache tokenizer with our internal >>> tokenizer. >>> >>> Cordiales salutations, >>> Christian >>> >>> [1] https://lucene.apache.org/core/7_2_0/analyzers-common/org/apache/lucene/ana… >>> [2] https://docs.basex.org/wiki/Full-Text:_Japanese >>> >>> >>> >>> On Mon, Oct 12, 2020 at 11:37 AM Philippe Pons >>> <philippe.pons(a)college-de-france.fr> wrote: >>> >>> Dear BaseX Team, >>> >>> I'm actually working on chinese texts in TEI. >>> I would like to know if stemming chinese text is possible in BaseX, as we can do with other languages (like english or deutsch)? >>> Or maybe there is a way to add this functionnality with Lucene? >>> >>> Best regards, >>> Philippe Pons >>> >>> -- >>> Ing?nieur d'?tude charg? de l'?dition de corpus num?riques >>> Centre de recherche sur les civilisations de l'Asie Orientale >>> CRCAO - UMR 8155 (Coll?ge de France, EPHE, CNRS, PSL Research University, Univ Paris Diderot, Sorbonne Paris Cit?) >>> 49bis avenue de la Belle Gabrielle >>> 75012 Paris >>> https://cv.archives-ouvertes.fr/ppons >>> >>> > >

2 2

Re: [basex-talk] Dpi scaling problem - Ubuntu 20.04
by Bridger Dyson-Smith 18 Oct '20

18 Oct '20

Hi Hugo - [responding to the list, too, because I'm well-known for missing the obvious! :)] On Thu, Oct 15, 2020 at 4:26 PM Silamphre <hugoscheithauer(a)gmail.com> wrote: > Hi Bridger, > > Thank you for your kind reply and your assistance. I have tried using that > command directly in the Ubuntu terminal, but unfortunately it works only > when I set the value to 2, which is way too big for an interface aha. It > seems to only be working with integers. > I'll try editing the script, but since it refers to a java program and I'm > not familiar with it, do you know if I can just copy that command line in > the script, or if I need to write a more specific command line ? > > On a different OS, I had problems with JDK font rendering, so I was adding flags like this to BaseX in the `basexgui` script like so: ```shell # Run code exec java -cp "$CP" -Dsun.java2d.uiScale=2.0 $BASEX_JVM org.basex.BaseXGUI "$@" ``` i.e. adding the flag *after* the `-cp`/classpath flag in the command. I just tried this on my current Linux system, and by bumping the number a bit, I did increase some of the scaling, but only in the editor pane of the GUI; i.e. I noticed the scaling particularly in the tabs. To be honest, I'm not sure what to make of that, or how to take a different approach. Maybe Christian or another use can give us some insights. > Thank you again. > You are most welcome. Sorry that we couldn't get it completely solved. Kind regards, > Hugo > > Best, Bridger > Le jeu. 15 oct. 2020 à 19:32, Bridger Dyson-Smith <bdysonsmith(a)gmail.com> > a écrit : > >> Hi Silamphre, >> >> I'm not sure if this will help or not, but editing the `basexgui` script >> to include `-Dsun.java2d.uiScale=1.25` might help[1]? I confess that I >> don't have UI scaling enabled on my unix-like system, or maybe you've >> already tried that approach. >> Hope that helps! >> Best, >> Bridger >> >> [1] >> https://stackoverflow.com/questions/58699877/how-to-fix-scaling-of-a-java-b… >> >> On Thu, Oct 15, 2020 at 12:06 PM Silamphre <hugoscheithauer(a)gmail.com> >> wrote: >> >>> Hello everyone, >>> >>> I started using BaseX for a class project a few days ago. I'd like to >>> run it on my Ubuntu 20.04. I've installed openjdk version 14 to do so. >>> >>> I've set my Ubuntu display settings at 125% fractional scaling, but it >>> appears that BaseX does not scale with this setting. The GUI consequently >>> appears really tiny, almost unusable. >>> >>> Does someone have a way to solve this issue, and make BaseX scales >>> accordingly to my Ubuntu display settings, please? >>> >>> Thank you for your help. >>> >>> Kind regards, >>> Hugo >>> >>> >>> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Garanti >>> sans virus. www.avast.com >>> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> >>> <#m_8249631326652388190_m_-8493036691201945712_m_240745489779756524_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> >>> >>

2 1

Packaging BaseX for the Chocolatey Package Manager
by Sacha Froment 18 Oct '20

18 Oct '20

Hello, I made a packaging script for the chocolatey package manager of the BaseX software. the script is freely available on this repo : https://github.com/sachahjkl/basex_chocolatey for reference, chocolatey : https://chocolatey.org/ Respectfully, Sacha Froment

2 1

Help with a function to return paths
by Bridger Dyson-Smith 16 Oct '20

16 Oct '20

Hi all - I hope you don't mind a question about serializing distinct XPaths. I'm trying to generate some reports for documentation and the available built-in and library functions[1] aren't quite what I need. The output I'm after is: test/aaa/bbb[@type="foo"] test/aaa/bbb[@type="foo"][@enc="bar"] test/aaa/bbb[@type="bzz"][@enc="bar"] test/aaa/bbb[@type="qux"][@enc="bar"][@key="yes"][@point="start"] test/aaa/bbb[@type="qux"][@enc="bar"][@key="yes"][@point="end"] I have a couple of functions that are getting me close, but I can't quite manage the output strings, and multiple children are causing me trouble (entirely too much like real life). Any help or suggestions would be greatly appreciated. I've created a gist[2] with the following example: Thanks very much for your time and trouble. Best, Bridger ```xquery xquery version "3.1"; declare variable $input := <test> <aaa> <bbb type="foo">bbb content</bbb> </aaa> <aaa> <bbb type="foo" enc="bar">bbb content</bbb> </aaa> <aaa> <bbb type="bzz" enc="bar">bbb content</bbb> <bbb type="qux" enc="bar" key="yes" point="start">bbb content</bbb> <bbb type="qux" enc="bar" key="yes" point="end">bbb content</bbb> </aaa> </test>; declare function local:elem( $nodes as node()* ) as xs:string* { for $node in $nodes return( string-join( if ($node/@*) then (string-join((name($node) || string-join(for $att in $node/@* return local:atty($att))), "/"), local:elem($node/child::*)) else if ($node/child::*) then (for $child in $node/child::* return local:elem($child), local:elem($node/child::*)) else (name($node) || "/" || local:elem($node/child::*)) ) ) }; declare function local:atty( $att as attribute() ) as xs:string* { "[@" || name($att) || "='" || data($att) || "']" }; local:e2($input (: this currently returns test/aaa/bbb[@type='foo']/ / /aaa/bbb[@type='foo'][@enc='bar']/ / /aaa/bbb[@type='bzz'][@enc='bar']/ /bbb[@type='qux'][@enc='bar'][@key='yes'][@point='start']/ /bbb[@type='qux'][@enc='bar'][@key='yes'][@point='end']/ / :) ``` [1] fn:path, and the related functions from functx (functx:distinct-element-paths, functx:path-to-node, and functx:path-to-node-with-pos). The functx functions are really close and awesome, but I need to incorporate attributes into my output. [2] https://gist.github.com/CanOfBees/8cfb435ac06986c9b0b0c215a786f4d7

2 3

Dpi scaling problem - Ubuntu 20.04
by Silamphre 15 Oct '20

15 Oct '20

Hello everyone, I started using BaseX for a class project a few days ago. I'd like to run it on my Ubuntu 20.04. I've installed openjdk version 14 to do so. I've set my Ubuntu display settings at 125% fractional scaling, but it appears that BaseX does not scale with this setting. The GUI consequently appears really tiny, almost unusable. Does someone have a way to solve this issue, and make BaseX scales accordingly to my Ubuntu display settings, please? Thank you for your help. Kind regards, Hugo <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Garanti sans virus. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

2 1

Re: [basex-talk] stemming chinese texts
by Philippe Pons 14 Oct '20

14 Oct '20

Hi Christian, I suppose some of my colleagues would be able to judge the quality of your full-text search results. On the other hand, on code level, I'm not sure I know how to implement an additionnal class that extends abstract Tokenizer class. Thank you for your help Philippe Le 14/10/2020 à 11:00, Christian Grün a écrit : > Hi Philippe, > > Thanks for your mail in private, in which I already gave you a little > assessment on what might be necessary to include the CJK tokenizers in > BaseX: > > The existing Apache code can be adapted and embedded into the BaseX > tokenizer infrastructure. On code level, an additional class needs to > be implemented that extends abstract Tokenizer class [1]. > > As far as I can judge, the 3 Lucene CJK analyzers could all be applied > to traditional and simplified Chinese. If we found someone who could > rate the linguistic quality of our full-text search results, that’d > surely be helpful. > > Hope this helps, > Christian > > [1] https://github.com/BaseXdb/basex/blob/master/basex-core/src/main/java/org/b… > > > > On Tue, Oct 13, 2020 at 12:32 PM Philippe Pons > <philippe.pons(a)college-de-france.fr> wrote: >> Dear Christian, >> >> Thank you very much for this quick and enlightening response. >> >> Without having had (yet) the opportunity to test it, I have indeed read the Japanese text tokenizer. >> Supporting Chinese tokenization would also be a great help. >> >> I have never tested what Lucene offers, especially since I have to manage texts in traditional Chinese and simplified Chinese (without reading either one myself). >> I would like to test Lucene's analyzers, but I don't know how to do it in BaseX? >> >> Best regards, >> Philippe Pons >> >> >> >> Le 12/10/2020 à 12:01, Christian Grün a écrit : >> >> Dear Philippe, >> >> As the Chinese language rarely uses inflection, there is usually no >> need to perform stemming on texts. However, tokenization will be >> necessary indeed. Right now, BaseX provides no tokenizer/analyzer for >> Chinese texts. It should be possible indeed to adopt code from Lucene, >> as we’ve already done for other languages (our software licenses allow >> that). >> >> Have you already worked with tokenization of Chinese texts in Lucene? >> If yes, which of the 3 available analyzers [1] have proven to yield >> the best results? >> >> As you may know, one of our users, Toshio HIRAI, has contributed a >> tokenizer for Japanes texts in the past [2]. If we decide to include >> support for Chinese tokenization, it might as well be interesting to >> compare the results of the Apache tokenizer with our internal >> tokenizer. >> >> Cordiales salutations, >> Christian >> >> [1] https://lucene.apache.org/core/7_2_0/analyzers-common/org/apache/lucene/ana… >> [2] https://docs.basex.org/wiki/Full-Text:_Japanese >> >> >> >> On Mon, Oct 12, 2020 at 11:37 AM Philippe Pons >> <philippe.pons(a)college-de-france.fr> wrote: >> >> Dear BaseX Team, >> >> I'm actually working on chinese texts in TEI. >> I would like to know if stemming chinese text is possible in BaseX, as we can do with other languages (like english or deutsch)? >> Or maybe there is a way to add this functionnality with Lucene? >> >> Best regards, >> Philippe Pons >> >> -- >> Ingénieur d'étude chargé de l'édition de corpus numériques >> Centre de recherche sur les civilisations de l'Asie Orientale >> CRCAO - UMR 8155 (Collège de France, EPHE, CNRS, PSL Research University, Univ Paris Diderot, Sorbonne Paris Cité) >> 49bis avenue de la Belle Gabrielle >> 75012 Paris >> https://cv.archives-ouvertes.fr/ppons >> >>

1 0

stemming chinese texts
by Philippe Pons 14 Oct '20

14 Oct '20

Dear BaseX Team, I'm actually working on chinese texts in TEI. I would like to know if stemming chinese text is possible in BaseX, as we can do with other languages (like english or deutsch)? Or maybe there is a way to add this functionnality with Lucene? Best regards, Philippe Pons -- Ingénieur d'étude chargé de l'édition de corpus numériques Centre de recherche sur les civilisations de l'Asie Orientale CRCAO - UMR 8155 (Collège de France, EPHE, CNRS, PSL Research University, Univ Paris Diderot, Sorbonne Paris Cité) 49bis avenue de la Belle Gabrielle 75012 Paris https://cv.archives-ouvertes.fr/ppons

2 3

Re: [basex-talk] BaseX-Talk Digest, Vol 130, Issue 5
by Duncan Paterson 12 Oct '20

12 Oct '20

> I'm actually working on chinese texts in TEI. > I would like to know if stemming chinese text is possible in BaseX, as > we can do with other languages (like english or deutsch)? > Or maybe there is a way to add this functionnality with Lucene? > > Best regards, > Philippe Pons > Dear Philippe, if by stemming you mean the removal of prefixes and suffixes to arrive at normalized word stems, the concept simply doesn’t apply to Chinese, so no it can’t be done. What you are most likely looking for is the ability to tokenize strings into n-grams, which lucene can do. https://lucene.apache.org/core/6_6_1/analyzers-common/org/apache/lucene/ana… <https://lucene.apache.org/core/6_6_1/analyzers-common/org/apache/lucene/ana…> Greetings Duncan

1 0

XPTY0004 error when calling http:send-request inside of a local function
by Bridger Dyson-Smith 11 Oct '20

11 Oct '20

Hi all - I'm accustomed to writing something like the following: ```xquery declare function local:grab( $url as xs:string, $path as xs:string, $fname as xs:string ) as document-node() { let $req := http:send-request(<http:request method="get"/>, $url) return if (head($req)/@status = "200") then file:write($path || $fname, tail($req), map { "method": "xml" }) else ("something went wrong!") }; ``` but I've noticed that in version 9.4.3 this returns an XPTY error: Stopped at /home/bridger/bin/basex-src/basex-943-xpty0004-error.xq, 1/18: [XPTY0004] Cannot promote xs:string* to document-node(): (let $req_7 := http:send-request(<http:request method="get"/>, " https://dpla.lib.utk.edu/repox/OAIHa.... While this could be a bug, should I be writing this kind of local function differently? Or could I improve my typing on it? Thanks very much for any advice or insights you can provide. Best, Bridger

2 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk