BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5252 discussions

Accessing Flexmark (Java) from Query
by Andreas Mixich 21 Sep '20

21 Sep '20

Hi, how can I translate this Java[1] to XQuery according to [2]? package com.vladsch.flexmark.samples; import com.vladsch.flexmark.util.ast.Node; import com.vladsch.flexmark.html.HtmlRenderer; import com.vladsch.flexmark.parser.Parser; import com.vladsch.flexmark.util.data.MutableDataSet; public class BasicSample { public static void main(String[] args) { MutableDataSet options = new MutableDataSet(); // uncomment to set optional extensions //options.set(Parser.EXTENSIONS, Arrays.asList(TablesExtension.create(), StrikethroughExtension.create())); // uncomment to convert soft-breaks to hard breaks //options.set(HtmlRenderer.SOFT_BREAK, " \n"); Parser parser = Parser.builder(options).build(); HtmlRenderer renderer = HtmlRenderer.builder(options).build(); // You can re-use parser and renderer instances Node document = parser.parse("This is *Sparta*"); String html = renderer.render(document); // "This is Sparta\n" System.out.println(html); } } I only get so far as to: declare namespace Node = "com.vladsch.flexmark.util.ast.Node"; declare namespace HtmlRenderer =" com.vladsch.flexmark.html.HtmlRenderer"; declare namespace Parser = "com.vladsch.flexmark.parser.Parser"; declare namespace MutableDataSet = "com.vladsch.flexmark.util.data.MutableDataSet"; declare option db:checkstrings 'false'; let $mds := MutableDataSet:new() let $builder := Parser:builder($mds) return $builder which results in DataSet{dataSet={}} I found no documentation, on how to translate something as Parser.builder(options).build() to XQuery. How do I express the method build() of the instance Parser.builder(options) I just created? Also, when I try the other way, by importing, for the following code import module namespace Node = "java:com.vladsch.flexmark.util.ast.Node"; import module namespace HtmlRenderer = "java:com.vladsch.flexmark.html.HtmlRenderer"; import module namespace Parser = "java:com.vladsch.flexmark.parser.Parser"; import module namespace MutableDataSet = "java:com.vladsch.flexmark.util.data.MutableDataSet"; let $mds := MutableDataSet:new() I get: [XQST0059] Could not instantiate com.vladsch.flexmark.util.ast.Node: java.lang.InstantiationException. Could it be, that it is only possible to call static properties via [1]? Am I right, that I need to write wrapper code in Java and then prepare results in a way, that I can retreive them from my own Java class? Thank you. [1]: https://github.com/vsch/flexmark-java/blob/master/flexmark-java-samples/src… [2]: https://docs.basex.org/wiki/Java_Bindings [3]: https://github.com/vsch/flexmark-java -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

4 8

Re: [basex-talk] Full-Text-Search Options
by Günter Dunz-Wolff 19 Sep '20

19 Sep '20

Sorry, it was my fault. Problem solved. Sorry again. Kindly regards Guenter

1 0

Full-Text-Search Options
by Günter Dunz-Wolff 19 Sep '20

19 Sep '20

Dear all, I’m using ft:mark with Options. In older versions of basex it worked fine, but with 9.3 I don’t get any results with the „distance" option and the „not in“ option. Maybe my syntax is deprecated? Example distance: ft:mark($ele[.//text() contains text {$query_string} all using wildcards using diacritics sensitive distance at most $distance words]) Example "not in": ft:mark($ele[.//text() contains text {$query_tokens} using wildcards using diacritics sensitive not in {$dont_find} using wildcards using diacritics sensitive]) Any help is appreciated. Thanks Guenter

1 0

Fulltext Distancing
by Adam Law 16 Sep '20

16 Sep '20

(: Hello - I saw some discussions about full text indexing. Dumbo here cannot work out how distance matching works. Also is it somehow possible to traverse up and down a full-index word list from a hit position rather than having to spend time say reversing strings. Is this is not possible due to how the word indexing works? If so can I preprocess https://github.com/pierrec/lz4/blob/master/fuzz/corpus/Mark.Twain-Tom.Sawye… to break it into words. I was considering making something like DTSearch (but more flexible) before I realised how difficult this is. Many thanks Dumbo :) import module namespace functx = 'http://www.functx.com'; (:fulltext <x><content><![CDATA[ https://github.com/pierrec/lz4/blob/master/fuzz/corpus/Mark.Twain-Tom.Sawye… ]]></content></x>:) (:$f - return all nodes containing queer and enterprises:) let $f := <x>{ft:search('xvue_textIndex',("enterprises", "queer"), map { 'mode': 'all' })/parent::* }</x> let $options1 := map { 'mode': 'all'} let $options2 := map { 'mode': 'all', "distance": map { "max": "5","unit": "words" }} let $options3 := map { 'mode': 'all words', "distance": map { "max": "5","unit": "words" }} let $options4 := map { 'mode': 'all words', "distance": map { "max": 5, "unit": "words" }} let $options := $options1 (:Why wont others work:) (:$g - mark words queers and enterprises. Can't get options:2,3,4 to work:) let $g := <y>{ft:mark( $f//*[ft:contains(text(), ('queer','enterprises'), $options)], 'mark')}</y> (:Hopeful - with distancing will this result in queer enterprises. Otherwise I have to postprocess more:) (:Unsure about how to return words before and words after using fulltext. Have to limit to characters:) (:Ideally, I would like to be able to specify words after and before:) let $charbefore := 30 let $charafter := 30 (:This takes a while because I am string joining large preceding-sibling:nodes() (sometimes text() and sometimes marked/text()) to return words in context:)(:Three seconds:) (:Is there a fulltext way of doing this that is faster eg traverse a word list by match position:) let $h := for $w in $g//mark return <a><preceedingWords>{ functx:reverse-string (substring( functx:reverse-string(string-join($w/preceding-sibling::node())),0,$charbefore))}</preceedingWords><match>{$w/text()}</match><followingWords>{substring(string-join($w/following-sibling::node() ),0,$charafter)}</followingWords></a> return $h (: $h := <a> <preceedingWords>thought and talked, and what </preceedingWords> <match>queer</match> <followingWords> enterprises they sometimes e</followingWords> </a> <a> <preceedingWords>t and talked, and what queer </preceedingWords> <match>enterprises</match> <followingWords> they sometimes engaged in. </followingWords> </a> Sorry about the length of this. :)

2 3

Re: [basex-talk] Best way to re-create existing root element with all attributes
by Yitzhak Khabinsky 15 Sep '20

15 Sep '20

Hi Martin, Thanks for the answer. That's exactly what I was looking for. Regards, Yitzhak Khabinsky

1 0

html:parse() fails on webpage
by Andreas Mixich 15 Sep '20

15 Sep '20

Hi, when doing: html:parse(fetch:binary("https://ant.apache.org/manual/Tasks/chmod.html"), map{"method":"xml"}) and also html:parse(fetch:binary("https://ant.apache.org/manual/Tasks/chmod.html"), map{"method":"html"}) or html:doc("https://ant.apache.org/manual/Tasks/chmod.html") I get [html:parse] Line 23: </head> found, </link> expected. I use the BaseX version from 14 minutes ago ;-) (BaseX944-20200914.223814). -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 5

Repeating "bin/basexhttp -S" and "bin/basexhttpstop"
by AirQuick 15 Sep '20

15 Sep '20

Repeating "bin/basexhttp -S" and "bin/basexhttpstop" is no longer supported? On BaseX 9.4.1 and 9.4.2, you can repeat: $ java -version java version "1.8.0_261" Java(TM) SE Runtime Environment (build 1.8.0_261-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.261-b12, mixed mode) $ BaseX941/basex/bin/basexhttp -S /tmp/BaseX941/basex/.basex: writing new configuration file. BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @676ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX941/basex/bin/basexhttpstop BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @227ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). $ BaseX941/basex/bin/basexhttp -S BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @231ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX941/basex/bin/basexhttpstop BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @237ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). On 9.4.3, you can't: $ BaseX943/basex/bin/basexhttp -S /tmp/BaseX943/basex/.basex: writing new configuration file. BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @309ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX943/basex/bin/basexhttpstop BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @250ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). $ BaseX943/basex/bin/basexhttp -S BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @254ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.util.log - Logging initialized @225ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 1.8.0_261-b12 [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0 [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 600000ms [main] WARN org.eclipse.jetty.server.handler.ContextHandler.ROOT - unavailable org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.BaseXServer.<init>(BaseXServer.java:108) at org.basex.http.HTTPContext.init(HTTPContext.java:102) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1289) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:602) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:413) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:767) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:360) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1445) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:855) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:275) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:128) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) [main] WARN org.eclipse.jetty.webapp.WebAppContext - Failed startup of context o.e.j.w.WebAppContext@44f75083{BaseX: The XML Database and XQuery Processor,/,file:///tmp/BaseX943/basex/webapp/,UNAVAILABLE}{/tmp/BaseX943/basex/webapp} javax.servlet.ServletException: org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.http.BaseXServlet.init(BaseXServlet.java:39) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1289) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:602) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:413) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:767) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:360) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1445) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:855) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:275) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:128) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) Caused by: org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.BaseXServer.<init>(BaseXServer.java:108) at org.basex.http.HTTPContext.init(HTTPContext.java:102) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) ... 26 more Failed to bind to /0.0.0.0:8984 -- AirQuick

2 4

missing web.xml from docker image
by Nicholas Saunders 15 Sep '20

15 Sep '20

I've just opened an issue: https://github.com/BaseXdb/basex/issues/1936 based on an inability to run the docker image: https://devops.stackexchange.com/q/12338/23443 but thought I'd ask here if there might be something obvious. I'm creating the container from the hub image with: docker run -d \ --name basexhttp \ --publish 1984:1984 \ --publish 8984:8984 \ --volume "$HOME/basex/data":/srv/basex/data \ --volume "$HOME/basex/repo":/srv/basex/repo \ --volume "$HOME/basex/webapp":/srv/basex/webapp \ basex/basexhttp:latest and another person reported the missing file. Is the file missing? I'm not sure.

6 11

Best way to re-create existing root element with all attributes
by Yitzhak Khabinsky 13 Sep '20

13 Sep '20

Hello, This is input XML: <employee emp="1" dept="55"> <name>Peter</name> <job>Director</job> <employee emp="12" dept="26"> <name>John</name> <job>Animator</job> <employee emp="123" dept="27"> <name>James</name> <job>Assistant</job> </employee> </employee> </employee> Desired output XML: <employee emp="1" dept="55"> <name>Peter</name> <job>Director</job> </employee> Overall, it is a so called 'modified identity transformation' in XSLT parlance. Output XML shall be the same, except the child <employee> element and its children. Question: What is the best way to re-create existing root element with all its attributes? My implementation: xquery version "3.1"; declare context item := document { <employee emp="1" dept="55"> <name>Peter</name> <job>Director</job> <employee emp="12" dept="26"> <name>John</name> <job>Animator</job> <employee emp="123" dept="27"> <name>James</name> <job>Assistant</job> </employee> </employee> </employee> }; (: working version :) element {fn:node-name(/*)} { let $y := ./*/@* return $y, (: copy all attributes :) for $x in ./*/(* except employee) return $x } (: NOT working version, trying to make it more concise :) element {fn:node-name(/*)} {/*/@*} { return for $x in ./*/(* except employee) return $x } Regards, Yitzhak Khabinsky

3 2

tail recursion issue in 9.4.3
by Mark McSweeny 13 Sep '20

13 Sep '20

Hello, I have encountered a difference in behaviour between versions 9.3.3 and 9.4.3 for a certain query involving tail recursion. In 9.3.3 the compiled query plan correctly applied tail call optimization. But in 9.4.3 tail call optimization is not applied, resulting in a stack overflow during execution. Here is a minimal query that demonstrates the issue: declare function local:f($n, $xs) { if ($n = 0) then $xs else let $x := copy $node := <a/> modify ( rename node $node as 'x') return $node return local:f($n - 1, ($xs, $x)) }; local:f(2000, ()) Mark

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk