- BaseX-Talk - mailman.uni-konstanz.de

Advice on accepting UTF-16 XML (and others) from RESTXQ?
by Clark, Ash 20 Oct '23

20 Oct '23

Hello! In brief, I’m looking for any advice folks have on accepting XML of various encodings into a single database. Are there any considerations I should take into account with, say, RESTXQ form parameters? Or with storage, indexing, querying, etc.? For context, I’m currently (re)building a RESTXQ API for a service that publishes TEI. The site, TAPAS, is open to anyone with TEI that might need a place to store it and show it off online. We do some minimal testing on uploaded files [1], but up to this point we haven’t applied any limitations on the character encoding that folks use. While I expect that many people use UTF-8 encoding for TEI, I would like to try to ensure that folks using other encodings can use the service as well. The previous version of the TAPAS-xq API was not tested in this regard (and in other ways as well). I’m trying to do better in writing this new version. One problem that I’m running into is simply retrieving UTF-16 XML from a multipart form parameter.[2] I think BaseX is serializing the file as a string, but when I try to parse it as XML, the file is flagged as ill-formed (“Content is not allowed in prolog”). Is there a way to be flexible about uploaded XML while giving BaseX any parsing/serialization hints it might need? I’m about at the limit of my ability to figure out how different encodings might be working within BaseX; I appreciate any and all information or advice! Warmly, Ash [1]: Our minimal testing: Is this well-formed XML? Is it in the TEI namespace? Is the outermost element <TEI> rather than <teiCorpus> or anything else? We also try to make sure the XML doesn’t have Javascript that might make it into a reader’s browser. [2]: I first discovered this might be a problem when creating a unit test<https://github.com/NEU-DSG/tapas-xq/blob/d66066e65a661a4b909c21ae852d6479f0…> for this function<https://github.com/NEU-DSG/tapas-xq/blob/d66066e65a661a4b909c21ae852d6479f0…> — the UTF-16 file-as-string could not be parsed as XML. I then tested a UTF-16 file against the RESTXQ endpoint with curl, and found the same problem (though I do not know if the string has been read as UTF-8 or -16). In contrast, when I tried to create a standalone test module<https://gist.github.com/amclark42/9f8d8135a30e4659774a673627a263ac>, a UTF-16 file-as-string could be parsed as XML, but not when encoded as binary and then decoded again. Ash Clark (my pronouns are e/em/eir) XML Applications Developer Digital Scholarship Group Northeastern University Libraries as.clark(a)northeastern.edu (617) 373-5983

2 2

Trying to get process details on macOS
by Eliot Kimber 20 Oct '23

20 Oct '23

In the context of a 10.6 server running as a web app, I’m trying to implement a function that uses the process module to run commands to get information about the running BaseX servers, in particular, the PID and port each server is on. I start a number of “worker” BaseXHTTP instances to handle long-running processes. On Linux this code works: let $cmdResult := proc:execute(‘ps’, ('-o', 'pid,%cpu,command')) >From which I can parse out the PID and port for BaseX processes: let $lines as xs:string* := ($cmdResult/output/text() => tokenize('
')) return map{ 'data' : let $servers as map(*) := map:merge( for $line at $p in $lines[contains(., 'BaseXHTTP')] let $pid as xs:string := tokenize($line, '\s+')[1] let $port as xs:string := tokenize(substring-after($line, ' -p'),'\s+')[1] return map{ $port : map{ 'port' : $port, 'pid' : $pid } } ) return $servers } However, on macOS there’s not an exact equivalent of the linux version of ps, but there is the “pgrep” command, which, from the command line, lets me get the data I need: pgrep -lf basex However, when I try to run this from within BaseX, I get “sysmon request failed with error: sysmond service not found pgrep: Cannot get process list” I assume this is a function of how the HTTP servers are running on macOS. I’m starting them like so: "${basexBinDir}/basexhttp" ${debugFlag} -S -p${clientPort} -h${httpPort} -s${stopPort} & So as a service Any ideas how I might make this work on mapOS? Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 3

More options for http-client?
by Andreas Hengsbach | nexoma 15 Oct '23

15 Oct '23

Hi Christian, are there any plans for the http client to become even more configurable? I have seen in the BaseX sources that the HttpClient.Builder (org.basex.io.IOUrl:173) is mostly served with standards. (except sslContext, connectTimeout, followRedirects). For example, I have a special case where I need to force the version to HTTP/1.1. Tried as a workaround to create my own instance via HttpClient.Builder using the XQuery Java binding, but failed on the interfaces. Thanks a lot Andreas

2 1

use-character-maps vs parameter-document with db:export()
by Zimmel, Daniel 09 Oct '23

09 Oct '23

Hi, when using db:export, the serialization parameter use-character-maps works just fine. But can someone explain why it is not possible to use parameter-document? At least, it does not work here with 10.3. As in: db:export($dbname,$path, map{ 'indent':'no', 'omit-xml-declaration':'no', 'parameter-document':'map.xml' }) OK I can see that there is no parameter-document option in the table I can find here defined for fn:serialize(): https://www.w3.org/TR/xpath-functions-31/#func-serialize When not using db:export(), all is well as described: https://docs.basex.org/wiki/Serialization#Character_mappings So in short, I think the answer is the spec. Is it? Have a nice weekend, Daniel

2 3

Strange "group by" behavior
by Alexander Krasnogolowy 07 Oct '23

07 Oct '23

Given the following XQuery: let $input := <root> <item><key>a</key><value>1</value></item> <item><key>b</key><value>2</value></item> <item><key>b</key><value>3</value></item> </root> let $map := map:merge(( map:entry(1, "A"), map:entry(2, "B"), map:entry(3, "C") )) for $result in $input/* let $key := $result/key/text() let $value := $result/value/text() group by $key return map:get($map, $key) When trying to execute that query, I get the error "Item expected, sequence found: (map {1:"A",2:"B",3:"C"}, map {1:"A",2:"B",3:"C"}). But why does it group the map? It isn't part of that for-loop but rather some kind of global variable. Or do I misunderstand the "group by" clause? I only expect the $value to be grouped which results in a sequence. Thanks, Alex

3 3

BaseX-10.7: error selecting CSV parser when creating a new database in the GUI
by ron.vdbranden＠gmail.com 03 Oct '23

03 Oct '23

Hi all, I think I'm experiencing a regression in the BaseX-10.7 GUI w.r.t. the CSV parser, when creating a new database. When I select CSV in the "Input format" dropdown on the "General" tab, nothing seems to be selected: * the dropdown stays open * no file mask is changed in "File patterns" * the "Parsing" tab doesn't show the CSV parsing options Additionally, I'm seeing logs starting with: Exception in thread "AWT-EventQueue-0" java.lang.ArrayIndexOutOfBoundsException: arraycopy: length -1 is negative at java.base/java.lang.System.arraycopy(Native Method) at org.basex.util.Array.copy(Array.java:124) This looks like an error to me; worked perfectly in 10.6. Best, Ron

2 2

XSLT in BaseX - no node parameters
by Hans-Juergen Rennau 25 Sep '23

25 Sep '23

Dear BaseX folks, the documentation of the XSLT module says: "Variables can be bound to a stylesheet via $arguments (only strings are supported when using XSLT 3.0 and Saxon). " That is a pity! Are there plans to remove this limitation? Kind regards,Hans-Jürgen

2 3

Element construction - namespace error - bug?
by Hans-Juergen Rennau 25 Sep '23

25 Sep '23

Dear BaseX folks, constructing elements, I encounter a problem with namespaces which I do not understand. Is it a bug or do I overlook something? To reproduce the problem you need to create an XML file "doc.xml" with this content: <doc xmlns="http://basex.org/simply/the/best"> <foo bar="1"> <peng/> </foo></doc> And here's the query: declare namespace f="http://basex.org/does/its/thing"; declare function f:pretty($n as node()) as node()? { typeswitch($n) case document-node() return document {$n/node() ! f:pretty(.)} case element() return element {node-name($n)} { in-scope-prefixes($n) ! namespace {.} {namespace-uri-for-prefix(., $n)}, $n/@* ! f:pretty(.), $n/node() ! f:pretty(.) } default return $n}; let $doc := doc('doc.xml')return f:pretty($doc) What I get is this error: Stopped at C:/projects/tableman/prototype/thieme-showcase/xq/demo-namespace-problem.xq, 8/33:[XQDY0102] Duplicate declaration of namespace 'http://basex.org/simply/the/best'. Stack Trace:- C:/projects/tableman/prototype/thieme-showcase/xq/demo-namespace-problem.xq, 11/33- C:/projects/tableman/prototype/thieme-showcase/xq/demo-namespace-problem.xq, 11/33- C:/projects/tableman/prototype/thieme-showcase/xq/demo-namespace-problem.xq, 6/63- C:/projects/tableman/prototype/thieme-showcase/xq/demo-namespace-problem.xq, 17/16 Strangely enough, you do not get the error if you copy the contents of doc.xml into the query: let $doc := <doc .../>return f:pretty($doc) You also do not get the error if you remove the @bar attribute in the document. Kind regards,Hans-Jürgen

2 3

Re: [basex-talk] Set Strip Whitespace Mode
by Christian Grün 15 Sep '23

15 Sep '23

Hi Hans-Jürgen, > question: what is the recommended way of ensuring that an application calling BaseX via command-line (basex ...) uses a certain strip whitespace mode (true or false), if the application is deployed on servers with different BaseX versions? Option -w cannot naively be used, as it toggles the strip whitespace mode, so the effect depends on the version. Sounds challenging. You can set the STRIPWS option to an explicit value… basex -c"SET STRIPWS false" query.xq ... …but this will fail as the comparable BaseX 9 option was called CHOP. You could use XQuery to retrieve the version number… data(db:system()//version) …or to check if a specific option is supported: try { prof:void(db:option('chop')), '!' } catch * { '?' } In general, I would recommend updating to the latest version whenever possible… Hope this helps, Christian

1 0

Set strip whitespace mode
by Hans-Juergen Rennau 15 Sep '23

15 Sep '23

Dear BaseX folks, question: what is the recommended way of ensuring that an application calling BaseX via command-line (basex ...) uses a certain strip whitespace mode (true or false), if the application is deployed on servers with different BaseX versions? Option -w cannot naively be used, as it toggles the strip whitespace mode, so the effect depends on the version. I have not found out how to determine the version of BaseX reliably, using XQuery or a command. So how can a script decide whether or not to use -w? Thank you for help. Kind regards,Hans-Jürgen

1 0

Variable declaration of variable containing a recursive function triggers an error! (golden oldy)
by Rob Stapper 12 Sep '23

12 Sep '23

Hi Christian, I’ve addressed this issue already in feb 2022 and nov 2020. Since I think it is a bug I am coming back on it again. Hopefully with a better formulated argument this time. There is a easy workaround but if code is generated, as in my case, having to change the code manually each time after generation is getting pretty tedious. (and I very much like my code to be consistent) So, why is it that a function-declaration of a function that is recursive doesn’t trigger an self-depending-error and a variable-declaration that has such a function assigned to, does? In the first situation preventing an endless loop is, obviously and rightly so, treated as a programmers responsibility. However in the second situation this responsibility is taken away from the programmer by not even allowing the situation. This is not consistent. Sure, the compiler should and does detect cyclic variable-assignments but that is actually not the case here. Assigning a function to a variable is per definition a non-cyclic assignment. Possible recursiveness in this case should be treated the same as with a function-declaration, that is, as a programmers responsibility. I hope the above makes some sense. Is it worth an effort to address this issue? It would probably make the compiler code even less complex. Cheers, Rob Stapper Sent from Mail for Windows -- This email has been checked for viruses by Avast antivirus software. www.avast.com

2 1

Docker
by Diego Alcorta 05 Sep '23

05 Sep '23

I see that docker images have not been updated in over 2 years. I was wondering what the best way to deploy basex in kubernetes is. -- Diego Alcorta dalcorta(a)gmail.com ----------------------------------------------------- "If patience is a virtue, and ignorance is bliss, you can have a pretty good life if you're ignorant and willing to wait" -----------------------------------------------------

2 1

Suche in allen BaseX-Talk Archives
by Dietmar Posselt 04 Sep '23

04 Sep '23

Hallo, gibt es eine Möglichkeit in allen BaseX-Talk Archives nach Begriffen, "weblogic" oder "tamino", zu suchen? Gruss Dietmar

2 1

Support non-admin user access to database admin interface (DBA)
by Matthew Dziuban 30 Aug '23

30 Aug '23

Hi all, While the subject might sound contradictory, I'm curious what you think about opening up the DBA code to allow non-admin users to access it and perform actions for which they have permissions? I currently maintain and run a fork of the DBA web app at work to make this possible, but I'd love to have the behavior built into BaseX if possible. You can view the changes I've made against BaseX 10.7 here: https://github.com/mblink/basex-webapp/compare/upstream-webapp...webapp-10.7 If you're open to this, I'd be happy to open a pull request with my changes! Thanks, Matt

2 5

copy/modify/return and the base URI
by Hans-Juergen Rennau 28 Aug '23

28 Aug '23

Dear BaseX team, I seem to remember that in earlier versions of BaseX a copy/modify/return did not change the base URI of the processed document. However, now it is lost, or more precisely, replaced with the static base URI of the processing XQuery module. Am I mistaken? At any rate it would be very desirable for copy/modify/return to preserve the base URI of the processed document or fragment. Kind regards,Hans-Jürgen

2 5

XQuery-Java-Binding: Nullpointer "nsMap" is null (on returning a w3c.dom.Node)
by Andreas Hengsbach | nexoma 28 Aug '23

28 Aug '23

Hi all, in a Java module I create a "org.w3c.dom.Node" (with java.xml.parsers.DocumentBuilder) and return it to XQuery/BaseX. Since 10.7 I get this exception: # schnipp Exception in thread "main" java.lang.NullPointerException: Cannot invoke "org.basex.util.hash.TokenMap.put(byte[], byte[])" because "nsMap" is null at org.basex.query.value.node.FElem.build(FElem.java:99) at org.basex.query.value.type.NodeType$3.cast(NodeType.java:60) at org.basex.query.value.type.NodeType$3.cast(NodeType.java:55) at org.basex.query.func.java.JavaCall.toValue(JavaCall.java:262) at org.basex.query.func.java.DynJavaFunc.eval(DynJavaFunc.java:90) at org.basex.query.func.java.JavaCall.value(JavaCall.java:81) at org.basex.query.expr.List.value(List.java:230) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:146) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.Try.value(Try.java:93) at org.basex.query.expr.List.value(List.java:226) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.List.value(List.java:230) at org.basex.query.expr.If.value(If.java:158) at org.basex.query.expr.List.value(List.java:230) at org.basex.query.expr.Try.value(Try.java:93) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:92) at org.basex.query.expr.If.value(If.java:158) at org.basex.query.expr.List.value(List.java:226) at org.basex.query.expr.Try.value(Try.java:93) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.scope.MainModule.iter(MainModule.java:48) at org.basex.query.QueryContext.lambda$iter$4(QueryContext.java:357) at org.basex.query.QueryContext.run(QueryContext.java:766) at org.basex.query.QueryContext.iter(QueryContext.java:357) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:95) # schnapp Do I have to create the Node differently now, or is this a bug? nsMap. a map of namespace I guess. In my case the w3c.dom.Node has no namespace. Thanks a lot Andreas

2 4

"Expressions must be all updating" puzzle
by Eliot Kimber 21 Aug '23

21 Aug '23

In BaseX 10: In an updating function I have a call to another updating function that uses update:output() to log messages. If that function call is included, BaseX says that expressions must be all updating, but if I remove the call, BaseX is happy. The calling function is: declare %updating %rest:path('/now/rest/analytics/store-latest-acrolinx-users' ) function now:storeAcrolinxUsers() { let $acrolinxMap as map(*)? := try { acrolinx:getUserDataMap() } catch * { util:logToConsole( 'storeAcrolinxUsers' ,``[`{$err:code}` - `{$err:description}`]`` ,'warn' ) } return if (exists($acrolinxMap)) then let $doc as element() := acrolinx:serializeAcrolinxUserMap($acrolinxMap) let $fileName as xs:string := 'acrolinx-users_' || replace($doc/@timestamp, ':', '~') || '.xml' return db:put(analyticsmgmt:getAnalyticsDatabase(), $doc, relpath:newFile('acrolinx/users', $fileName)) }; The offending function is util:logToConsole(), which is declared as: declare %updating function util:logToConsole( $functionName as xs:string, $message as xs:string, $logLevel as xs:string ) { let $logMessage as xs:string := '[' || upper-case($logLevel) || '] ' || $functionName || '(): ' || $message return ( update:output(prof:dump($logMessage)) , update:output($logMessage) ) }; This is declared as an updating function and returns “updating” functions. If I comment out the call to util:logToConsole() in the first function, then BaseX is happy. If I use the non-updating version of logToConsole(), util:logToLog(), then BaseX is also happy. So my question is: why is BaseX complaining about the use of this updating function in an updating function? There must be some subtlety that I’m missing but I have not yet figured out what it is. Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 4

Problem with uploading a file larger than 512 MB .......
by Dmitry Gorskiy 21 Aug '23

21 Aug '23

Dear Sirs, What could be the problem? Big file upload problem. Below is the listing from the console. My computer: ------------------- CPU: 4 cores RAM: 8G OS: Linux BaseX: 107 and BaseX108-20230816.163639 Java: Adoptium idk-17.0.8+7 I'm creating files: dd if=/dev/random of=file_512M bs=1M count=512 …………………………file_530M …………………………file_1G …………………………file_2G and etc. Launching “basexhttp" ( default ...-Xmx2g … ) Let's go in … http://192.168.1.120:8080/dba/files <http://192.168.1.120:8080/dba/files> Downloading files - no problem. Uploading: file 512MB size - no problem. Uploading file 530MB and more - PROBLEM ( looking console output below ) OK, relaunching basexhttp whith -Xmx4G ….. Uploading file 512MB - ok Uploading file 1GB - ok More size - crashes What could be the problem? Thank you very much. Dmitriy Gorskiy. HTTP ERROR 500 java.lang.OutOfMemoryError: Java heap space URI: /dba/file-upload STATUS: 500 MESSAGE: java.lang.OutOfMemoryError: Java heap space SERVLET: RESTXQ CAUSED BY: java.lang.OutOfMemoryError: Java heap space Caused by: java.lang.OutOfMemoryError: Java heap space at java.base/java.util.Arrays.copyOf(Arrays.java:3537) at org.basex.util.list.ByteList.add(ByteList.java:43) at org.basex.io.in.BufferInput.content(BufferInput.java:216) at org.basex.http.RequestContext.body(RequestContext.java:119) at org.basex.http.RequestContext.addMultipart(RequestContext.java:137) at org.basex.http.RequestContext.formValues(RequestContext.java:103) at org.basex.http.restxq.RestXqFunction.bind(RestXqFunction.java:223) at org.basex.http.restxq.RestXqResponse.init(RestXqResponse.java:60) at org.basex.http.web.WebResponse.create(WebResponse.java:54) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:72) at org.basex.http.BaseXServlet.service(BaseXServlet.java:69) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1450) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:554) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel$$Lambda$140/0x00007f5974196000.dispatch(Unknown Source) Powered by Jetty:// 9.4.51.v20230217 <https://eclipse.org/jetty>

2 1

Use Bash to construct multi-file form submission
by Eliot Kimber 18 Aug '23

18 Aug '23

This is not strictly a BaseX question but it is in the context of communicating with a BaseX-implemented REST service and I’m hoping someone in this community can answer my question as I’ve not found a solution the interwebs. I’ve implemented a POST method that expects a multi-part form request with multiple files that then loads those files into a database. The files are all related such that I want something close to an atomic commit for the set of files. Thus the multi-file form approach. The REST method works and I can use from the command line using curl, i.e: curl --location http://localhost:9984/now/rest/validation/reports?debug=false \ --form 'files=@"/Users/eliot.kimber/git-basex/product-content-analytics/validation-reports/vancouver/bundle-strategic-portfolio-mgmt_errors_vancouver_2023-08-14T22~11~28Z_1ae692f8_1692054936.xml"' \ --form 'files=@"/Users/eliot.kimber/git-basex/product-content-analytics/validation-reports/vancouver/bundle-tech-technology-industry_errors_vancouver_2023-08-14T22~11~28Z_1ae692f8_1692054971.xml"' What I haven’t been able to figure out is how to construct the equivalent curl command in a bash script, where the script gets a list of flies to load and then constructs the –form parameters. Everything I’ve tried results in a “Warning: Trailing data after quoted form parameter” message or some more utter failure. It must be some subtlety of how to escape the quotes—my googling around produces lots of stack overflow discussions of how to manage the escapes, but nothing I’ve tried has so far worked. My bash approach is simply: curlcmd=”curl --location …” for file in ${files[@]}; do curlcmd+=” --form ‘files=@\”${file}\”’ done And then execute the resulting string: bash -c $curlcmd I have a separate script that successfully constructs a curl call to a companion end point that takes one file: curl \ "--location" "${serverUrl}:${serverPort}/now/rest/validation/report/${fileName}?debug=${debug}" \ "--header" "Content-Type: text/xml" \ "--data-binary" "@${filePath}" And I’m currently just calling this for each file, which is OK. But I’d really like to be able to send a set of files as a single REST call. Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 2

Re: [basex-talk] mapping functions
by Imsieke, Gerrit, le-tex 17 Aug '23

17 Aug '23

Hi Graydon, Replying to the list for posterity. I hope you don’t mind. When you dynamically evaluate an expression (xquery:eval(), job:eval(), …), you start with the default values of the static context [1]. Nothing of the XQuery module from which you evaluate the expression is known (unless supplied by binding, but ordinary function declarations are not amenable to binding), therefore no risk of circularity. As stated in the table in [1], you can use module import [2] to augment this clean slate. In particular the module’s function declarations/signatures will be available then. If you don’t want the dynamically evaluated expression to import the whole module, you can store functions into variables and supply these variables to the evaluation through bindings. Haven’t tried it yet. Gerrit [1] https://www.w3.org/TR/xquery-31/#id-xq-static-context-components [2] https://www.w3.org/TR/xquery-31/#id-module-import On 16.08.2023 14:02, Graydon Saunders wrote: > Thank you for the specific example! > > I'm croggled that works without giving me a circular reference error of some kind, but it does work. > > Much appreciated! > > Graydon > > On Tue, Aug 15, 2023 at 11:34 PM <gerrit.imsieke(a)le-tex.de <mailto:gerrit.imsieke@le-tex.de>> wrote: > > You can import the library module in the evaluated expression. Example: https://github.com/transpect/control-backend/blob/main/webapp/control-backe… <https://github.com/transpect/control-backend/blob/main/webapp/control-backe…> > > Gerrit > > > Sent from MailDroid <https://goo.gl/ODgwBb> > > -----Original Message----- > From: Graydon Saunders <graydonish(a)gmail.com <mailto:graydonish@gmail.com>> > To: BaseX <BaseX-Talk(a)mailman.uni-konstanz.de <mailto:BaseX-Talk@mailman.uni-konstanz.de>> > Sent: Wed, 16 Aug 2023 4:42 > Subject: [basex-talk] mapping functions > > Hello -- > > I have various databases that will be run through the same code after their contents is regularized. So the only different function is the one used for regularization. > > This can be handled by writing a wrapper function and passing in a label to say which function to use, but I was wondering if there's a way to do it in the configuration map directly. The configuration map exists as a text file and gets run through xquery:eval() at the start of the process. > > declare namespace abc='http://some/uri <http://some/uri>'; > 'regularizationFunction': map { > 'typeOne': abc:regularizationOne#1, > 'typeTwo': abc:regularizationTwo#1 > } > > doesn't work, because the abc functions aren't known at evaluation time. These functions are defined in the library module that's evaluating the configuration file but xquery:eval() doesn't know that. I don't see a way to use bindings to get around this. > > Is there a way to map a locally-defined function reference so xquery:eval() will recognize it? > > thanks! > Graydon > > -- > Graydon Saunders | graydonish(a)fastmail.com <mailto:graydonish@fastmail.com> > Þæs oferéode, ðisses swá mæg. > -- Deor ("That passed, so may this.") > -- Gerrit Imsieke Geschäftsführer / Managing Director le-tex publishing services GmbH Weissenfelser Str. 84, 04229 Leipzig, Germany Phone +49 341 355356 110, Fax +49 341 355356 510 gerrit.imsieke(a)le-tex.de, http://www.le-tex.de Registergericht / Commercial Register: Amtsgericht Leipzig Registernummer / Registration Number: HRB 24930 Geschäftsführer / Managing Directors: Gerrit Imsieke, Svea Jelonek, Thomas Schmidt ---------------------------------------------- Besuchen Sie uns auf der Frankfurter Buchmesse in Halle 4.0, G94.

2 3

Accessing BaseX server on remote machine
by Furst, Thomas 17 Aug '23

17 Aug '23

Hello, I am attempting to use BaseX from a central location on our network so that all team members can access it. I am using the Python Client to achieve this. Everything works fine when the host is entered as 'localhost'. Once I change it to the remote host name, I am getting a time out error reported back: TimeoutError: [WinError 10060] A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond On the remote machine (Windows 10 Pro for Workstations) I have opened port 1984 in the firewall on both the inbound and outbound. Can someone help me understand what I may be doing incorrectly? Or what I may have overlooked doing that is also required? Thank you, Tom Furst

2 4

mapping functions
by Graydon Saunders 15 Aug '23

15 Aug '23

Hello -- I have various databases that will be run through the same code after their contents is regularized. So the only different function is the one used for regularization. This can be handled by writing a wrapper function and passing in a label to say which function to use, but I was wondering if there's a way to do it in the configuration map directly. The configuration map exists as a text file and gets run through xquery:eval() at the start of the process. declare namespace abc='http://some/uri'; 'regularizationFunction': map { 'typeOne': abc:regularizationOne#1, 'typeTwo': abc:regularizationTwo#1 } doesn't work, because the abc functions aren't known at evaluation time. These functions are defined in the library module that's evaluating the configuration file but xquery:eval() doesn't know that. I don't see a way to use bindings to get around this. Is there a way to map a locally-defined function reference so xquery:eval() will recognize it? thanks! Graydon -- Graydon Saunders | graydonish(a)fastmail.com Þæs oferéode, ðisses swá mæg. -- Deor ("That passed, so may this.")

2 1

passing complex parameters to modules
by Graydon Saunders 13 Aug '23

13 Aug '23

Hello -- I've got a module full of functions. I've got two (and expect more) queries which import the function module. The queries have slightly different requirements; for example, in one case, it's necessary to use normalize-unicode() during a data regularization step, and in the other case it isn't. These differences are generally not at the top level of function that the query itself calls; they're usually a couple levels down in the function module. It doesn't look like the function module can have its own external variables; if it can, that'd be ideal. Otherwise, it seems like the thing to do is to have each query load a parameter map, but then I have to include that map as a parameter in all the functions calls in the function module, which feels inelegant. And I definitely don't want to start introducing a haze of individual values. Is there a better way to do this? It seems like I'm missing something. Thanks! Graydon -- Graydon Saunders | graydonish(a)fastmail.com Þæs oferéode, ðisses swá mæg. -- Deor ("That passed, so may this.")

3 2

How best to cache an intermediate result in the context of a larger query?
by Eliot Kimber 10 Aug '23

10 Aug '23

In the context of a RESTXQ handler that is processing a stored document to generate HTML From it, I need to do some expensive processing and then cache the result for the next time the same document is rendered. It doesn’t make sense to preprocess all the documents to cache the data as part of my overall ingestion process because only a fraction of documents will ever be rendered by this page. I think the answer is to turn on MIXUPDATES so I can invoke an updating function in the process of the larger RESTXQ handling query, but I’m wondering if there’s some less drastic or better-architected approach? For example, should be I be invoking a separate REST end point to do the calculation, blocking on the request, and then fetch the cached result? I read through the update module and the various pages on XQuery update and feel like I still don’t quite understand what my updating options are. Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

3 5

BaseX 10.7: The Summer Edition
by Christian Grün 09 Aug '23

09 Aug '23

Dear all, We’re pleased to announce version 10.7 of BaseX, of our XML framework: https://basex.org. The new release is a big step forward towards BaseX 11: • We have added numerous new operators, functions and features of XQuery 4. • The GUI editor and result view now provide full support for Unicode characters. • Font rendering has been improved (you can tweak it in the Font Dialog) • More BaseX 11 preview features available (see docs.basex.org) • Various bug fixes (web:forward, job:eval, main-memory documents) Have fun, Your BaseX Team

3 3

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk