- BaseX-Talk - mailman.uni-konstanz.de

java.lang.ArrayIndexOutOfBoundsException on REST GETrequest
by Geoff Alexander 06 Jun '20

06 Jun '20

We have a BaseX application that uses the BaseX REST API. A number of GET requests are failing with an HTTP 400 Bad Request response. Looking at the BaseX logs, I find that BaseX is internally throwing java.lang.ArrayIndexOutOfBoundsException for these HTTP 400 Bad Request failures: <entry time="05:13:57.193" address="***.***.***.***:*****" user="admin" type="400" ms="3.93">[GET] https://********.*******.ibm.com:10443/BaseX/rest/****/*******.xml; Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.6.7 Java: IBM Corporation, 1.8.0_241 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException at org.basex.util.Compress.unpack(Compress.java:120) at org.basex.data.DiskData.txt(DiskData.java:284) at org.basex.data.DiskData.text(DiskData.java:251) at org.basex.io.serial.Serializer.node(Serializer.java:370) at org.basex.io.serial.Serializer.node(Serializer.java:158) at org.basex.io.serial.StandardSerializer.node(StandardSerializer.java:105) at org.basex.io.serial.Serializer.node(Serializer.java:345) at org.basex.io.serial.Serializer.node(Serializer.java:158) at org.basex.io.serial.StandardSerializer.node(StandardSerializer.java:105) at org.basex.io.serial.AdaptiveSerializer.node (AdaptiveSerializer.java:75) at org.basex.io.serial.Serializer.serialize (Serializer.java:109) at org.basex.io.serial.AdaptiveSerializer.serialize (AdaptiveSerializer.java:66) at org....</entry> I realize that BaseX 8.6.7 is somewhat old. I can look at upgrading to a more recent version if necessary. But before I do that, I'd like to know if the java.lang.ArrayIndexOutOfBoundsException is a known problem and more importantly if there is anything we can do short of upgrading BaseX to fix the problem. Thanks, Geoff Alexander, Ph.D. Software Engineer, Corporate Tools Development IBM Corporation Charlotte, NC

2 1

[FULLTEXT] How to search for underscore seperated words ?
by ETANCHAUD Fabrice 05 Jun '20

05 Jun '20

Hi all BaseX users, When I search for 'YET_ANOTHER_SILLY_KEYWORD', ft:search gives me all text nodes containing any of the YET ANOTHER SILLY KEYWORD words. I tried the different search modes, but could not find a way to get ft:search return only the text nodes containing the concatenation. Does anybody have a solution ? Best regards, [MAIF] Fabrice ETANCHAUD Unité Etudes Informatiques - MAIF VIE 50 avenue Salvador Allende 79029 Niort Cedex 9 fabrice.etanchaud(a)maif.fr MAIF.FR<http://www.maif.fr/> | Retrouvez-nous aussi sur [Facebook] <https://www.facebook.com/MAIFassureur> [Twitter] <https://twitter.com/MAIF> [Youtube] <https://www.youtube.com/user/maif>

3 3

HashMap insertion bug - node ID is different on get than on put
by Buddy Kresge 05 Jun '20

05 Jun '20

This can be reproduced in 9.2.4 and 9.3.3 (only tried those 2 versions) We are using java:HashMap, and we are seeing that when we insert a node into the HashMap from a file and do a subsequent hash:get, the generate-id() for the hash:get is different than the original generate-id value from the hash:put. Note: when we read the XML from a file, that is when we see the issue, if we declare the XML in Basex GUI, we do NOT see this behavior. Here are the examples: Scenario #1: XML is a variable in the BaseX GUI session --- no bug ---------------------------------------------------------------------------------------- declare namespace hash = "java:java.util.HashMap"; let $data := <A> <B> <C> <Message>Hi there</Message> <Message>How are you</Message> <D> <E>1</E> </D> </C> </B> </A> let $node := $data//*:C let $kb := hash:new() let $nullOp := hash:put($kb, generate-id($node), $node) let $getNode := hash:get($kb, generate-id($node)) return (generate-id($node), generate-id($getNode)) Result: id6312150 id6312150 Scenario #2: XML is read in from a file --- bug appears ---------------------------------------------------------------------------------------- Move the data into a file and then read in from the file, that is when we see the issue. declare namespace hash = "java:java.util.HashMap"; let $file := doc('SampleData.xml') let $node := $file//*:C[1] let $kb := hash:new() let $null := hash:put($kb, generate-id($node), $node) let $getNode := hash:get($kb, generate-id($node)) return (generate-id($node), generate-id($getNode)) Result: id30601d5 id30602d0 Thanks in advance for your assistance Buddy

2 1

Random Numbers from Random.org
by Leo Studer 03 Jun '20

03 Jun '20

Hello I try to use random numbers from random.org. Here my xpath let $urand := function(){doc("https://www.random.org/integers/?num=1&min=0&max=1000000000&col…")//*:pre/number() div 1000000000} return for $i in 1 to 10 return $urand() Which brings 10 time the same value, however, every run time a different one. What is wrong with this code? Thanks in advance for your valuable input Yours Leo

3 2

Indexes getting removed after update operation in database
by DK Singh 02 Jun '20

02 Jun '20

Hi, I am using Basex version 8.6.6 i am creating full text indexes on database from the GUI, when any update operation is happening on the database all created indexes getting removed. when i use ft module to search anything then error occurs that database "test" has not full text index. I am expecting if index already created then it should not removed, please suggest how can i resolve this issue. Regards Dharmendra Kumar Singh

2 2

Eclipse editor support and authentication
by Ben Pracht 02 Jun '20

02 Jun '20

Hi Folks, Perhaps I'm using too new of an Eclipse (Photon), but I'm not able to integrate Eclipse with BaseX. I installed the trial Oxygen plugin, though I don't want to pay for it. Even then, it would not offer a BaseX datasource, only one for ExistDB. I tried to install XQDT, but it could not be installed without downgrading many components, which I did not want to do. As an Eclipse person, using IntelliJ would not be very productive as I've gotten used to the Eclipse keyboard shortcuts. I'd like to create a server program based in BaseX with RESTful xquery based services. Initially, it would be a CRUD type application. It doesn't need high performance, just not terrible, and I'd like to be able to authenticate into it. I'm confident BaseX can handle the task, it's just getting an editor capable of handling it. Using the GUI that comes with BaseX is good for small tasks, but not so good for larger applications. It doesn't appear that there's much in the way of XQuery support in Eclipse anymore, and even the XQDT if it could be installed doesn't support the newer 3.1 type xquery (I believe I read). Can someone recommend a good editor? I'm using GVim for many small projects, though it takes work to get it to work with larger projects efficiently (CTags helps for C/C++ code, but I dont' think it works with XQuery). Separately, would it be possible to develop a secure BaseX based application that users could log in, and authenticate into, store delicate personal information and have it be sufficiently secure? Could it be at least as secure as, say a Tomcat application? Sorry to ask this question, I do app development, but usually my role comes in after the user has been authenticated using something like OAuth or other. Best Regards, Ben Prachtcom <ben.pracht(a)gmail.com>

3 4

RESTXQ - java.lang.OutOfMemoryError: Java heap space
by Sebastian Guerrero 02 Jun '20

02 Jun '20

Hi BaseX team! A quick question. Is there some known bug/common setting missing for RESTXQ and memory problems? I have this simple module ( into /webapp, a .xqm file ) : *module namespace exe = 'http://site.com/execute <http://site.com/execute>';* *declare * *%updating* * %rest:path("update")* * %rest:consumes("application/x-www-form-urlencoded")* * %rest:POST function exe:update() {* * xquery:eval-update(request:parameter("query"))* *};* I use it to execute some updates against some databases from different clients. Everything works fine by a while, but after some time I get this error [1]: *java.lang.OutOfMemoryError: Java heap space* I noticed that every call to *update()* the memory grows and grows until it reaches the *OutOfMemoryError*. [2] If I stop the HTTP server, the memory is released immediately. [3] What I'm doing wrong? Is there some command to execute the GC? Is this a problem with "*xquery:eval-update()"*? Am I using it in the wrong way? Best regards, Sebastian. [1] https://imgur.com/DrcbwQg [2] https://imgur.com/fonmrhm [3] https://imgur.com/SYFBFK8

3 4

basex-talk@mailman.uni-konstanz.de
by Noki Vcon 30 May '20

30 May '20

Hi, I have modified BaseX_JVM for GUI to 3072M and Java Runtime parameter -Xmx3072m. BaseX GUI will not open if the BaseX_JVM value is more than 1400. Then I have to go to bin and edit the file to 1400 or less so it will open again. Please advise how this can be fixed? Thanks Mohamed

2 1

BaseX XSLT fails after returning first result
by Furst, Thomas 21 May '20

21 May '20

I have a large XML file stored in BaseX that I need to split up into smaller, modular documents. I have created an XSL file to do so: <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" xmlns:xs="http://www.w3.org/2001/XMLSchema" exclude-result-prefixes="xs" version="2.0"> <xsl:output indent="yes" encoding="UTF-8"/> <xsl:param name="schema"/> <xsl:param name="model"/> <xsl:param name="sysDiff"/> <xsl:param name="sys"/> <xsl:param name="subsys"/> <xsl:param name="subsubsys"/> <xsl:param name="assy"/> <xsl:param name="disassy"/> <xsl:param name="disassyv"/> <xsl:param name="info"/> <xsl:param name="infov"/> <xsl:param name="itemloc"/> <xsl:param name="tname"/> <xsl:param name="iname"/> <xsl:param name="outputDir"/> <xsl:template match="/"> <xsl:result-document href="{concat($outputDir, '/DMC-',$model,'-',$sysDiff,'-',$sys,'-',$subsys,$subsubsys,'-',$assy,'-',$disassy,$disassyv,'-',$info,$infov,'-',$itemloc,'.xml')}" method="xml"> <dmodule> <identAndStatusSection> <dmAddress> <dmIdent> <dmCode modelIdentCode="{$model}" systemDiffCode="{$sysDiff}"> <xsl:attribute name="systemCode" select="$sys"/> <xsl:attribute name="subSystemCode" select="$subsys"/> <xsl:attribute name="subSubSystemCode" select="$subsubsys"/> <xsl:attribute name="assyCode" select="$assy"/> <xsl:attribute name="disassyCode" select="$disassy"/> <xsl:attribute name="disassyCodeVariant" select="$disassyv"/> <xsl:attribute name="infoCode" select="$info"/> <xsl:attribute name="infoCodeVariant" select="$infov"/> <xsl:attribute name="itemLocationCode" select="$itemloc"/> </dmCode> <language languageIsoCode="en" countryIsoCode="US"/> <issueInfo issueNumber="000" inWork="01"/> </dmIdent> </dmAddress> </identAndStatusSection> </dmodule> </xsl:result-document> </xsl:template> </xsl:stylesheet> My issue is that when using the xslt:transform() function in BaseX it only returns (creates) the first document. This is the XQuery I have for this: let $style := doc('file:///C:/base.xsl') for $d in doc('file:///C:/Users/tfurst/Documents/Book1-test.xml')//title for $newD in //*[title] where $newD/title/@id eq $d/@id let $schema := $d/schemaName let $model := $d/modelic let $sdc := $d/sdc let $sys := $d/systemCode let $subsys := $d/subsys let $subsubsys := $d/subsubsys let $assy := $d/assy let $disassy := $d/disassy let $disassyv := $d/disassyv let $info := $d/infoCode let $infov := $d/infov let $itemloc := $d/itemloc let $tname := $d/tname let $iname := $d/iname return xslt:transform($newD,$style, map {"outputDir":"file:///G:/LMA-Conv/Flight/test-conv-out", "model":$model, "sysDiff":$sdc, "sys":$sys, "subsys":$subsys, "subsubsys":$subsubsys, "assy":$assy, "disassy":$disassy, "disassyv":$disassyv, "info":$info, "infov":$infov, "itemloc":$itemloc, "tname":$tname, "iname":$iname}) The document named Book1-test.xml is essentially a map of existing IDs of elements to new output file names. After it creates the first XML output file BaseX returns ERROR [FODC0002] "" (Line 1): Premature end of file. When I looked up the error code in the BaseX documentation this error is defined as "The specified document resource cannot be retrieved. ". Is there some limitation to the use of the xslt:transform function in a loop? I am not understanding why it was able to retrieved the first time, but not after that. I have tried to move the XSL to different file locations, no luck. Am I missing something ridiculously obvious here? This XSL stylesheet is a very simplified version of what it will ultimately become, I wanted to get the process down before fully developing the XSL. Thank you, Tom Furst NOTE: This email message and any attachments are for the sole use of the intended recipient(s) and may contain confidential and/or privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by replying to this email, and destroy all copies of the original message. Thank you, RCM Technologies.<https://www.rcmt.com> NOTE: This email message and any attachments are for the sole use of the intended recipient(s) and may contain confidential and/or privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by replying to this email, and destroy all copies of the original message. Thank you, RCM Technologies.<https://www.rcmt.com>

3 4

patterns
by Ветошкин Владимир 21 May '20

21 May '20

2 2