BaseX-Talk

basex-talk@mailman.uni-konstanz.de

4 participants
5268 discussions

Error message, can this be fixed?
by Roland Haarbrink 21 Jun '21

21 Jun '21

Hi, Getting this message: org.basex.core.BaseXException: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.9 Java: Oracle Corporation, 1.8.0_161 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException When using this validator: https://validatie.geostandaarden.nl/etf-webapp/testruns/start-direct Can this be fixed? Thanks URL: http://localhost:8080/etf-webapp/testruns/start-direct Exception id: EXID-06e97066-fe8f-43cd-adc5-df641b843f75 de.interactive_instruments.etf.dal.basex.dao.BasexDataSource.create(BasexDat aSource.java:397) de.interactive_instruments.etf.dal.basex.dao.BasexDataSource.create(BasexDat aSource.java:381) de.interactive_instruments.etf.dal.basex.dao.BasexTestObjectDao.doCreate(Bas exTestObjectDao.java:134) de.interactive_instruments.etf.dal.dao.AbstractTestObjectDao.create(Abstract TestObjectDao.java:89) de.interactive_instruments.etf.webapp.controller.TestObjectController.addFil eTestData(TestObjectController.java:366) de.interactive_instruments.etf.webapp.controller.TestRunController.startDire ct(TestRunController.java:238) sun.reflect.GeneratedMethodAccessor245.invoke(Unknown Source) sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl .java:43) java.lang.reflect.Method.invoke(Method.java:498) org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(Invoc ableHandlerMethod.java:221) org.springframework.web.method.support.InvocableHandlerMethod.invokeForReque st(InvocableHandlerMethod.java:136) org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandle rMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:110) org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerA dapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:817) org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerA dapter.handleInternal(RequestMappingHandlerAdapter.java:731) org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.hand le(AbstractHandlerMethodAdapter.java:85) org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServl et.java:959) org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServle t.java:893) org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkSer vlet.java:968) org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.jav a:870) javax.servlet.http.HttpServlet.service(HttpServlet.java:648) org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.ja va:844) javax.servlet.http.HttpServlet.service(HttpServlet.java:729) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:292) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:207) org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(Application FilterChain.java:240) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterCh ain.java:207) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.ja va:212) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.ja va:106) org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase .java:502) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:141 ) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogVa lve.java:616) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java :88) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:522) org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Proce ssor.java:1095) org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(Abstrac tProtocol.java:672) org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.jav a:1500) org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java: 1456) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11 49) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6 24) org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.ja va:61) java.lang.Thread.run(Thread.java:748)

2 1

Package for system integration
by karlo＠fastmail.com 20 Jun '21

20 Jun '21

I have packaged basex in a way that I believe will be easier for integration with package managers. https://klarinet.kos.ovh/fossil/basex-root-install/uv/basex-9.4.3.tar.gz >From the root of that archive, you can build and install like this. make make install # as root The above will install to the prefix /usr/local. You can set a different prefix. Here is an example. make clean make PREFIX=/usr make PREFIX=/usr install # as root A secondary benefit of this package is the removal of the bash dependency. Could a package like this be distributed officially? If that is agreeable, I am happy to try incorporating this into the present build system. Here is a utility for preparing the package. It depends on sh and other Unix-like utilities. https://klarinet.kos.ovh/fossil/basex-root-install/dir?ci=tip With distinguished salutations, Kralj Karlo

3 6

getting request's headers inside a Web Application
by dudzikp＠yahoo.com 16 Jun '21

16 Jun '21

Dear all, I do not see an option to obtain the headers from the HTTP request from inside webapp function. Just like in the example: declare %rest:GET %rest:path('tests-html') ???%rest:headers('User-Agent')??? %output:method('html') function page-main:start-empty( ???$user-agent as xs:string??? ) as element(html) { ... } Is this possible? BR

3 3

http:sent-request with username, password and auth-method results in improper use msg
by Rob Stapper 15 Jun '21

15 Jun '21

Hi Cristian, When I add the username, password,auth-method to a http-request [1] I get an improper use message from BaseX[2]. The message suggest a bug. I hope this helps solving it. Kind regards, Rob [1] http:send-request( <http:request method='post' username='admin' password='admin' auth-method='Basic' > <http:body media-type='text/plain'/> </http:request> , 'http://LAPTOP-F17D4BIM:8984/test' , "test" ) [2] Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.5.3 beta Java: Oracle Corporation, 1.8.0_271 OS: Windows 10, amd64 Stack Trace: java.lang.IllegalStateException: Already connected at sun.net.www.protocol.http.HttpURLConnection.setRequestProperty(Unknown Source) at org.basex.util.http.HttpClient.setContentType(HttpClient.java:258) at org.basex.util.http.HttpClient.sendRequest(HttpClient.java:82) at org.basex.query.func.http.HttpSendRequest.value(HttpSendRequest.java:34) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.scope.MainModule.iter(MainModule.java:97) at org.basex.query.QueryContext.iter(QueryContext.java:326) at org.basex.query.QueryContext.cache(QueryContext.java:607) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:113) at org.basex.core.cmd.AQuery.query(AQuery.java:99) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:416) at org.basex.gui.GUI.lambda$4(GUI.java:359) at java.lang.Thread.run(Unknown Source) Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 2

differencing the string value of documents
by Graydon Saunders 12 Jun '21

12 Jun '21

Hello -- So I have XML documents A and B. For this purpose, the markup (which is known to be different) is not relevant; the thing I need to do is prove that all of the text in the string value of A is present in B in the same order in which it exists in A. Document B can have additional text and still be correct, so it is not sufficient to check if string(A) = string(B). (Ideally, B's extra text can be extracted and then compared against the sources of extra text in the transformation between A and B so as to confirm that it's at least all plausible new text.) I've been poking at this for a while and am getting that "reinventing the wheel by gnawing on anvils" feeling. Does a facility to do this exist in BaseX? I've had a look at the documentation and I observe some mention of diff.xqm but that appears to be a node-based diff. thanks! Graydon

5 9

Permissions
by SW-Service 12 Jun '21

12 Jun '21

Hello, should perm force authentication and only the user "admin" would be authorised? Best regards Frank module namespace page = 'http://basex.org/test'; declare %rest:path("basex-rest/test/check-rest-perm") %perm:allow("admin") %rest:GET %output:method("xml") function page:test-check-rest-perm() as element(response) { let $response := element response { 'Response' } return $response }; <response>Response</response>

2 1

HTTP Client DELETE with body
by Marco Lettere 12 Jun '21

12 Jun '21

Dear all, I have to call an API which model an HTTP DELETE operation based on the body of the request. It looks like currently http:send-request is not allowing body to be present ("Body not expected for method DELETE."). I feel that this is bit too restrictive interpretation of the spec which states (as far as I recall) that there is no defined semantic for the operation but not that it is forbidden. Is there any possibility to relax this behaviour and allow for bodies in DELETE calls? [1] Thank you very much. Marco. [1] https://github.com/BaseXdb/basex/blob/382c8097afb1ec5bac1e9511a2287686c33f6…

3 6

Re: [basex-talk] Error with full-text and fuzzy query
by Christian Grün 07 Jun '21

07 Jun '21

cc to the list (2)… Christian Grün <christian.gruen(a)gmail.com> schrieb am Mo., 7. Juni 2021, 15:47: > …and another snapshot for you: modifier letters [1] will now be > regarded as diacritical characters, and queries such as… > > tokenize('faraʼid faraid Birkan')[. contains text 'faraʼid' using fuzzy] > > …will only regard the first two terms as similar. As a consequence, > fuzzy queries for terms with modifiers should get a lot faster. > > You’ll need to recreate your full-text index to take full advantage of the > fix. > > [1] https://de.wikipedia.org/wiki/Unicodeblock_Spacing_Modifier_Letters > > > > On Mon, Jun 7, 2021 at 2:00 PM Christian Grün <christian.gruen(a)gmail.com> > wrote: > > > > > Out of curiosity, is there a way to access those individual term > similarity statistics via XQuery? > > > > I assume there is no straightforward way, but you can check the first > > results of a full-text query: > > > > ft:search('your-db', 'faraʼid', map { "fuzzy": true() })[position() < > 10] > > > > And I noticed that due to the modifier letter (ʼ), many non-similar > > results are returned as well. I’ve raised another issue to track this > > down [1]. > > > > [1] https://github.com/BaseXdb/basex/issues/2015 >

1 0

Re: [basex-talk] Error with full-text and fuzzy query
by Christian Grün 07 Jun '21

07 Jun '21

cc to the list… Christian Grün <christian.gruen(a)gmail.com> schrieb am Mo., 7. Juni 2021, 13:50: > Thanks, Tim, that was helpful. It turned out that the index contains > an unusually high number of similar tokens for one search terms in > your query: > > faraʼid : 13709 similar terms > muhammad : 131 similar terms > siraj : 50 similar terms > ... > > A new snapshot with a bug fix is available, in which similar terms are > collected non-recursively [1]. I’d have wished that your search was > evaluated faster (it takes around 6 seconds on machine) but at least > it succeeds. I’ll have some more thoughts. > > Cheers, > Christian > > [1] https://files.basex.org/releases/latest/ > > > > On Mon, Jun 7, 2021 at 1:17 PM Tim Thompson <timathom(a)gmail.com> wrote: > > > > Thank you, Christian. If it's still helpful, here is a link to download > the document I am using as my full-text index. > > > > All best, > > Tim > > > > > > -- > > Tim A. Thompson > > Metadata Librarian > > Yale University Library > > > > On Mon, Jun 7, 2021 at 6:19 AM Christian Grün <christian.gruen(a)gmail.com> > wrote: > >> > >> I think I managed to build up a bug scenario that should resemble > >> yours [1]: If thousands of similar terms are found, the results cannot > >> be recursively joined anymore. > >> > >> [1] https://github.com/BaseXdb/basex/issues/2014 > >> > >> > >> > >> On Mon, Jun 7, 2021 at 10:28 AM Christian Grün > >> <christian.gruen(a)gmail.com> wrote: > >> > > >> > Hi Tim, > >> > > >> > I’m still trying to get this reproduced. > >> > > >> > The error is caused by excessive recursive functions call. Out of > >> > interest, could you try to increase the size of the Java Stack Trace > >> > and see if the error persists? This can be achieved by assigning a > >> > large value to the JVM via the Xss flag [1]. You could e.g. add > >> > -Xss64m to the BASEX_JVM variable in the BaseX start scripts [2]. > >> > > >> > Internal notes… If yes, we might be confronted with an infinite loop. > >> > If no, we should try to rewrite a recursive index lookup to an > >> > iterative one. > >> > > >> > If your data is not confidential, feel free to provide me with a > download link. > >> > > >> > Cheers, > >> > Christian > >> > > >> > [1] > https://stackoverflow.com/questions/3700459/how-to-increase-the-java-stack-… > >> > [2] https://docs.basex.org/wiki/Start_Scripts > >> > > >> > > >> > > >> > On Fri, Jun 4, 2021 at 11:03 PM Tim Thompson <timathom(a)gmail.com> > wrote: > >> > > > >> > > Thanks, Christian. The rest of the stack trace was just many lines > of "at > org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:74)" until > the end: > >> > > > >> > > [qtp1546693040-47] WARN > org.eclipse.jetty.server.handler.ErrorHandler - Error page too large: 500 > java.lang.StackOverflowError Request(POST // > 10.5.157.229:10214/dba/query-eval)@7dcadc62 > >> > > [qtp1546693040-47] INFO > org.eclipse.jetty.server.handler.ErrorHandler - Disabling showsStacks for > ErrorPageErrorHandler@53032c30{STARTED} > >> > > > >> > > Best regards, > >> > > Tim > >> > > > >> > > > >> > > -- > >> > > Tim A. Thompson > >> > > Metadata Librarian > >> > > Yale University Library > >> > > > >> > > On Fri, Jun 4, 2021 at 1:30 PM Christian Grün < > christian.gruen(a)gmail.com> wrote: > >> > >> > >> > >> Hi Tim, > >> > >> > >> > >> > [qtp1546693040-47] WARN org.eclipse.jetty.server.HttpChannel - > /dba/query-eval > >> > >> > java.lang.StackOverflowError > >> > >> > at > org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:73) > >> > >> > at > org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:74) > >> > >> > >> > >> Could you share some more lines of the stack trace with us? > >> > >> > >> > >> Thanks in advance > >> > >> Christian >

1 0

Error with full-text and fuzzy query
by Tim Thompson 07 Jun '21

07 Jun '21

Hello, I have a full-text index defined on a database with 21,936,670 entries. I'm hitting a stack overflow error when I try to query the following (normalized) string with a fuzzy query: "sajawandi, siraj al-din muhammad ibn muhammad, active 12th century. faraʼid al-sirajiyah" The index entries look like this: <d a="http://id.loc.gov/authorities/names/n2008037847"> <n>Sajāwandī, Sirāj al-Dīn Muḥammad ibn Muḥammad, active 12th century. Farāʼiḍ al-Sirājīyah</n> <d>12th cent.</d> </d> If I create a new DB ("ftindex-test") with only that one entry and try the following lookup, it works: ft:search( "ftindex-test", "sajawandi, siraj al-din muhammad ibn muhammad, active 12th century. faraʼid al-sirajiyah" , map {"mode": "phrase", "content": "entire", "fuzzy": true()} )/.. However, if I try the same query against the full index (with ~22 million entries), it fails with a stack overflow error: [qtp1546693040-47] WARN org.eclipse.jetty.server.HttpChannel - /dba/query-eval java.lang.StackOverflowError at org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:73) at org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:74) ... If I remove the "fuzzy" parameter, the query does work against the full index. Is this a bug, a known limitation here, or something that I'm missing? Thanks in advance, Tim -- Tim A. Thompson Metadata Librarian Yale University Library

2 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk