BaseX-Talk February 2017

basex-talk@mailman.uni-konstanz.de

38 participants
39 discussions

Allowing for comments in code...
by France Baril 18 Feb '17

18 Feb '17

I was wondering if it would be possible to either: * Allow for an omit-comment option in HTML5 serializer * Allow for {(: Nothing but a comment :)} in xquery code. I often have long pieces of HTML to output and clients don't want me to output them with the result. However, I can't use {(::)}. I have been using useless code around my comments just to get around this issue: { let $t := '' return $t (: The comment I can't leave without the bogus code:) } Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 6

in memory
by Patrice Drolet ift.a., MD 17 Feb '17

17 Feb '17

Hello, I am trying to use the option MAINMEM to get faster access to data. I can’t make it work. How to use this option in java? When it is set, I get an error with new CreateDB(dbname).execute(context); Thanks, Patrice Drolet

2 1

Retrieve large amount of data from XML-resource
by Jan Stapel 15 Feb '17

15 Feb '17

Hello, i am getting an BaseXException when trying to get large amount of data from a XML-resource with a JAVA-Client. For example for a xml-file with the size of 79167874 ("FACTOR", as shown by the web-gui) "session.execute(new XQuery("doc('db/file.xml')"));" will result in an exception[0]. My assumption is that a timeout is exceeded somewhere.. so my next question is how to properly set the timeout (Or in general, how to run specific commands via java-client, I can't find it in the wiki. "session.query("timeout[0]");" seems to not have any influence. Query large files in general, for example query its number of instances, seems to not be the problem. Increasing the -Xmx in the basex-script did not help. # Options for virtual machine (can be extended by global options) BASEX_JVM="-Xmx10G $BASEX_JVM" Increasing the -Xmx of the java-application did not help as well. I hope you can help me. best regards, Jan [0] org.basex.core.BaseXException: Interrupted. at org.basex.api.client.ClientSession.receive(ClientSession.java:191) at org.basex.api.client.ClientSession.execute(ClientSession.java:160) at org.basex.api.client.ClientSession.execute(ClientSession.java:165) at org.basex.api.client.Session.execute(Session.java:36) at net.ddns.janstapel.datamanagement.Main.main(Main.java:37)

2 5

Re: [basex-talk] Folder operations in BaseX
by Christian Grün 15 Feb '17

15 Feb '17

Hi Bhushan (cc to the list), So you are exclusively working with binary resources, right? In that case, a query like the following one can be used: let $db := 'db' let $src-path := 'src/' let $trg-path := 'trg/' for $src in db:list($db, $src-path) let $trg := $trg-path || substring-after($src, $src-path) return db:store($db, $trg, db:retrieve($db, $src)) I have added a slightly revised version of this query in our Wiki [1]. Hope this helps, Christian [1] http://docs.basex.org/wiki/Database_Module#db:store On Wed, Feb 15, 2017 at 6:11 AM, Nanday, Bhushan <bhushan.nanday(a)sap.com> wrote: > Hi Christian, > > Thanks for reaching out. I am currently trying to use the db:store(source, destination, file) in an xqeury. This approach works well when the source is a file but doesn’t work when the source is a folder. I need something that will move/copy and entire folder and not just a file. > > > > > > On 2/13/17, 1:46 PM, "Christian Grün" <christian.gruen(a)gmail.com> wrote: > > Hi Bhushan, > > > Hope everyone is doing good. I am currently trying to copy an entire > > folder from the source location to a destination location. > > How did you proceed so far? > > Regards, > Christian > >

1 0

Folder operations in BaseX
by Nanday, Bhushan 13 Feb '17

13 Feb '17

Hi All, Hope everyone is doing good. I am currently trying to copy an entire folder from the source location to a destination location. I have tried rename but its too expensive from time response stand point when the schema size is too large. To go around the problem I am trying to run the xquery using db:store (). But db:store doesn’t seem to work on folders. So I am wondering if there is any other efficient way ( apart from rename and db:store) which will work on the folder. I need to copy the entire folder from source location to destination and it may have a hierarchy of sub-folders in it. Any help on that is really appreciated! Thanks, Bhushan

2 1

DFDL module and XSLT module
by Kristian Kankainen 13 Feb '17

13 Feb '17

Hello all. I am making a simple wrapper java module for Daffodil so that I can run DFDL parsing and unparsing from XQuery. I got communication working between BaseX and my module allready, but I can only send and return Strings. Because the module is so similar to the XSLT module of BaseX, I wonder if the java source code is available. I can't find it in the GitHub repository. Thanks Kristian K

2 1

Update facility
by meumapple 09 Feb '17

09 Feb '17

I have written a function consisting in a copy/modify expression: declare function local:mine($s) { copy $e:= $s modify (...) return $e }; It seems it is not possible to somehow make it recursive ( ... return local:mine($e) ): can anyone confirm this? What is the best way to have a recursive function while using the update facility? Best, Giuseppe

2 1

Re: [basex-talk] Send multipart binary with http client
by Christian Grün 09 Feb '17

09 Feb '17

Hi Max, Do you have an MCVE for us? Thanks in advance, Christian Am 30.01.2017 4:24 nachm. schrieb "Maximilian Gärber" <mgaerber(a)arcor.de>: Hi, this seems related to https://github.com/BaseXdb/basex/issues/1203 Problem 1: When setting Content-Transfer-Encoding manually (via <http:header>), it will appear twice in the request that is sent Problem 2: I cannot override base64 because it happens automatically based on the content I am sending and for some reason the web server that receives this request does not recognize the base64 encoding correctly Regards, Max 2017-01-30 15:35 GMT+01:00 Maximilian Gärber <mgaerber(a)arcor.de>: > Hi, > > I can't figure out how to send a file in binary (not base64) when > using multipart [1] > > On the body, I've tried method="basex" because the docs says this > would write raw bytes to the request > > Regards, > Max > > > [1] > > declare function _:send-multipart($url, $file-name, $path) as item()* { > > > let $uri := file:path-to-uri($path || $file-name) > let $type := fetch:content-type($uri) > > let $binary := file:read-binary($path || $file-name) > let $boundary_id := concat("batch_", random:uuid()) > > let $req := > <http:request method="post" send-authorization="false" > override-media-type="text/plain"> > > <http:header name="Accept" value="application/json"/> > <http:header name="Accept-Encoding" value="gzip, deflate"/> > > <http:multipart media-type="multipart/form-data" > boundary="{$boundary_id}"> > > <http:header name="Content-Transfer-Encoding" value="binary"/> > <http:header name="Content-Disposition" value="form-data; > name='FILE'; filename='{$file-name}'"/> > <http:header name="Content-Type" value="{$type}"/> > >  > <http:body media-type="application/octet-stream" method="binary"> > {$binary} > </http:body> > > </http:multipart> > </http:request> > > let $resp := http:send-request($req, $url) > return json:parse($resp[2]) > > };

2 5

Re: [basex-talk] Whatever happened to EVENTPORT? [urgent]
by Bram Vanroy 09 Feb '17

09 Feb '17

Hi all A quick update. The issue was indeed caused by our firewall. Hereby the problem is solved. Thank you for the quick response Christian! Cheers Op 8 feb. 2017 18:28 schreef Bram Vanroy <bram.vanroy1(a)student.kuleuven.be>: Unfortunately it does not. We were already using this version of the client [1]. It might be an issue with our network setup though, so I already contacted our sysadmin. If you do happen to think of something that could cause this, please let me know. [1] https://github.com/BaseXdb/basex/blob/master/basex-api/src/main/php/BaseXCl… -----Oorspronkelijk bericht----- Van: Christian Grün [mailto:christian.gruen@gmail.com] Verzonden: woensdag 8 februari 2017 18:15 Aan: Bram Vanroy <bram.vanroy1(a)student.kuleuven.be> CC: BaseX <basex-talk(a)mailman.uni-konstanz.de> Onderwerp: Re: [basex-talk] Whatever happened to EVENTPORT? [urgent] Hi Bram, With Version 8.0 of BaseX, the client/server communication was updated. You’ll probably need to update your PHP client [1]. The EVENTPORT option is obsolete, itwas removed in 8.2, see [1]. Does this help? Christian [1] http://docs.basex.org/wiki/Clients [2] http://docs.basex.org/wiki/Options __________________________________________ On Wed, Feb 8, 2017 at 5:44 PM, Bram Vanroy <bram.vanroy1(a)student.kuleuven.be> wrote: > Good evening all > > I’m sorry to be so pushy with the urgent addendum but we have an event > and some demos coming up and we only now realise that BaseX isn’t > working anymore. (Our own fault.) > > We upgraded from BaseX 7.9 to 8.3 (after going from Cent OS 6 to Cent OS > 7). > Thinking we could use the same settings from our .basex configuration > file, I ran the command basexserver as I used to. This works, but I > remember seeing a message in the command line that some attributes > were not recognised and that a new configuration file was created by > basex itself, and that a server was launched subsequently. The issue > is, though, that we use BaseX as a back-end database system that > processes requests from an apache webservice. On Machine A the > webservice is running, and basex is running on machine B. The > webservice fires a session request (with PHP) like > so: > > > > $session = new Session("machineB", 1958, "admin", "admin"); > > > > However, the connection fails. First a warning, followed by a Fatal error. > > > > PHP Warning: socket_connect(): unable to connect [113]: No route to > host in basex-client.php on line 17 > > > > Line 17 would be the first one of this clause: > > > > if(!socket_connect($this->socket, $h, $p)) { > > throw new Exception("Can't communicate with server."); > > } > > > > My instinct was that the webservice could not connect to basex because > some settings in the newly created .basex file were incorrect. > However, I checked them and they are definitely correct. Shown below: > > > > # General Options > > DEBUG = false > > DBPATH = /home/obelix/sonarbasex/WRPPH > > REPOPATH = /home/nobackup/Gretel/BaseXRepo > > LANG = English > > LANGKEYS = false > > GLOBALLOCK = false > > > > # Client/Server Architecture > > HOST = localhost > > PORT = 1958 > > SERVERPORT = 1958 > > USER = > > PASSWORD = > > SERVERHOST = > > PROXYHOST = > > PROXYPORT = 9591 > > NONPROXYHOSTS = > > IGNORECERT = false > > TIMEOUT = 30 > > KEEPALIVE = 600 > > PARALLEL = 8 > > LOG = true > > LOGMSGMAXLEN = 1000 > > > > # HTTP Services > > WEBPATH = /home/pricie/sonar/BaseXWeb > > RESTPATH = > > RESTXQPATH = > > CACHERESTXQ = false > > HTTPLOCAL = false > > STOPPORT = 8591 > > AUTHMETHOD = Basic > > > > I did find, however, that unlike the .basex file of our previous > version, this one does not have an EVENTPORT attribute. Is this > normal? I can’t find it in the documentation anymore either. So if it > has nothing to do with ports an access, why would I then get a ‘no > route to host’ error? Is there ANY way that, given my basex file > above, this is caused by BaseX? Or is it more likely to be a > network/permission error? > > > > > > Thank you in advance, I’m running out of ideas! > > > > > > Kind regards > > > > Bram

1 0

Whatever happened to EVENTPORT? [urgent]
by Bram Vanroy 08 Feb '17

08 Feb '17

Good evening all I'm sorry to be so pushy with the urgent addendum but we have an event and some demos coming up and we only now realise that BaseX isn't working anymore. (Our own fault.) We upgraded from BaseX 7.9 to 8.3 (after going from Cent OS 6 to Cent OS 7). Thinking we could use the same settings from our .basex configuration file, I ran the command basexserver as I used to. This works, but I remember seeing a message in the command line that some attributes were not recognised and that a new configuration file was created by basex itself, and that a server was launched subsequently. The issue is, though, that we use BaseX as a back-end database system that processes requests from an apache webservice. On Machine A the webservice is running, and basex is running on machine B. The webservice fires a session request (with PHP) like so: $session = new Session("machineB", 1958, "admin", "admin"); However, the connection fails. First a warning, followed by a Fatal error. PHP Warning: socket_connect(): unable to connect [113]: No route to host in basex-client.php on line 17 Line 17 would be the first one of this clause: if(!socket_connect($this->socket, $h, $p)) { throw new Exception("Can't communicate with server."); } My instinct was that the webservice could not connect to basex because some settings in the newly created .basex file were incorrect. However, I checked them and they are definitely correct. Shown below: # General Options DEBUG = false DBPATH = /home/obelix/sonarbasex/WRPPH REPOPATH = /home/nobackup/Gretel/BaseXRepo LANG = English LANGKEYS = false GLOBALLOCK = false # Client/Server Architecture HOST = localhost PORT = 1958 SERVERPORT = 1958 USER = PASSWORD = SERVERHOST = PROXYHOST = PROXYPORT = 9591 NONPROXYHOSTS = IGNORECERT = false TIMEOUT = 30 KEEPALIVE = 600 PARALLEL = 8 LOG = true LOGMSGMAXLEN = 1000 # HTTP Services WEBPATH = /home/pricie/sonar/BaseXWeb RESTPATH = RESTXQPATH = CACHERESTXQ = false HTTPLOCAL = false STOPPORT = 8591 AUTHMETHOD = Basic I did find, however, that unlike the .basex file of our previous version, this one does not have an EVENTPORT attribute. Is this normal? I can't find it in the documentation anymore either. So if it has nothing to do with ports an access, why would I then get a 'no route to host' error? Is there ANY way that, given my basex file above, this is caused by BaseX? Or is it more likely to be a network/permission error? Thank you in advance, I'm running out of ideas! Kind regards Bram

2 2

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk February 2017