- BaseX-Talk - mailman.uni-konstanz.de

http:send-request - problem with form data
by Bogdan Bogucki 13 Jul '18

13 Jul '18

Hello, I have problem with http:send-request. I want to send post method request with form data but I encountered problem with characters encoding. Example: Request: for $x in http:send-request( <http:request method='post' href='http://localhost:3333'> <http:header name="User-Agent" value="Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36"/> <http:body media-type='application/x-www-form-urlencoded; charset=UTF-8'> <![CDATA[start=0&length=100&sort=date_type&page=0&size=100]]> </http:body> </http:request> )[2]/json/data/results/content return $x Optimized Query: util:item-at(http:send-request(element Q{http://expath.org/ns/http-client}request { (attribute method { ("post") }, attribute href { ("http://localhost:3333") }, element Q{http://expath.org/ns/http-client}header { (attribute name { ("User-Agent") }, attribute value { ("Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36") }) }, element Q{http://expath.org/ns/http-client}body { (attribute media-type { ("application/x-www-form-urlencoded; charset=UTF-8") }, "
 start=0&length=100&sort=date_type&page=0&size=100
 ") }) }), 2)/json/data/results/content Request send: POST / HTTP/1.1 User-Agent: Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/67.0.3396.99 Safari/537.36 Content-Type: application/x-www-form-urlencoded; charset=UTF-8 Host: copart.com:3333 Accept: text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2 Connection: keep-alive Content-Length: 75 start=0&length=100&sort=date_type&page=0&size=100 Payload is not correctly encoded it should be: start=0&length=100&sort=date_type&page=0&size=100 How can I force function http:send-request to serialize CDATA without escaping ? Best Regards Bogdan Bogucki

3 10

Re: [basex-talk] Number of Databases in BaseX
by Christian Grün 12 Jul '18

12 Jul '18

Hi Martin (cc to the mailing list), The max. number of allowed databases depends on the directory limit of your operating system. In practice, it’s advisable to find a good ratio between size and number of databases, because your file system may require too much time to open a particular database if you have created too many instances. Best, Christian Martin Lourduswamy <martin.louis(a)gmail.com> schrieb am Fr., 13. Juli 2018 00:56: > Hi, > I know each DB is a actually a path in BaseX, > Is there a limit on the number of Databases a single Basex instance can > host, > Please let me know when you have sometime, > > Thanks, > Regards > Martin Lourduswamy >

1 0

slash operator in Basex 9.0.2
by Giuseppe Celano 06 Jul '18

06 Jul '18

I have noticed that in BaseX 9.0.2 a query like <j>fgrtu</j>/data(.)/replace(., "g", "h") gets evaluated (returning "fhrtu"), while in BaseX 8.x, Exist, and Zorba I get an error message (since, as expected, replace() is preceded not by a node but a string). Is this a bug? Ciao, Giuseppe

2 3

Add line-number function
by Павел Павлов 05 Jul '18

05 Jul '18

Hello! Can you add to BaseX (as module) function "line-number" which retrieves the line number of the expression ? Same as in eXist-db ( http://exist-db.org/exist/apps/fundocs/view.html?uri=http://exist-db.org/xq… ) or saxon ( http://www.saxonica.com/html/documentation/functions/saxon/line-number.html ). it is very important for us because our users want see error line number in xml docs when our xquery scripts validate them.

2 1

file:write and arrow operator
by Giuseppe Celano 04 Jul '18

04 Jul '18

Hi All, I was wondering if there is a way to take full advantage of the arrow operator with file:write(). If I want to write the results of a query, it would be ideal, I think, if the first parameter of file:write() were the content to write and the second the path: in this case I could have: my query => file:write("myPath"), where I could easily comment out "=> file:write("myPath")", if needed. However, the first parameter of file:write() is the path, so I end up with using the function in the way I usually use all the other functions (this is not a big problem, but I was wondering if I could take advantage of the arrow operator here: wouldn't it be better to have the path as the second parameter in file:write()?). Ciao, Giuseppe

3 3

basex csv import cmd
by Kittelmann, Maike 04 Jul '18

04 Jul '18

Dear BaseX users, I often make use of importing files to BaseX via command line. For XML this works fine. Currently, I work with CSV-files that I import to BaseX via GUI. I would like to automatize this process as I do with XML-Import files. Unfortunately, I didn't find any instructions so far how I can apply these same GUI CSV import settings to the import via command line. Is this possible? Best regards, Maike Kittelmann -- Maike Kittelmann Metadaten und Datenkonversion Georg-August-Universität Göttingen Niedersächsische Staats- und Universitätsbibliothek Göttingen D-37070 Göttingen Papendiek 14 (Historisches Gebäude, Raum 1.617) +49 551 39-10249 kittelmann(a)sub.uni-goettingen.de http://www.sub.uni-goettingen.de<https://email.gwdg.de/owa/redir.aspx?C=TxY71q4kfUCSjLXiZog64-dZmmdWU9EIVyC3…>

2 1

Passing sequence of strings to the java class
by Alexander Shpack 03 Jul '18

03 Jul '18

Hey, team! Just simple question. How to pass sequence of string to the java class? let $values := for $i in (1 to 3) return $i cast to xs:string return j:exec($values) In case when local function returns one item all is good. Otherwise j:exec takes array of item()+, but not the array of stings. If you just call j:exec(("1","2")) than all works as expected. Any thoughts? Is it bug or feature? ;) BaseX 9.0 Thanks! -- s0rr0w

2 7

XPST0003 for decimal formats without any properties
by Reece Dunn 02 Jul '18

02 Jul '18

Hi All, Given the query: declare decimal-format test; () BaseX 9.0 reports: Error: Stopped at basex-9.0/file, 1/28: [XPST0003] Decimal-format property '' is invalid. This is a valid XQuery 3.1 file, as https://www.w3.org/TR/xquery-31/#doc-xquery31-DecimalFormatDecl denotes the property production as "*", not "+". Kind regards, Reece

2 1

Host 'files.basex.org' not reachable
by Kristian Kankainen 02 Jul '18

02 Jul '18

Hi I wanted to download a newer version of BaseX, but wasn't able to do so because the host is unreachable: > $ wget http://files.basex.org/releases/9.0.2/BaseX902.zip > [...] Name or service not known And my old versions of BaseX (zip-edition of 8.67 and 9.0) doesn't want to start anymore: > $ ./basexgui > java.util.concurrent.ExecutionException: java.io.IOException: Unknown > host 'files.basex.org'. > [...] Is some of your servers down? Best regards, Kristian K

2 3

Unexpected removal of BaseX Database
by Arjan Loeffen 02 Jul '18

02 Jul '18

Dear BaseX people, We create a backup of a BaseX 8.6.4 database using a windows scheduled process: call basexclient -V -Uadmin -Padmin -c "CREATE BACKUP imvertor-*" We have a server process that interacts with the databases, all called Imvertor-*. In accessing the database at certain moments the backup process seems to conflict with the update process. This is visible in the log: [...] 11:59:12.012 127.0.0.1:60319 admin REQUEST [GET] http://localhost:8984/rest/ imvertor-jobs 11:59:12.106 127.0.0.1:60319 admin 200 95.65 ms 11:59:12.121 127.0.0.1:60319 admin REQUEST [DELETE] http://localhost:8984/rest/imvertor-jobs/2018-06-14-11-58-17-450.xml 11:59:12.137 127.0.0.1:60319 admin 200 5.08 ms 11:59:12.137 127.0.0.1:60322 admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs 11:59:12.200 127.0.0.1:60322 admin 200 73.59 ms 11:59:12.215 127.0.0.1:60322 admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs 11:59:21.075 127.0.0.1:60323 admin REQUEST SET QUERYINFO 0.13 ms 11:59:21.075 127.0.0.1:60323 admin OK QUERYINFO: true 0.1 ms *11:59:21.184 127.0.0.1:60323 <http://127.0.0.1:60323/> admin REQUEST CREATE BACKUP imvertor-* 0.21 ms* *11:59:22.372 127.0.0.1:60322 <http://127.0.0.1:60322/> admin 400 Database 'imvertor-jobs_665091421' could not be renamed. 10166.92 ms* *11:59:22.372 127.0.0.1:60322 <http://127.0.0.1:60322/> admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs <http://localhost:8984/rest/imvertor-jobs>* *11:59:27.309 127.0.0.1:60323 <http://127.0.0.1:60323/> admin ERROR Database 'imvertor-jobs' is being updated, or update was not completed. Backup for 'imvertor-jobs-regression' was created in 53.29 ms. Backup for 'imvertor-jobs_665091421' was created in 1262.1 ms. Backup for 'imvertor-models' was created in 4760.92 ms. Backup for 'imvertor-models-regression' was created in 51.58 ms. 6128.15 ms* *11:59:27.309 127.0.0.1:60322 <http://127.0.0.1:60322/> admin 404 Database 'imvertor-jobs' was not found. 4932.96 ms* 12:01:03.465 127.0.0.1:60325 admin REQUEST [GET] http://localhost:8984/rest/?command=list 12:01:03.481 127.0.0.1:60325 admin 200 3.24 ms 12:01:03.543 127.0.0.1:60325 admin REQUEST [GET] http://localhost:8984/rest/ imvertor-jobs 12:01:03.543 127.0.0.1:60325 admin 404 Database 'imvertor-jobs' was not found. 0.36 ms 12:01:03.543 127.0.0.1:60325 admin REQUEST [PUT] http://localhost:8984/rest/ imvertor-jobs 12:01:03.575 127.0.0.1:60325 admin 201 Database 'imvertor-jobs' created in 13.47 ms. 22.83 ms [...] This is rather a serious problem; the whole database is lost. Our software is set up such that the database is created when it is not found. Hence the last log... Do you recognize the problem, and can you specify how to avoid it? Hope this gives you enough info. Thanks in advance! -- Arjan Loeffen, Armatiek BV 06-12918997

2 2

GUI
by Giuseppe Celano 29 Jun '18

29 Jun '18

Hi, I have updated Java (10 from 8) and I cannot apparently customize the GUI anymore on my Mac (if I click on BaseXGUI > aboutBaseXGUI, I cannot access the relevant tabs). Is this a known issue? Moreover, if I start the GUI from the command line, I keep getting the warning message "Illegal reflective access by org.basex.gui.GUIMacOSX". Is there a way to avoid that? Thanks. Ciao, Giuseppe Universität Leipzig Institute of Computer Science, NLP Augustusplatz 10 04109 Leipzig Deutschland E-mail: celano(a)informatik.uni-leipzig.de E-mail: giuseppegacelano(a)gmail.com Web site 1: http://www.dh.uni-leipzig.de/wo/team/ Web site 2: https://sites.google.com/site/giuseppegacelano/

3 6

Tracing query execution
by Iwan Briquemont 29 Jun '18

29 Jun '18

Hello, I use BaseX mostly for boolean queries, I have a hardware database and I check if specific hardware support features I need. It works great but when something is not as expected, it's hard to find out the reason. E.g. given an expression like: $some-value = $some-list and (custom:predicate() or $x > $y) I would like to know why it's true or false. For now I add trace() manually on the subexpressions, rerun, add trace to more specific parts, etc. Ideally I would want to break down the query execution so it shows the values of subparts of the query to pinpoint why it is false, e.g. have an output like: $some-value = $some-list and (custom:predicate() or $x > $y) -> false()$some-value = $some-list -> true()$some-value -> 1$some-list -> (1, 2, ..., 10)custom:predicate() or $x > $y -> false()custom:predicate() -> false()... # It should also go inside the function$x > $y -> false()$x -> 10$y -> 11 Any ideas how it could be achieved? Looking at the code, maybe a debug() (like iter() or item()) method could be added to Expr objects which would trace the expression query, file, line and the result of the expression (or probably the first x characters of the result to avoid huge output)? With an xquery function which would trigger it. I also thought of modifying the query programmatically to add trace() calls but that seems overly complicated. Best regards, Iwan

3 2

Distributing service as EAR
by Mauro Mugnaini 29 Jun '18

29 Jun '18

Hi All, We are used to implement and deploy services into containers (Tomcat, JBoss, Wildfly, ...) as single WAR and for this kind of work we always implement starting from the BaseX WAR distribution. Now, looking in depth into the structure of the WAR, we noted that all the third party JARs, BaseX common classes JAR and XQJ bridge JAR are located into WEB-INF/lib folder whereas HTTP related classes (filters, servlet, listener and so on) are located inside the WEB-INF/classes. Moreover a possibly useless (?) WEB-INF folder with another web.xml and another jetty.xml in the same WEB-INF/classes. My question is: is there any reason why files in WEB-INF/classes are not “jarred” into a single archive and placed into WEB-INF/lib folder? Are there any cons doing that way according to your experience? The objective is to optimize the EAR content, where several WARs of services are packaged into a single EAR file, by factoring out all the JARs into the /lib folder of the EAR. Thank you and regards, Mauro

2 1

Cancelling long running query
by Shaun Flynn 29 Jun '18

29 Jun '18

Hello there, I have had a look in the documentation and was wondering, is it possible to cancel a query once it has been submitted using ClientQuery/ClientSession? Would calling close() on ClientQuery do that? Shaun

3 2

Copy Path in GUI seems to recently not give correct path for target
by Alex Everitt 28 Jun '18

28 Jun '18

Hi, I'm fairly certain there is a bug in the GUI now. I often right click in the GUI and choose Copy Path (from tree and map etc.) and until recently that worked every time. Now I'm getting paths that are just obviously not correct from the second level of the tree down. The first level of the tree is ok. db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResponse Then the second level of the tree and levels not ok. db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResult/ListOrdersResult *Should be: db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResponse/ ListOrdersResult And so on. db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/Orders/Orders/Orders *Should be: db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResponse/ ListOrdersResult/Orders This may have started since the 9 release. Thanks, Alex Everitt

2 1

"Infinity" is incorrectly cast to xs:float.
by Reece Dunn 28 Jun '18

28 Jun '18

Hi, I have found the following behaviour in BaseX 9.0: "Infinity" cast as xs:float (: INF :) "-Infinity" cast as xs:float (: -INF :) "infinity" cast as xs:float (: [FORG0001] Cannot convert xs:string to xs:float: "infinity". :) "Infinity" cast as xs:double (: [FORG0001] Cannot convert xs:string to xs:double: "Infinity". :) "-Infinity" cast as xs:double (: [FORG0001] Cannot convert xs:string to xs:double: "-Infinity". :) >From my reading of Functions and Operators 3.1, and XML Schema 1.1 Part 2 Datatypes, "Infinity" and "-Infinity" are both invalid values for xs:float (like with xs:double) -- they should only be "INF" and "-INF". Kind regards, Reece H. Dunn

2 1

Fwd: Tracing query execution
by Iwan Briquemont 28 Jun '18

28 Jun '18

I forgot to reply to the mailing list too. ---------- Forwarded message ---------- From: Iwan Briquemont <tracnar(a)gmail.com> Date: 2018-06-28 10:51 GMT+02:00 Subject: Re: [basex-talk] Tracing query execution To: Fabrice ETANCHAUD <fetanchaud(a)pch.cerfrance.fr> Hi Fabrice, Indeed that's another solution. I also thought about restricting the expression to a subset of what XQuery supports to implement what you describe. But then the information would be restricted to the expressions which follow that subset. Note that I do not need to know how it is decided per-se for my application, it is as a debugging feature. Behind the boolean expressions there are also some more complicated queries (like joining data from multiple sources), which is why I like to be able to use XQuery all the way. I think this kind of debugging would be useful for actual queries too. Regards, Iwan 2018-06-28 10:18 GMT+02:00 Fabrice ETANCHAUD <fetanchaud(a)pch.cerfrance.fr>: > Hi Iwan, > > > > IMHO it is more a design issue than a tool issue. > > If you need to know exactly where a boolean expression is decided, > > You might have to implement a boolean algebra interpreter. > > You could even describe your questions in xml format, to be interpreted by > a recursive function against your hardware corpus. > > > > That way you could implement rules like : > > All ancestors are ‘and’ operators and my current node is ‘false’ => ‘false’ > > All ancestors are ‘or’ operators’ and my current node is ‘true’ => ‘true’ > > And detect exactly where your expression is decided. > > > > This make me think of the MarkLogic stored query feature. > > > > Sorry I just thought about that a few minutes, > > I hope it helps, > > > > Best regards, > > Fabrice > > > > *De :* BaseX-Talk [mailto:basex-talk-bounces@mailman.uni-konstanz.de] *De > la part de* Iwan Briquemont > *Envoyé :* mercredi 27 juin 2018 23:04 > *À :* basex-talk(a)mailman.uni-konstanz.de > *Objet :* [basex-talk] Tracing query execution > > > > Hello, > > > > I use BaseX mostly for boolean queries, I have a hardware database and I > check if specific hardware support features I need. > > > > It works great but when something is not as expected, it's hard to find > out the reason. > > > > E.g. given an expression like: > > $some-value = $some-list and (custom:predicate() or $x > $y) > > > > I would like to know why it's true or false. > > For now I add trace() manually on the subexpressions, rerun, add trace to > more specific parts, etc. > > > > Ideally I would want to break down the query execution so it shows the > values of subparts of the query to pinpoint why it is false, e.g. have an > output like: > > $some-value = $some-list and (custom:predicate() or $x > $y) -> false() > > $some-value = $some-list -> true() > > $some-value -> 1 > > $some-list -> (1, 2, ..., 10) > > custom:predicate() or $x > $y -> false() > > custom:predicate() -> false() > > ... # It should also go inside the function > > $x > $y -> false() > > $x -> 10 > > $y -> 11 > > > > Any ideas how it could be achieved? > > Looking at the code, maybe a debug() (like iter() or item()) method could > be added to Expr objects which would trace the expression query, file, line > and the result of the expression (or probably the first x characters of the > result to avoid huge output)? With an xquery function which would trigger > it. > > > > I also thought of modifying the query programmatically to add trace() > calls but that seems overly complicated. > > > > Best regards, > > Iwan >

1 0

How to export a database containing xi:include to multiple files
by Marco Randazzo 27 Jun '18

27 Jun '18

Hi, I'm posting again the same question I did some time ago, unfortunately unanswered :( I used baseX GUI (9.0.1) to create a database similar to the following test file: <main xmlns:xi="http://www.w3.org/2001/XInclude"> <xi:include href="folder1/file1.xml" /> <xi:include href="folder2/file1.xml" /> </main> The Result displayed in the baseX gui is correct: <main xmlns:xi="http://www.w3.org/2001/XInclude"> <data xml:base="folder1/file1.xml">5555</data> <data xml:base="folder2/file1.xml">6666</data> </main> Now, after editing the values, I would like to export the contents of the database to MULTIPLE xml files, recreating the same files and the original folders (I see this information is not lost, it is stored in the value of xml:base) However, using the export function available in the baseX GUI, I am able to obtain only a SINGLE file containing the Result shown above, where the two files have been merged in a single file. What can I do? Thank you, Cheers, Marco Randazzo

2 1

DBA session timeout
by Omar Siam 26 Jun '18

26 Jun '18

Hi list! I just got asked if I can change the session timeout for DBA. I actually can't. I don't know where to look. Can anybody can give me a hint? Best regards Omar Siam

2 1

Re: [basex-talk] doc path in basex
by Martin Lourduswamy 26 Jun '18

26 Jun '18

Hi, I used db:node-pre(db:text("db", "ae4b577bd9f578556cd")//../..) delete node db:open-pre("db",333) to immensely speed the basex access. Thanks for helping me with how to get a db:node form basex. I have one more question. I am using FreeBSD to host BaseX and it is stable so for in the testing. Are there any known problems of openjdk8 on FreeBSD and baseX. I could not find any issues so far with basex. But I read somewhere that openjdk8 on FreeBSD dumps core some time. I think it is for specific applications only not for baseX. Just a architectural suggestion on picking the best OS to host baseX. Please let me know when you have some time, ( BaseX works excellent on Windows, CentOS and FreeBSD and produced same results in all of them. But on windows the disk was close to 100% in windows while running my application, centos and FreeBSD has no problems. ) Thanks, Regards Martin Lourduswamy On Thu, Jun 14, 2018 at 2:36 PM, Christian Grün <christian.gruen(a)gmail.com> wrote: > Hi Martin, > > The behavior of BaseX is similar on Windows and Linux. > > I would guess you started the application from different directories? > With file:current-dir(), you get your current working directory [1]. > file:base-dir() points you to the directory in which your XQuery file > is stored. > > Best, > Christian > > [1] http://docs.basex.org/wiki/File_Module#file:current-dir > > > On Thu, Jun 14, 2018 at 2:35 PM Martin Lourduswamy > <martin.louis(a)gmail.com> wrote: > > > > Hi, > > I have a query that creates DB > > > > db:create("database", "db.xml") > > > > I have put the db.xml in the bin dir. > > > > This works for unix/Linux, but on windows I need to specifically give > bin dir lke > > > > db:create("database", "bin/db.xml") > > Otherwise it does not work. > > > > I do not want to hard code path in the script. Is there a general way to > specify the path, > > Thanks, > > Regards > > Martin Lourduswamy >

2 2

Re: [basex-talk] Usage of doc's in BaseX
by Fabrice ETANCHAUD 14 Jun '18

14 Jun '18

Hi Bram, You are welcome, BaseX is such a versatile tool ! Keep index and data content separate could help in various ways. The main one is that, considering you still have to index your index database, you will index only needed data, and you might even set autoupdate to forget about index management. As it seems your data is 'append only', you should build your index on 'pre' node values instead of 'id' node values, in order to gain direct access to data. When working on XML documents, I try to replace 'database' with 'collection', and that seems to help in making effective decisions. Best regards, Fabrice Etanchaud [1] http://docs.basex.org/wiki/Node_Storage [2] http://docs.basex.org/wiki/Database_Module#db:node-pre [2] http://docs.basex.org/wiki/Database_Module#db:open-pre De : Bram Vanroy [mailto:Bram.Vanroy@UGent.be] Envoyé : jeudi 14 juin 2018 13:48 À : Fabrice ETANCHAUD Objet : RE: Usage of doc's in BaseX Hi Fabrice Thanks for the reply. The values that I am trying to index are indeed computed from the original XML but not present in it. Thanks for the limitations link, I had seen it but couldn't find it when googling for 'basex limitations' or others. Considering that my databases will be static and don't need updating, would you still argue for a separation? Thanks again Bram Van: BaseX-Talk <basex-talk-bounces(a)mailman.uni-konstanz.de> Namens Fabrice ETANCHAUD Verzonden: donderdag 14 juni 2018 11:18 Aan: BaseX <basex-talk(a)mailman.uni-konstanz.de> Onderwerp: Re: [basex-talk] Usage of doc's in BaseX Hello Bram, IMHO the main argument for data/index separation is the ease of index recreation, and the ease of reindexation of your index database. Is there still a need for ad hoc indexing, now that BaseX let us index only a node name selection ? I guess you need to index computed values ? For current BaseX limitations, you will find them in [1], but you might have already read that page. I hit the database node number limit once working with the European Patent Office DOCDB collection. So I had to set up a database naming politics to dispatch the documents. Hoping it helps, Best regards, Fabrice Etanchaud Senior Data Specialist CERFrance PCH [1] http://docs.basex.org/wiki/Statistics De : BaseX-Talk [mailto:basex-talk-bounces@mailman.uni-konstanz.de] De la part de Bram Vanroy Envoyé : jeudi 14 juin 2018 10:47 À : BaseX Objet : [basex-talk] Usage of doc's in BaseX Dear BaseX team I am planning an update on our previous custom indexing system [1]. But to do this I have a couple of questions. The major ones will be how to write an efficient custom indexing query in XQuery, but that'll be for another email. (In fact, we have a dual indexing system, so two index files per main file.) For now I am mainly interested in different documents in a single databases, and the doc() functionality. Intuitively, I'd say that documents that are related to each other should be put in the same database. E.g. one database with different documents for plants, and one database with different documents for animals. But when I was scrolling through the documentation of BaseX, I noticed that when creating custom indices you do not put those in the same db as the original content, so you have on database for the content and one for the index [2]. Is this the way it's typically done? More generally, the questions that I have are the following: * What is the actual difference in BaseX between using separate documents in a single database, or using different databases all together? * Is there a performance difference when I would put my index file in the same database as the content, vs. when using different databases altogether? * What is the max allowed size for a document in a database and a database itself respectively? (I have files that are 100's of GB in size. It might not be plausible to have a file and its index file in the same database.) Thank you in advance Kind regards Bram Vanroy Doctoral Research at Ghent University, Belgium https://www.lt3.ugent.be/people/bram-vanroy/ [1] https://biblio.ugent.be/publication/8534144 [2] http://docs.basex.org/wiki/Indexes#Custom_Index_Structures

1 0

doc path in basex
by Martin Lourduswamy 14 Jun '18

14 Jun '18

Hi, I have a query that creates DB db:create("database", "db.xml") I have put the db.xml in the bin dir. This works for unix/Linux, but on windows I need to specifically give bin dir lke db:create("database", "bin/db.xml") Otherwise it does not work. I do not want to hard code path in the script. Is there a general way to specify the path, Thanks, Regards Martin Lourduswamy

1 0

Usage of doc's in BaseX
by Bram Vanroy 14 Jun '18

14 Jun '18

Dear BaseX team I am planning an update on our previous custom indexing system [1]. But to do this I have a couple of questions. The major ones will be how to write an efficient custom indexing query in XQuery, but that'll be for another email. (In fact, we have a dual indexing system, so two index files per main file.) For now I am mainly interested in different documents in a single databases, and the doc() functionality. Intuitively, I'd say that documents that are related to each other should be put in the same database. E.g. one database with different documents for plants, and one database with different documents for animals. But when I was scrolling through the documentation of BaseX, I noticed that when creating custom indices you do not put those in the same db as the original content, so you have on database for the content and one for the index [2]. Is this the way it's typically done? More generally, the questions that I have are the following: * What is the actual difference in BaseX between using separate documents in a single database, or using different databases all together? * Is there a performance difference when I would put my index file in the same database as the content, vs. when using different databases altogether? * What is the max allowed size for a document in a database and a database itself respectively? (I have files that are 100's of GB in size. It might not be plausible to have a file and its index file in the same database.) Thank you in advance Kind regards Bram Vanroy Doctoral Research at Ghent University, Belgium https://www.lt3.ugent.be/people/bram-vanroy/ [1] https://biblio.ugent.be/publication/8534144 [2] http://docs.basex.org/wiki/Indexes#Custom_Index_Structures

2 1

Issue with selecting child nodes
by Shaun Flynn 13 Jun '18

13 Jun '18

Hello there, I have the following query: declare variable $queryPath external := "D:\NROD Projects\xqCrews\diagrams.v3\"; declare variable $testSet := doc($queryPath || "tests\testSet1.xml"); $testSet where testSet1.xml is: <test> <test1> <content>Foobar</content> </test1> <test1> <content>Foobar</content> </test1> </test> When I run $testSet/*, I would expect to get the following result: <test1> <content>Foobar</content> </test1> <test1> <content>Foobar</content> </test1> However, I get the complete document in testSet1.xml When I run this against testSet1.xml $testSet/*/* then I get what would I expect to see: <test1> <content>Foobar</content> </test1> <test1> <content>Foobar</content> </test1> Am I misunderstanding something? Shaun

2 1

Nugets?
by Peter Villadsen 08 Jun '18

08 Jun '18

Hello, I am building a system that relies on a Basex backend, and for that I have chosen to use the TCP protocol. My system is built in managed code, so I went ahead and copied the code provided here: https://github.com/BaseXdb/basex/tree/master/basex-api/src/main/c%23 which satisfied my needs very nicely. However, since I have not written this code myself, it is subject to expensive and time consuming pre-shipping legal audits where it is checked that the code does not contain references to other public domain code. Engineers developing managed code today expect APIs to be shipped as Nuget packages. This has the advantages that it is extremely easy to uptake, you can regard it as a black box (but get the source if you need to), and it supports dependencies (none, in your case) and you can go back and use previously shipped versions (which is important in your case, since you have just changed the authentication scheme I believe). Could you consider offering the API as both Nugets and source on Github? Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

5 4

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk