- BaseX-Talk - mailman.uni-konstanz.de

An invalid XML character (Unicode: 0x1a) was found in the element content of the document
by Geoff Alexander 16 Jan '20

16 Jan '20

We're getting an "An invalid XML character (Unicode: 0x1a) was found in the element content of the document" error from a BaseX REST API PUT request We using BaseX 8.6.7 ( I realize that BaseX 8.6.7 isn't the latest version). Is this a user error or a BaseX problem? If it's user error, how would I fix the error. If it's a BaseX problem, is it fixed in a more recent BaseX version.

2 1

Overwrite databases via REST interface
by Braunschweig, Björn 15 Jan '20

15 Jan '20

Dear list, I have a use case where multiple distributed processes make use of a shared basex instance using the REST interface. Unfortunately executing PUT /rest/mydb creates an empty database regardless of whether it contains files or not. Is there a config option or something else to not overwrite existing databases? Otherwise I have to implement a locking mechanism. Regards, Björn

2 1

slow search performance across multiple databases
by Braunschweig, Björn 15 Jan '20

15 Jan '20

Hello everyone, First of all thank you for building such a great product! Unfortunately I encounter extremely slow queries using a basex instance. My xml files are distributed over 256 databases (00-ff) with roughly 250MB each. All share a structure similar to [3]. I executed OPTIMIZE ALL for all databases, see [4]. [5] shows the info index output. The linux server which is running the basex instance shows great amounts of io. I replicated the data to my local desktop and see the same amount of high io usage across all database files. For example: [data\81\tbl.basex, data\81\txt.basex, ..., etc] Querying a single database is fast and the info output window shows the following [2], but a query across all dbs just stalls and does not return a result in a reasonable time. Could somebody give me a hint how to speed things up? regards, Björn [1] Example query: ``` declare namespace mets = "http://www.loc.gov/METS/"; declare namespace lmerFile = "http://www.ddb.de/LMERfile"; count( for $db in db:list() for $doc in db:open($db) where $doc/koala/mets:mets/mets:amdSec/mets:techMD/mets:mdWrap/mets:xmlData/lmerFi le:format = 'urn:123' return $doc) ``` [2] ``` Compiling: - inline $db_0 - pre-evaluate db:open(database[,path]) to document-node() sequence: db:open("fe") -> (db:open-pre("fe", 0), ...) - rewrite cached filter to iter path: ((db:open-pre("fe", 0), ...))[(element(koala)/element(mets:mets)/element(mets:amdSec)/element(mets:t ... -> (db:open-pre("fe", 0), ...)/.[(element(koala)/element(mets:mets)/element(mets:amdSec)/element(mets: t... - rewrite where clause(s) - simplify FLWOR expression: (db:open-pre("fe", 0), ...)/.[(element(koala)/element(mets:mets)/element(mets:amdSec)/element(mets: t... Optimized Query: count((db:open-pre("fe", 0), ...)/.[(element(koala)/element(mets:mets)/element(mets:amdSec)/element(mets: techMD)/element(mets:mdWrap)/element(mets:xmlData)/element(lmerFile:format) = "urn:123")]) Query: declare namespace mets = "http://www.loc.gov/METS/"; declare namespace lmerFile = "http://www.ddb.de/LMERfile"; count( let $db := "fe" for $doc in db:open($db) where $doc/koala/mets:mets/mets:amdSec/mets:techMD/mets:mdWrap/mets:xmlData/lmerFi le:format = 'urn:123' return $doc) Result: - Hit(s): 1 Item - Updated: 0 Items - Printed: 4 b - Read Locking: (global) - Write Locking: (none) Timing: - Parsing: 0.41 ms - Compiling: 161.91 ms - Evaluating: 2155.26 ms - Printing: 0.86 ms - Total Time: 2318.44 ms Query Plan: <QueryPlan compiled="true" updating="false"> <FnCount name="count" type="xs:integer" size="1"> <IterPath type="document-node()*" database="fe"> <DBNodeSeq type="document-node()+" size="29196" database="fe"> <DBNode pre="0" type="document-node()" size="1" database="fe"/> <DBNode pre="245" type="document-node()" size="1" database="fe"/> <DBNode pre="417" type="document-node()" size="1" database="fe"/> <DBNode pre="679" type="document-node()" size="1" database="fe"/> <DBNode pre="945" type="document-node()" size="1" database="fe"/> </DBNodeSeq> <IterStep axis="self" test="node()" type="node()?"> <CmpG op="=" type="xs:boolean" size="1"> <IterPath type="element()*"> <IterStep axis="child" test="element(koala)" type="element()*"/> <IterStep axis="child" test="element(mets:mets)" type="element()*"/> <IterStep axis="child" test="element(mets:amdSec)" type="element()*"/> <IterStep axis="child" test="element(mets:techMD)" type="element()*"/> <IterStep axis="child" test="element(mets:mdWrap)" type="element()*"/> <IterStep axis="child" test="element(mets:xmlData)" type="element()*"/> <IterStep axis="child" test="element(lmerFile:format)" type="element()*"/> </IterPath> <Str type="xs:string" size="1">urn:123</Str> </CmpG> </IterStep> </IterPath> </FnCount> </QueryPlan> ``` [3] <?xml version="1.0" encoding="UTF-8"?> <koala> <aip> <parent_asset_id /> <asset_ingest_timestamp>2016-05-04 13-57-17-943000</asset_ingest_timestamp> <external_asset_id>urn:nbn:de:xyz</external_asset_id> <internal_asset_id>4e1f-82-45c5-37-1678e81f</internal_asset_id> <aip_is_deleted>false</aip_is_deleted> <aip_deletion_timestamp>2016-05-04 13-57-17-943000</aip_deletion_timestamp> <storage_backend>hdd</storage_backend> <aip_size>179810</aip_size> <asset_version>1</asset_version> </aip> <mets OBJID="" TYPE="ko" xsi:schemaLocation="http://www.loc.gov/METS/ http://www.loc.gov/standards/mets/mets.xsd http://www.ddb.de/LMERfile http://files.dnb.de/standards/lmer/lmer-file.xsd http://www.ddb.de/LMERobject http://files.dnb.de/standards/lmer/lmer-object.xsd http://www.ddb.de/LMERprocess http://files.dnb.de/standards/lmer/lmer-process.xsd http://purl.org/dc/elements/1.1/ http://dublincore.org/schemas/xmls/qdc/2003/04/02/dc.xsd" xmlns="http://www.loc.gov/METS/" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:lmerFile="http://www.ddb.de/LMERfile" xmlns:lmerObject="http://www.ddb.de/LMERobject" xmlns:lmerProcess="http://www.ddb.de/LMERprocess" xmlns:dc="http://purl.org/dc/elements/1.1/"> <metsHdr CREATEDATE="2015-03-23T11:03:19.079+01:00"> <agent ROLE="ARCHIVIST" TYPE="ORGANIZATION"> <name>test</name> <note>test</note> </agent> </metsHdr> <amdSec ID="AmdSec-0001"> <techMD ID="TechMD-LMER-Object"> <mdWrap ID="TechMD-LMER-Object-MdWrap" MIMETYPE="text/xml" MDTYPE="OTHER" OTHERMDTYPE="lmerObject" LABEL="LMERobject"> <xmlData> <lmerObject:persistentIdentifier>urn:nbn:de:test</lmerObject:persistentIdent ifier> <lmerObject:transferChecksum CHECKSUMTYPE="xor of sha1 file checksums">ac38416b34a7b1b55875798819220c092a77f3b7</lmerObject:transferChec ksum> <lmerObject:masterCreationDate>2015-03-23T11:03:19.080+01:00</lmerObject:mas terCreationDate> <lmerObject:metadataCreationDate>2015-03-23T11:03:19.080+01:00</lmerObject:m etadataCreationDate> <lmerObject:metadataRecordCreator>test</lmerObject:metadataRecordCreator> <lmerObject:numberOfFiles>1</lmerObject:numberOfFiles> </xmlData> </mdWrap> </techMD> <techMD ID="TechMD-File--0"> <mdWrap ID="TechMD-File--0-MDWRAP" MIMETYPE="text/xml" MDTYPE="OTHER" OTHERMDTYPE="lmerFile"> <xmlData> <lmerFile:format REGISTRYNAME="DIAS">urn:123</lmerFile:format> <lmerFile:xmlData MDTYPE="FITS"> <fits xsi:schemaLocation="http://hul.harvard.edu/ois/xml/ns/fits/fits_output http://files.dnb.de/standards/fits/fits_output_dnb.xsd" version="0.6.1" timestamp="23.03.15 09:24" xmlns="http://hul.harvard.edu/ois/xml/ns/fits/fits_output"> <identification status="SINGLE_RESULT"> <identity format="Portable Document Format" mimetype="application/pdf" toolname="FITS" toolversion="0.6.1"> <tool toolname="Droid" toolversion="3.0"/> <tool toolname="Jhove" toolversion="1.11"/> <tool toolname="file utility" toolversion="5.17"/> <tool toolname="Exiftool" toolversion="7.74"/> <tool toolname="NLNZ Metadata Extractor" toolversion="3.4GA"/> <tool toolname="ffident" toolversion="0.2"/> <version toolname="Droid" toolversion="3.0">1.6</version> <externalIdentifier toolname="Droid" toolversion="3.0" type="puid">fmt/20</externalIdentifier> </identity> </identification> <fileinfo> <size toolname="Jhove" toolversion="1.11">77973</size> <creatingApplicationName toolname="Jhove" toolversion="1.11">Acrobat 9.1.1 /InDesign: pictwpstops filter 1.0</creatingApplicationName> <lastmodified toolname="Exiftool" toolversion="7.74" status="SINGLE_RESULT">2015:03:23 09:24:57+01:00</lastmodified> <created toolname="Exiftool" toolversion="7.74" status="SINGLE_RESULT">2009:06:12 11:53:28+02:00</created> <filepath toolname="OIS File Information" toolversion="0.1" status="SINGLE_RESULT">/data/var/tmp/tomcatP-6/./impservice/GU_42_2009-S23-2 5.pdf</filepath> <filename toolname="OIS File Information" toolversion="0.1" status="SINGLE_RESULT">./impservice/GU_42_2009-S23-25.pdf</filename> <md5checksum toolname="OIS File Information" toolversion="0.1" status="SINGLE_RESULT">a2a1ff970c0f82dfce7e208b35eb5783</md5checksum> <fslastmodified toolname="OIS File Information" toolversion="0.1" status="SINGLE_RESULT">1427099097000</fslastmodified> </fileinfo> <filestatus> <well-formed toolname="Jhove" toolversion="1.11" status="SINGLE_RESULT">true</well-formed> <valid toolname="Jhove" toolversion="1.11" status="SINGLE_RESULT">true</valid> <message toolname="Jhove" toolversion="1.11" status="SINGLE_RESULT">Page information is not displayed; to display remove param value of p from the config file</message> <ingestLevel toolname="DidigO" toolversion="0.9" status="SINGLE_RESULT">4</ingestLevel> </filestatus> <metadata> <document> <pageCount toolname="Exiftool" toolversion="7.74" status="SINGLE_RESULT">3</pageCount> <isTagged toolname="Jhove" toolversion="1.11">no</isTagged> <hasOutline toolname="Jhove" toolversion="1.11">no</hasOutline> <hasAnnotations toolname="Jhove" toolversion="1.11" status="SINGLE_RESULT">no</hasAnnotations> <isRightsManaged toolname="Exiftool" toolversion="7.74" status="SINGLE_RESULT">no</isRightsManaged> <isProtected toolname="Exiftool" toolversion="7.74">no</isProtected> <isPdfA toolname="Exiftool" toolversion="7.74" status="SINGLE_RESULT">no</isPdfA> <hasForms toolname="NLNZ Metadata Extractor" toolversion="3.4GA" status="SINGLE_RESULT">no</hasForms> </document> </metadata> </fits> </lmerFile:xmlData> </xmlData> </mdWrap> </techMD> </amdSec> <fileSec> <fileGrp ID="ASSET" ADMID="TechMD-LMER-Object"> <file ID="FILE-0" ADMID="TechMD-File--0" CREATED="2015-08-13T11:03:19.006+01:00" SIZE="77973" CHECKSUM="ac38416b34a7bc092a77f3b7" CHECKSUMTYPE="SHA-1" MIMETYPE="application/pdf"> <FLocat LOCTYPE="URL" xlink:type="simple" xlink:href="file://./content/big.pdf"/> </file> </fileGrp> </fileSec> <structMap TYPE="ASSET"> <div ORDER="1" LABEL="File list" TYPE="ASSET"> <fptr FILEID="FILE-0"/> </div> </structMap> </mets> </koala> [4] Example for db 00: ``` BaseX 9.0.2 [Standalone] Try 'help' to get more information. > open 00 Database '00' was opened in 2040.58 ms. > info database Database Properties NAME: 00 SIZE: 269 MB NODES: 8782619 DOCUMENTS: 29471 BINARIES: 0 TIMESTAMP: 2020-01-09T13:31:43.000Z UPTODATE: true Resource Properties INPUTPATH: INPUTSIZE: 0 b INPUTDATE: 2020-01-09T06:37:10.793Z Indexes TEXTINDEX: true ATTRINDEX: true TOKENINDEX: false FTINDEX: true TEXTINCLUDE: ATTRINCLUDE: TOKENINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: true AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96 SPLITSIZE: 0 > ``` [5] Info Index Output: > info index Elements - Structure: Hash - Entries: 147 tool 185692x, leaf message 162967x, strings, leaf mdWrap 68088x xmlData 68088x techMD 68088x version 52735x, 22 distinct strings, leaf externalIdentifier 52319x, 28 distinct strings, leaf lmerFile:format 38617x, 15 distinct strings, leaf lmerFile:xmlData 38617x fits 38617x identification 38617x identity 38617x fileinfo 38617x filename 38617x, strings, leaf filepath 38617x, strings, leaf size 38617x, integers [948, 344172844], leaf md5checksum 38617x, strings, leaf fslastmodified 38617x, integers [1.354674301E12, 1.578101482E12], leaf filestatus 38617x ingestLevel 38617x, 4 distinct integers [1, 4], leaf metadata 38617x file 38617x FLocat 38617x, leaf fptr 38617x, leaf document 31004x well-formed 30515x, 2 distinct strings, leaf valid 30515x, 2 distinct strings, leaf lmerObject:metadataCreationDate 29471x, strings, leaf lmerObject:metadataRecordCreator 29471x, string, leaf lmerObject:numberOfFiles 29471x, 61 distinct integers [1, 235], leaf parent_asset_id 29471x, string, leaf fileSec 29471x fileGrp 29471x structMap 29471x div 29471x aip 29471x koala 29471x aip_is_deleted 29471x, leaf aip_deletion_timestamp 29471x, leaf storage_backend 29471x, string, leaf aip_size 29471x, integers [863, 1683060591], leaf asset_version 29471x, integer [1, 1], leaf mets 29471x metsHdr 29471x agent 29471x name 29471x, string, leaf note 29471x, string, leaf amdSec 29471x internal_asset_id 29471x, strings, leaf external_asset_id 29471x, strings, leaf asset_ingest_timestamp 29471x, strings, leaf lmerObject:persistentIdentifier 29471x, strings, leaf lmerObject:transferChecksum 29471x, strings, leaf lmerObject:masterCreationDate 29471x, strings, leaf isTagged 29315x, 2 distinct strings, leaf hasOutline 29315x, 2 distinct strings, leaf lastmodified 28499x, strings, leaf creatingApplicationName 28145x, strings, leaf isProtected 27796x, 2 distinct strings, leaf hasAnnotations 26362x, 2 distinct strings, leaf isRightsManaged 25577x, 4 distinct strings, leaf created 23912x, strings, leaf isPdfA 23902x, 2 distinct strings, leaf pageCount 23673x, integers [1, 3128], leaf hasForms 22050x, 2 distinct strings, leaf title 19639x, strings, leaf graphicsCount 19028x, integers [1, 20435], leaf author 12483x, strings, leaf pdfAVersion 11292x, 5 distinct strings, leaf language 8013x, 51 distinct strings, leaf lmerFile:category 7366x, string, leaf image 2118x imageWidth 2115x, integers [200, 7462], leaf bitsPerSample 2115x, 3 distinct strings, leaf imageHeight 2115x, integers [304, 10713], leaf YCbCrSubSampling 2084x, 4 distinct strings, leaf xSamplingFrequency 2083x, 55 distinct doubles [1, 1200], leaf ySamplingFrequency 2083x, 55 distinct doubles [1, 1200], leaf samplingFrequencyUnit 2082x, 3 distinct strings, leaf lightSource 1739x, 3 distinct strings, leaf channelMode 1649x, 3 distinct strings, leaf channels 1649x, 2 distinct integers [1, 2], leaf bitRate 1649x, 3 distinct integers [80000, 320000], leaf sampleRate 1649x, 2 distinct integers [44100, 48000], leaf audio 1649x text 1231x charset 1002x, 6 distinct strings, leaf markupBasis 940x, 3 distinct strings, leaf markupBasisVersion 939x, double [1, 1], leaf markupLanguage 735x, 2 distinct strings, leaf iccProfileName 708x, 15 distinct strings, leaf iccProfileVersion 708x, 6 distinct strings, leaf compressionScheme 578x, 3 distinct strings, leaf orientation 561x, 2 distinct strings, leaf scanningSoftwareName 533x, 66 distinct strings, leaf copyrightNote 481x, strings, leaf colorSpace 328x, 3 distinct strings, leaf samplesPerPixel 323x, 3 distinct integers [3, 5], leaf exifVersion 155x, 4 distinct integers [210, 230], leaf byteOrder 71x, string, leaf linebreak 58x, string, leaf YCbCrPositioning 21x, 2 distinct integers [1, 2], leaf apertureValue 16x, 11 distinct doubles [2.2, 13.4], leaf exposureBiasValue 16x, 2 distinct strings, leaf shutterSpeedValue 15x, 12 distinct strings, leaf flash 15x, 6 distinct strings, leaf digitalCameraModelName 15x, 13 distinct strings, leaf digitalCameraManufacturer 15x, 8 distinct strings, leaf isoSpeedRating 15x, 7 distinct integers [32, 1600], leaf focalLength 14x, 12 distinct doubles [4.2, 137], leaf exposureTime 14x, 11 distinct strings, leaf fNumber 14x, 9 distinct doubles [2.2, 6.3], leaf meteringMode 12x, 4 distinct strings, leaf maxApertureValue 10x, 5 distinct doubles [2.7, 4.9], leaf captureDevice 9x, string, leaf exposureProgram 8x, 4 distinct strings, leaf sensingMethod 8x, string, leaf inhibitorType 7x, 3 distinct strings, leaf scannerManufacturer 5x, 4 distinct strings, leaf scannerModelName 5x, 4 distinct strings, leaf creatingos 3x, string, leaf duration 2x, 2 distinct strings, leaf milliseconds 2x, 2 distinct integers [2209067, 6200496], leaf brightnessvalue 2x, 2 distinct doubles [3737910, 3737956.3692762186], leaf subjectDistance 2x, 2 distinct strings, leaf brightnessValue 2x, 2 distinct doubles [6.369276219, 9.768303187], leaf cfaPattern 2x, 2 distinct strings, leaf referenceBlackWhite 1x, string, leaf exposureIndex 1x, integer [100, 100], leaf usesStyleSheets 1x, string, leaf characterCount 1x, integer [451, 451], leaf wordCount 1x, integer [32, 32], leaf paragraphCount 1x, integer [1, 1], leaf gpsDateStamp 1x, string, leaf gpsLatitudeRef 1x, string, leaf gpsLatitude 1x, string, leaf gpsLongitudeRef 1x, string, leaf gpsLongitude 1x, string, leaf gpsAltitudeRef 1x, string, leaf gpsAltitude 1x, string, leaf gpsTimeStamp 1x, string, leaf gpsSpeedRef 1x, string, leaf gpsSpeed 1x, integer [0, 4.9E-324], leaf gpsImgDirectionRef 1x, string, leaf gpsImgDirection 1x, double [352.1332378, 352.1332378], leaf gpsDestBearingRef 1x, string, leaf gpsDestBearing 1x, double [352.1332378, 352.1332378], leaf Attributes - Structure: Hash - Entries: 31 toolversion 1175464x, 20 distinct strings, leaf toolname 1175464x, 11 distinct strings, leaf status 773429x, 2 distinct strings, leaf ID 233735x, strings, leaf TYPE 117884x, 3 distinct strings, leaf MIMETYPE 106705x, 11 distinct strings, leaf MDTYPE 106705x, 2 distinct strings, leaf xsi:schemaLocation 68088x, strings, leaf CHECKSUMTYPE 68088x, 2 distinct strings, leaf OTHERMDTYPE 68088x, 2 distinct strings, leaf ADMID 68088x, strings, leaf LABEL 58942x, 2 distinct strings, leaf type 52319x, string, leaf CREATED 38617x, strings, leaf SIZE 38617x, integers [948, 344172844], leaf CHECKSUM 38617x, strings, leaf LOCTYPE 38617x, string, leaf xlink:type 38617x, string, leaf xlink:href 38617x, strings, leaf FILEID 38617x, strings, leaf REGISTRYNAME 38617x, string, leaf version 38617x, string, leaf timestamp 38617x, strings, leaf format 38617x, 14 distinct strings, leaf mimetype 38617x, 11 distinct strings, leaf ROLE 29471x, string, leaf CREATEDATE 29471x, strings, leaf PROFILE 29471x, string, leaf OBJID 29471x, strings, leaf RECORDSTATUS 29471x, string, leaf ORDER 29471x, integer [1, 1], leaf Text Index - Structure: Sorted List - Names: - Size: 5866 kB - Entries: 446427 no 157290x 1 69949x true 52426x 4 31437x .... <removed for privacy reasons> .... Attribute Index - Structure: Sorted List - Names: - Size: 8288 kB - Entries: 242140 SINGLE_RESULT 738299x Jhove 442253x 1.11 435034x Exiftool 215455x 7.74 215455x OIS File Information 156783x 0.1 156783x Droid 129111x 3.0 129111x ASSET 88413x FITS 77234x 0.6.1 77234x text/xml 70424x NLNZ Metadata Extractor 68965x 3.4GA 68965x OTHER 68088x application/pdf 58972x TechMD-LMER-Object 58942x TechMD-File--0 58942x FILE-0 58942x puid 52319x simple 38617x lmerFile 38617x URL 38617x SHA-1 38617x 0.9 38617x 0.2 35663x CONFLICT 35130x ... 00472a0cefc564ddeeaf01ef4eedefa648ae10a7 1x 00445341-1a94-45d1-96e0-bfbd285d0d9b 1x 0042e488-c19a-4824-9619-d396230236ae 1x 0041e4bb7a4ab62e00a9292e5f99254c260fab9d 1x 0040b05044d6242c7c746b82ff20ba793ae95e83 1x 0040782b-c857-495f-a7b0-83aa0e359452 1x 004004d7946daa934ac3313bbe719a19204ac982 1x 003df86b-035b-44fa-9c3e-a0dfdcf385b7 1x 003db1fa9bf4eb1cc721e2944d3fc4128e18691b 1x 003d1d59ef25783c8b0b611c485ab94101419dae 1x 003a6afc-3d12-4e0a-afd6-a0fa27babc75 1x 003a273f76a52e69167bd7663ca5ba2333a51e8e 1x 0038393fd7440e962ab44397700290f67708322b 1x 00381c23-1181-4cdb-a389-280cee83fa8c 1x 003564e47d4b24eb4e36a29d951b0ba77ed36a41 1x 003493e5e743a8cb209170cd3545ab47281bf1fc 1x 0032449e-1641-4d7b-8eb6-c0b6ce4bd73e 1x 00306c1e-67f1-4653-b1af-6c9cc8f466e3 1x 002ef043-303b-4372-8747-d424ad5d06ab 1x 002e19fe325f1a79f9c07929ed9649e5a88598e2 1x 002d9889ac5e27206fbe44bf204ddf77ec6d825a 1x 0028ee044ab6547ff0d2d0f5cfdefee2202653d0 1x 0028a8563f280fc2f6d2234c8bd5a374348bea4b 1x 002834455c3cc319a94b5801770f4f4a7bdb6d5f 1x 0024e7afb42e3466305c8688df8b26e9722596fe 1x 002275c7fb5dbb62291ea1db105f6ddf354cd67a 1x 002122dacfe6e2c268421f9f5fcdc708fa64ba28 1x 00200878d71f7184518266e6962d868c6c341523 1x 001fa27f1c3c2aec81f2257ac975e0d24a825333 1x 001f194b917c9312038b8f9cba4a46b5c007d1aa 1x Token Index - Not available Full-Text Index - Names: - Size: 39 MB - Entries: 386830 pdf 183610x 1 181572x <removed for privacy reasons> Path Index doc(): 29471x koala: 29471x aip: 29471x parent_asset_id: 29471x, leaf text(): 25457x, 2 distinct strings, leaf asset_ingest_timestamp: 29471x, leaf text(): 29471x, strings, leaf external_asset_id: 29471x, leaf text(): 29471x, strings, leaf internal_asset_id: 29471x, leaf text(): 29471x, strings, leaf aip_is_deleted: 29471x, leaf aip_deletion_timestamp: 29471x, leaf storage_backend: 29471x, leaf text(): 29471x, string, leaf aip_size: 29471x, leaf text(): 29471x, integers [863, 1683060591], leaf asset_version: 29471x, leaf text(): 29471x, integer [1, 1], leaf mets: 29471x @OBJID: 29471x, strings, leaf @TYPE: 29471x, string, leaf @PROFILE: 29471x, string, leaf @xsi:schemaLocation: 29471x, strings, leaf metsHdr: 29471x @CREATEDATE: 29471x, strings, leaf @RECORDSTATUS: 29471x, string, leaf agent: 29471x @ROLE: 29471x, string, leaf @TYPE: 29471x, string, leaf name: 29471x, leaf text(): 29471x, string, leaf note: 29471x, leaf text(): 29471x, string, leaf amdSec: 29471x @ID: 29471x, string, leaf techMD: 68088x @ID: 68088x, strings, leaf mdWrap: 68088x @ID: 68088x, strings, leaf @MIMETYPE: 68088x, string, leaf @MDTYPE: 68088x, string, leaf @OTHERMDTYPE: 68088x, 2 distinct strings, leaf @LABEL: 29471x, string, leaf xmlData: 68088x lmerObject:persistentIdentifier: 29471x, leaf text(): 29471x, strings, leaf lmerObject:transferChecksum: 29471x, leaf @CHECKSUMTYPE: 29471x, string, leaf text(): 29471x, strings, leaf lmerObject:masterCreationDate: 29471x, leaf text(): 29471x, strings, leaf lmerObject:metadataCreationDate: 29471x, leaf text(): 29471x, strings, leaf lmerObject:metadataRecordCreator: 29471x, leaf text(): 29471x, string, leaf lmerObject:numberOfFiles: 29471x, leaf text(): 29471x, 61 distinct integers [1, 235], leaf lmerFile:format: 38617x, leaf @REGISTRYNAME: 38617x, string, leaf text(): 38617x, 15 distinct strings, leaf lmerFile:category: 7366x, leaf text(): 7366x, string, leaf lmerFile:xmlData: 38617x @MDTYPE: 38617x, string, leaf fits: 38617x @xsi:schemaLocation: 38617x, strings, leaf @version: 38617x, string, leaf @timestamp: 38617x, strings, leaf identification: 38617x @status: 38617x, string, leaf identity: 38617x @format: 38617x, 14 distinct strings, leaf @mimetype: 38617x, 11 distinct strings, leaf @toolname: 38617x, string, leaf @toolversion: 38617x, string, leaf tool: 185692x, leaf @toolname: 185692x, 8 distinct strings, leaf @toolversion: 185692x, 17 distinct strings, leaf version: 52735x, leaf @toolname: 52735x, 5 distinct strings, leaf @toolversion: 52735x, 10 distinct strings, leaf @status: 35130x, string, leaf text(): 52735x, 22 distinct strings, leaf externalIdentifier: 52319x, leaf @toolname: 52319x, string, leaf @toolversion: 52319x, double [3, 3], leaf @type: 52319x, string, leaf text(): 52319x, 28 distinct strings, leaf fileinfo: 38617x filename: 38617x, leaf @toolname: 38617x, 2 distinct strings, leaf @toolversion: 38617x, 4 distinct strings, leaf text(): 38617x, strings, leaf @status: 35296x, string, leaf filepath: 38617x, leaf @toolname: 38617x, 2 distinct strings, leaf @toolversion: 38617x, 4 distinct strings, leaf text(): 38617x, strings, leaf @status: 35296x, string, leaf size: 38617x, leaf @toolname: 38617x, 2 distinct strings, leaf @toolversion: 38617x, 3 distinct doubles [0.1, 1.5], leaf @status: 8957x, string, leaf text(): 38617x, integers [948, 344172844], leaf md5checksum: 38617x, leaf @toolname: 38617x, string, leaf @toolversion: 38617x, double [0.1, 0.1], leaf @status: 38617x, string, leaf text(): 38617x, strings, leaf fslastmodified: 38617x, leaf @toolname: 38617x, string, leaf @toolversion: 38617x, double [0.1, 0.1], leaf @status: 38617x, string, leaf text(): 38617x, integers [1.354674301E12, 1.578101482E12], leaf creatingApplicationName: 28145x, leaf @toolname: 28145x, 3 distinct strings, leaf @toolversion: 28145x, 4 distinct strings, leaf text(): 28145x, strings, leaf @status: 8983x, string, leaf lastmodified: 28499x, leaf @toolname: 28499x, string, leaf @toolversion: 28499x, double [7.74, 7.74], leaf @status: 28499x, string, leaf text(): 28499x, strings, leaf created: 23912x, leaf @toolname: 23912x, 2 distinct strings, leaf @toolversion: 23912x, 2 distinct strings, leaf @status: 23463x, string, leaf text(): 23912x, strings, leaf inhibitorType: 7x, leaf @toolname: 7x, string, leaf @toolversion: 7x, double [7.74, 7.74], leaf @status: 7x, string, leaf text(): 7x, 3 distinct strings, leaf copyrightNote: 481x, leaf @toolname: 481x, string, leaf @toolversion: 481x, double [7.74, 7.74], leaf @status: 481x, string, leaf text(): 481x, strings, leaf creatingos: 3x, leaf @toolname: 3x, string, leaf @toolversion: 3x, 3 distinct doubles [5.09, 5.32], leaf @status: 3x, string, leaf text(): 3x, string, leaf filestatus: 38617x well-formed: 30515x, leaf @toolname: 30515x, 2 distinct strings, leaf @toolversion: 30515x, 5 distinct strings, leaf @status: 30515x, string, leaf text(): 30515x, 2 distinct strings, leaf valid: 30515x, leaf @toolname: 30515x, 2 distinct strings, leaf @toolversion: 30515x, 5 distinct strings, leaf @status: 30515x, string, leaf text(): 30515x, 2 distinct strings, leaf ingestLevel: 38617x, leaf @toolname: 38617x, string, leaf @toolversion: 38617x, double [0.9, 0.9], leaf @status: 38617x, string, leaf text(): 38617x, 4 distinct integers [1, 4], leaf message: 162967x, leaf @toolname: 162967x, 2 distinct strings, leaf @toolversion: 162967x, 5 distinct strings, leaf @status: 162967x, string, leaf text(): 162967x, strings, leaf metadata: 38617x document: 31004x author: 12483x, leaf @toolname: 12483x, 3 distinct strings, leaf @toolversion: 12483x, 6 distinct strings, leaf @status: 5555x, string, leaf text(): 12467x, strings, leaf language: 8013x, leaf @toolname: 8013x, 3 distinct strings, leaf @toolversion: 8013x, 6 distinct strings, leaf @status: 3013x, string, leaf text(): 8013x, 51 distinct strings, leaf title: 19639x, leaf @toolname: 19639x, 3 distinct strings, leaf @toolversion: 19639x, 6 distinct strings, leaf @status: 10692x, string, leaf text(): 19402x, strings, leaf isRightsManaged: 25577x, leaf @toolname: 25577x, 2 distinct strings, leaf @toolversion: 25577x, 4 distinct strings, leaf @status: 25577x, string, leaf text(): 25577x, 4 distinct strings, leaf pageCount: 23673x, leaf @toolname: 23673x, 2 distinct strings, leaf @toolversion: 23673x, 2 distinct doubles [1.5, 7.74], leaf @status: 23534x, string, leaf text(): 23673x, integers [1, 3128], leaf graphicsCount: 19028x, leaf @toolname: 19028x, string, leaf @toolversion: 19028x, 2 distinct doubles [1.11, 1.5], leaf @status: 19028x, string, leaf text(): 19028x, integers [1, 20435], leaf isTagged: 29315x, leaf @toolname: 29315x, 2 distinct strings, leaf @toolversion: 29315x, 3 distinct strings, leaf text(): 29315x, 2 distinct strings, leaf @status: 10218x, string, leaf hasOutline: 29315x, leaf @toolname: 29315x, 2 distinct strings, leaf @toolversion: 29315x, 3 distinct strings, leaf text(): 29315x, 2 distinct strings, leaf @status: 10218x, string, leaf hasAnnotations: 26362x, leaf @toolname: 26362x, string, leaf @toolversion: 26362x, 2 distinct doubles [1.11, 1.5], leaf @status: 26362x, string, leaf text(): 26362x, 2 distinct strings, leaf isProtected: 27796x, leaf @toolname: 27796x, 2 distinct strings, leaf @toolversion: 27796x, 2 distinct strings, leaf text(): 27796x, 2 distinct strings, leaf @status: 9640x, string, leaf isPdfA: 23902x, leaf @toolname: 23902x, string, leaf @toolversion: 23902x, double [7.74, 7.74], leaf @status: 23902x, string, leaf text(): 23902x, 2 distinct strings, leaf hasForms: 22050x, leaf @toolname: 22050x, string, leaf @toolversion: 22050x, string, leaf @status: 22050x, string, leaf text(): 22050x, 2 distinct strings, leaf pdfAVersion: 11292x, leaf @toolname: 11292x, string, leaf @toolversion: 11292x, double [7.74, 7.74], leaf @status: 11292x, string, leaf text(): 11292x, 5 distinct strings, leaf text: 1231x charset: 1002x, leaf @toolname: 1002x, 3 distinct strings, leaf @toolversion: 1002x, 4 distinct strings, leaf text(): 1002x, 6 distinct strings, leaf @status: 204x, string, leaf markupBasis: 940x, leaf @toolname: 940x, 3 distinct strings, leaf @toolversion: 940x, 4 distinct strings, leaf text(): 940x, 3 distinct strings, leaf @status: 191x, string, leaf markupBasisVersion: 939x, leaf @toolname: 939x, 2 distinct strings, leaf @toolversion: 939x, 3 distinct strings, leaf text(): 939x, double [1, 1], leaf @status: 200x, string, leaf markupLanguage: 735x, leaf @toolname: 735x, string, leaf @toolversion: 735x, double [0.2, 0.2], leaf @status: 735x, string, leaf text(): 735x, 2 distinct strings, leaf linebreak: 58x, leaf @toolname: 58x, string, leaf @toolversion: 58x, double [1.11, 1.11], leaf @status: 58x, string, leaf text(): 58x, string, leaf usesStyleSheets: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, string, leaf @status: 1x, string, leaf text(): 1x, string, leaf characterCount: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, string, leaf @status: 1x, string, leaf text(): 1x, integer [451, 451], leaf wordCount: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, string, leaf @status: 1x, string, leaf text(): 1x, integer [32, 32], leaf paragraphCount: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, string, leaf @status: 1x, string, leaf text(): 1x, integer [1, 1], leaf image: 2118x imageWidth: 2115x, leaf @toolname: 2115x, 3 distinct strings, leaf @toolversion: 2115x, 3 distinct strings, leaf text(): 2115x, integers [200, 7462], leaf @status: 441x, string, leaf imageHeight: 2115x, leaf @toolname: 2115x, 3 distinct strings, leaf @toolversion: 2115x, 3 distinct strings, leaf text(): 2115x, integers [304, 10713], leaf @status: 441x, string, leaf iccProfileName: 708x, leaf @toolname: 708x, string, leaf @toolversion: 708x, double [7.74, 7.74], leaf @status: 708x, string, leaf text(): 708x, 15 distinct strings, leaf YCbCrSubSampling: 2084x, leaf @toolname: 2084x, string, leaf @toolversion: 2084x, double [7.74, 7.74], leaf @status: 2084x, string, leaf text(): 2084x, 4 distinct strings, leaf samplingFrequencyUnit: 2082x, leaf @toolname: 2082x, 3 distinct strings, leaf @toolversion: 2082x, 3 distinct strings, leaf text(): 2082x, 3 distinct strings, leaf @status: 394x, string, leaf xSamplingFrequency: 2083x, leaf @toolname: 2083x, 3 distinct strings, leaf @toolversion: 2083x, 3 distinct strings, leaf text(): 2083x, 55 distinct doubles [1, 1200], leaf @status: 394x, string, leaf ySamplingFrequency: 2083x, leaf @toolname: 2083x, 3 distinct strings, leaf @toolversion: 2083x, 3 distinct strings, leaf text(): 2083x, 55 distinct doubles [1, 1200], leaf @status: 394x, string, leaf iccProfileVersion: 708x, leaf @toolname: 708x, string, leaf @toolversion: 708x, double [7.74, 7.74], leaf @status: 708x, string, leaf text(): 708x, 6 distinct strings, leaf bitsPerSample: 2115x, leaf @toolname: 2115x, 3 distinct strings, leaf @toolversion: 2115x, 3 distinct strings, leaf text(): 2115x, 3 distinct strings, leaf @status: 441x, string, leaf lightSource: 1739x, leaf @toolname: 1739x, 2 distinct strings, leaf @toolversion: 1739x, 2 distinct strings, leaf @status: 1734x, string, leaf text(): 1739x, 3 distinct strings, leaf compressionScheme: 578x, leaf @toolname: 578x, 2 distinct strings, leaf @toolversion: 578x, 2 distinct doubles [1.5, 7.74], leaf @status: 577x, string, leaf text(): 578x, 3 distinct strings, leaf orientation: 561x, leaf @toolname: 561x, 2 distinct strings, leaf @toolversion: 561x, 2 distinct strings, leaf text(): 561x, 2 distinct strings, leaf @status: 76x, string, leaf scanningSoftwareName: 533x, leaf @toolname: 533x, string, leaf @toolversion: 533x, double [7.74, 7.74], leaf @status: 533x, string, leaf text(): 533x, 66 distinct strings, leaf colorSpace: 328x, leaf @toolname: 328x, 2 distinct strings, leaf @toolversion: 328x, 2 distinct doubles [1.5, 7.74], leaf @status: 327x, string, leaf text(): 328x, 3 distinct strings, leaf samplesPerPixel: 323x, leaf @toolname: 323x, 2 distinct strings, leaf @toolversion: 323x, 2 distinct doubles [1.5, 7.74], leaf @status: 322x, string, leaf text(): 323x, 3 distinct integers [3, 5], leaf YCbCrPositioning: 21x, leaf @toolname: 21x, string, leaf @toolversion: 21x, double [7.74, 7.74], leaf text(): 21x, 2 distinct integers [1, 2], leaf captureDevice: 9x, leaf @toolname: 9x, string, leaf @toolversion: 9x, double [7.74, 7.74], leaf @status: 9x, string, leaf text(): 9x, string, leaf digitalCameraManufacturer: 15x, leaf @toolname: 15x, string, leaf @toolversion: 15x, double [7.74, 7.74], leaf @status: 15x, string, leaf text(): 15x, 8 distinct strings, leaf digitalCameraModelName: 15x, leaf @toolname: 15x, string, leaf @toolversion: 15x, double [7.74, 7.74], leaf @status: 15x, string, leaf text(): 15x, 13 distinct strings, leaf fNumber: 14x, leaf @toolname: 14x, string, leaf @toolversion: 14x, double [7.74, 7.74], leaf text(): 14x, 9 distinct doubles [2.2, 6.3], leaf exposureTime: 14x, leaf @toolname: 14x, string, leaf @toolversion: 14x, double [7.74, 7.74], leaf text(): 14x, 11 distinct strings, leaf isoSpeedRating: 15x, leaf @toolname: 15x, string, leaf @toolversion: 15x, double [7.74, 7.74], leaf @status: 15x, string, leaf text(): 15x, 7 distinct integers [32, 1600], leaf exifVersion: 155x, leaf @toolname: 155x, string, leaf @toolversion: 155x, double [7.74, 7.74], leaf text(): 155x, 4 distinct integers [210, 230], leaf @status: 24x, string, leaf shutterSpeedValue: 15x, leaf @toolname: 15x, string, leaf @toolversion: 15x, double [7.74, 7.74], leaf @status: 15x, string, leaf text(): 15x, 12 distinct strings, leaf apertureValue: 16x, leaf @toolname: 16x, string, leaf @toolversion: 16x, double [7.74, 7.74], leaf text(): 16x, 11 distinct doubles [2.2, 13.4], leaf exposureBiasValue: 16x, leaf @toolname: 16x, string, leaf @toolversion: 16x, double [7.74, 7.74], leaf @status: 16x, string, leaf text(): 16x, 2 distinct strings, leaf maxApertureValue: 10x, leaf @toolname: 10x, string, leaf @toolversion: 10x, double [7.74, 7.74], leaf text(): 10x, 5 distinct doubles [2.7, 4.9], leaf meteringMode: 12x, leaf @toolname: 12x, string, leaf @toolversion: 12x, double [7.74, 7.74], leaf text(): 12x, 4 distinct strings, leaf flash: 15x, leaf @toolname: 15x, string, leaf @toolversion: 15x, double [7.74, 7.74], leaf text(): 15x, 6 distinct strings, leaf focalLength: 14x, leaf @toolname: 14x, string, leaf @toolversion: 14x, double [7.74, 7.74], leaf text(): 14x, 12 distinct doubles [4.2, 137], leaf sensingMethod: 8x, leaf @toolname: 8x, string, leaf @toolversion: 8x, double [7.74, 7.74], leaf text(): 8x, string, leaf referenceBlackWhite: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf text(): 1x, string, leaf scannerManufacturer: 5x, leaf @toolname: 5x, string, leaf @toolversion: 5x, double [7.74, 7.74], leaf @status: 5x, string, leaf text(): 5x, 4 distinct strings, leaf scannerModelName: 5x, leaf @toolname: 5x, string, leaf @toolversion: 5x, double [7.74, 7.74], leaf @status: 5x, string, leaf text(): 5x, 4 distinct strings, leaf exposureProgram: 8x, leaf @toolname: 8x, string, leaf @toolversion: 8x, double [7.74, 7.74], leaf text(): 8x, 4 distinct strings, leaf subjectDistance: 2x, leaf @toolname: 2x, string, leaf @toolversion: 2x, double [7.74, 7.74], leaf text(): 2x, 2 distinct strings, leaf cfaPattern: 2x, leaf @toolname: 2x, string, leaf @toolversion: 2x, double [7.74, 7.74], leaf text(): 2x, 2 distinct strings, leaf byteOrder: 71x, leaf @toolname: 71x, string, leaf @toolversion: 71x, double [1.5, 1.5], leaf @status: 71x, string, leaf text(): 71x, string, leaf exposureIndex: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf text(): 1x, integer [100, 100], leaf brightnessValue: 2x, leaf @toolname: 2x, string, leaf @toolversion: 2x, double [7.74, 7.74], leaf @status: 2x, string, leaf text(): 2x, 2 distinct doubles [6.369276219, 9.768303187], leaf brightnessvalue: 2x, leaf @toolname: 2x, string, leaf @toolversion: 2x, string, leaf @status: 2x, string, leaf text(): 2x, 2 distinct doubles [3737910, 3737956.3692762186], leaf gpsLatitudeRef: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsLatitude: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsLongitudeRef: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsLongitude: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsAltitudeRef: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsAltitude: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsTimeStamp: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsSpeedRef: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsSpeed: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, integer [0, 4.9E-324], leaf gpsImgDirectionRef: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsImgDirection: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, double [352.1332378, 352.1332378], leaf gpsDestBearingRef: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf gpsDestBearing: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, double [352.1332378, 352.1332378], leaf gpsDateStamp: 1x, leaf @toolname: 1x, string, leaf @toolversion: 1x, double [7.74, 7.74], leaf @status: 1x, string, leaf text(): 1x, string, leaf audio: 1649x bitRate: 1649x, leaf @toolname: 1649x, string, leaf @toolversion: 1649x, double [7.74, 7.74], leaf @status: 1647x, string, leaf text(): 1649x, 3 distinct integers [80000, 320000], leaf sampleRate: 1649x, leaf @toolname: 1649x, string, leaf @toolversion: 1649x, double [7.74, 7.74], leaf @status: 1647x, string, leaf text(): 1649x, 2 distinct integers [44100, 48000], leaf channels: 1649x, leaf @toolname: 1649x, string, leaf @toolversion: 1649x, double [7.74, 7.74], leaf @status: 1647x, string, leaf text(): 1649x, 2 distinct integers [1, 2], leaf channelMode: 1649x, leaf @toolname: 1649x, string, leaf @toolversion: 1649x, double [7.74, 7.74], leaf @status: 1649x, string, leaf text(): 1649x, 3 distinct strings, leaf duration: 2x, leaf @toolname: 2x, string, leaf @toolversion: 2x, string, leaf @status: 2x, string, leaf text(): 2x, 2 distinct strings, leaf milliseconds: 2x, leaf @toolname: 2x, string, leaf @toolversion: 2x, string, leaf @status: 2x, string, leaf text(): 2x, 2 distinct integers [2209067, 6200496], leaf fileSec: 29471x fileGrp: 29471x @ID: 29471x, string, leaf @ADMID: 29471x, string, leaf file: 38617x @ID: 38617x, strings, leaf @ADMID: 38617x, strings, leaf @CREATED: 38617x, strings, leaf @SIZE: 38617x, integers [948, 344172844], leaf @CHECKSUM: 38617x, strings, leaf @CHECKSUMTYPE: 38617x, string, leaf @MIMETYPE: 38617x, 11 distinct strings, leaf FLocat: 38617x, leaf @LOCTYPE: 38617x, string, leaf @xlink:type: 38617x, string, leaf @xlink:href: 38617x, strings, leaf structMap: 29471x @TYPE: 29471x, string, leaf div: 29471x @ORDER: 29471x, integer [1, 1], leaf @LABEL: 29471x, string, leaf @TYPE: 29471x, string, leaf fptr: 38617x, leaf @FILEID: 38617x, strings, leaf

3 7

Bug merging maps with option duplicates:combine?
by Johannes Echterhoff 10 Jan '20

10 Jan '20

Hello, When executing: map:merge(( map { "DENW21AL100077Hs": "a", "DENW21AL100076i5": "a" }, map { "DENW21AL100077Hs": "b", "DENW21AL100076i5": "b", "DENW21AL100076hT": "b" } ), map {'duplicates': 'combine'}) in the BaseX GUI I get: Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.3.1 Java: AdoptOpenJDK, 1.8.0_212 OS: Windows 10, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 2 at org.basex.query.value.map.TrieList.add(TrieList.java:199) at org.basex.query.value.map.TrieList.addAll(TrieList.java:141) at org.basex.query.value.map.XQMap.addAll(XQMap.java:106) at org.basex.query.func.map.MapMerge.item(MapMerge.java:33) at org.basex.query.func.StandardFunc.optimize(StandardFunc.java:82) at org.basex.query.expr.Arr.compile(Arr.java:43) at org.basex.query.scope.MainModule.comp(MainModule.java:81) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) at org.basex.query.QueryContext.compile(QueryContext.java:312) at org.basex.query.QueryProcessor.compile(QueryProcessor.java:79) at org.basex.core.cmd.AQuery.query(AQuery.java:93) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:422) at org.basex.gui.GUI.lambda$4(GUI.java:365) at java.lang.Thread.run(Thread.java:748) Best regards, Johannes

4 4

Running BaseX from the command line
by Philip Spaelti 07 Jan '20

07 Jan '20

I have made occasional tries at using BaseX for my project over the years. After a longer pause I am trying again. I downloaded the latest version (9.1.3). If I try to start BaseX from the command line it starts a version 7.9 and asks we if I want to update. Can someone please explain what is going on? Philip

2 3

Config error
by Philip Spaelti 07 Jan '20

07 Jan '20

When I try to run the basexhttp script I get the following error: BaseX 9.3.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @259ms to org.eclipse.jetty.util.log.Slf4jLog [main] WARN org.eclipse.jetty.xml.XmlConfiguration - Config error at <Call name="addConnector"><Arg> <New class="org.eclipse.jetty.server.nio.SelectChannelConnector"><Set name="host"><SystemProperty name="org.basex.serverhost" default="0.0.0.0"/></Set><Set name="port"><SystemProperty name="org.basex.serverport" default="8984"/></Set><Set name="maxIdleTime">60000</Set><Set name="reuseAddress">true</Set><Set name="Acceptors">2</Set></New> </Arg></Call> org.eclipse.jetty.server.nio.SelectChannelConnector

1 0

Client software and command scripts
by Ben Engbers 06 Jan '20

06 Jan '20

Hi Christian, I read in the documentation that a client should not only be able to execute commands but should also be able to execute command scripts. My question is if a command script (a file with extension '.bxs') is passed as a 'path' to the execute-command or is the client supposed to read the file, line by line, and then executing each line separately? Cheers, Ben

2 5

Happy New Year! -- A #DigitialHumanities/#MachineLearning #CitizenScientist needs you help... :-)
by Jim Salmons 04 Jan '20

04 Jan '20

Hello Christian & the BaseX Community, Happy New Year and Decade! I will get to my specific BaseX/XQuery question below, but first some long but mostly necessary context... I am a 69-year-old post-cancer #PayItForward indie #CitizenScientist working at the intersection of #DigitalHumanities and #AI/#MachineLearning. I am developing the #MAGAZINEgts ground-truth storage format for serial publications (primarily print magazines and newspapers). My format is based on a ontological stack of CIDOC-CRM, FRBRoo, and PRESSoo, and utilizes a metamodel subgraph design pattern to support integrated complex document structure and content depiction models. In addition, my fellow cancer-surviving wife and I are developing a reference implementation of the #MAGAZINEgts format for the 48-issue run of Softalk magazine published between 1980 and 1984 during the dawn of the Microcomputer and Digital Age. Post-cancer and with determination to reinvent ourselves as Citizen Scientists in the Digital Humanities, we funded digitization of our magazine collection into the Internet Archive as a gift to each other for our 25th wedding anniversary. Initially, I did all our exploratory #MAGAZINEgts prototyping development in Python using import/export of data via JSON format with one-off scripts to format batches of information into XML format to fold into the published #MAGAZINEgts file for the Softalk magazine reference implementation at the Archive. Then I found BaseX!!! :D Upon discovering BaseX, I began using it for direct #MAGAZINEgts XML access and development. The FactMiners Toolkit is, at this stage, the old pre-BaseX stuff plus the new features related to the generation of balanced training datasets for #MachineLearning model training. I am in the process now of revisiting my early development and refactoring it to incorporate BaseX direct editing. I recently completed the generation of a "seed"/master dataset for all the advertisements in Softalk magazine (https://github.com/SoftalkAppleProject/datasets_ml_all_ads_1M). This seed dataset can be used in conjunction with the PRESSoo Issuing Rules of the Advertising Model in the Metamodel partition of the #MAGAZINEgts file. This "seed" dataset and the metamodel can be used to generate any "slice and dice" dataset for #ML model training that is aware of the interrelationships of advertisements' size, shape, and allowable positions on variously formatted multi-column pages. (If this domain of research interests anyone, please do not hesitate to contact me. I can point you to our #DATeCH papers/posters and Neo4j #GraphGists, etc. for more information. You will also find relevant links to our research on the GitHub repo cited above.) Now on to my specific question/request-for-information... To generate #MachineLearning training datasets, I need to not only slice-and-dice the "actual" data of the advertisement dataset, I also need to incorporate page examples which DO NOT include the document structure being trained to be recognized. In other words, the "non-label" instances of a #ML training dataset are the members of the set-theoretic complement of pages that DO have advertisements. Fortunately and by design, the #MAGAZINEgts format incorporates all the information to do this dataset generation... the problem is that I have only ever known enough XML-related technologies to "git'er done." And even whatever I may have known is long-since gone following my cancer battle. Now, given the OCD-ness of my basic personality structure, I thought it would be best to develop a solution to present before asking for community help... and here I am. The digital collection of Softalk magazine is in the Internet Archive here: https://archive.org/details/softalkapple?sort=date The #MAGAZINEgts file for Softalk magazine is here: https://archive.org/download/softalkapple/softalkapple_publication.xml For simplicity's sake during my exploratory/learning experience, I import the softalkapple_publication.xml file into BaseX with the "strip namespaces" option checked and rename the imported database as 'MAGgts'. My problem is not that I cannot generate the non-label dataset, but rather that this query takes roughly around 30 seconds to execute!? Honestly, the fact that this query works is all I need. But given the world of modern near-instantaneous responses to virtually all data inquiries, I am wondering if there is a far better solution to my problem. (Also note, the somewhat strange format of the returned results -- 'NoAdPg' elements wrapped within a 'Result' element is for the convenience of bringing this data into Python to be parsed by the 'xmltodict' module.) If it turns out that this 30+-second run is, in fact, justified due to the unseen actual computations being done, no problem. An explanation of why that much processing power is needed is one possible response to this inquiry. On the other hand, there is a vast domain of XQuery know-how that I am blind to and would value any explanation and optimization that can be suggested to speed this operation up. Here is my current 30+-second query: ====== (: Round up a list by issue of the leaf images of Softalk magazine that DO NOT have an advertisement on them and that excludes Cover 1, inserts (e.g. 'blow-in' cards), and missing pages... :) (: The softalkapple_publication.xml file from the Internet Archive's Softalk collection is imported as 'MAGgts' into BaseX XML database, with stripped namespaces for interactive development/learning convenience. :) (: This NS declaration is not needed when namespaces are stripped. declare default element namespace "http://www.factminers.org/MAGAZINE/gts/2019-01-18"; :) declare variable $ad_index := doc('MAGgts')//AdIndex/*; (: Gather all issues in the Leaf2ppg map (page image to print page number map) :) declare variable $all_issues := doc('MAGgts')//Metadata//Leaf2ppg_map[1]/*; if (count($all_issues) > 0) then (<Result>{for $issue in $all_issues return (for $leaf_spec in $issue/* let $leaf_id := $leaf_spec/Issue_id let $leaf_pgnum := $leaf_spec/PageNum let $leaf_type := $leaf_spec/PgType where ($leaf_pgnum != 'Cover1' and $leaf_pgnum != 'Insert Stub' and $leaf_pgnum != 'Insert Content' and $leaf_type != 'MissingPgs') return (if (exists($ad_index[PageNum = $leaf_pgnum and Issue_id = $leaf_id])) (: We're not interested in pages w/ ads, only those WITHOUT ads :) then () else <NoAdPg> <LeafNum>{data($leaf_spec/@leafnum)}</LeafNum> {$leaf_spec/(Issue_id | PgType | PageNum) }</NoAdPg> ))}</Result>) else "Nothing found." ====== Again, Happy New Year/Decade. Any explanation or optimization greatly appreciated. Happy-Healthy Vibes from Colorado, -: Jim :-

2 2

Syntax to use profiling functions on updating functions
by France Baril 31 Dec '19

31 Dec '19

Hi, I can't seem to use the profiling functions on updating functions. I was wondering if it's a known limit or if I just need to use a different syntax in this context. For example in an updating function that returns 2 updates, I have something like this declare updating function > translation:import-and-process-returned-translations($package-number as > xs:string) { > .... some code .... > return ( > translation:save-space-issues($package-name, $space-issues) => > prof:time('Translate save space issues: '), > translation:save-source-mismatches($package-name, > $source-mismatches) => prof:time('Translate save source mismatches: '), > translation:save-zhtw-brackets-issues($menu-id, $package-name) => > prof:time('Translate check zhtw brackets, not saved?: ') > ) > }; This works with the prof:time, but if I try to profile, I get: [XUST0001] Expressions must all be updating or return an empty sequence. Thanks! P.S. By the way, I'm very excited about the improvements I am able to implement now that I can use the performance functions in this module. I'm one version late to say this, but awesome addition! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 30 Dec '19

30 Dec '19

3 2

Parsing MusicXML files
by Joe Curtis 29 Dec '19

29 Dec '19

I am trying to solve a problem transferring musical information between two high end scoring programs using the industry standard MusicXML language. Although the majority (say 95%) of information is transferred correctly the remainder does not because the originating program gives a general classification of <words> in the file whilst the receiving program has a more sophisticated breakdown of the information. Rather than classifying it incorrectly it doesn't translate the information at all. The information occurs randomly throughout the score rather than in a regular pattern. What I am trying to do is read the MusicXML file and list the <words> where they occur together with the part identification and measure (bar) number to enable me to add the information manually at a later stage. I have come across BaseX while researching how to parse the files but am struggling to master the logic of xquery to achieve my aim. The structure of the file at my interest level is:-  <measure number="27" width="224"> <direction> <direction-type> <words default-x="9" default-y="20" justify="left" valign="middle" font-family="Times New Roman" font-style="normal" font-size="5.9683" font-weight="normal">tutti</words> and my xquery entries are:- let $score := doc('score')/score-partwise(:/part/measure/direction/direction-type/words:) for $word in ($score//words/text()) let $p := $score/part/@id let $m := $score/part/measure/@number return $word, $p, $m If I return just $word I get the relevant <words>entries but if I add $p and $m I get an error message 'undeclared variable $p' I realise that this is more of an xquery question than BaseX but I thought I would come here first. Any help would be greatly appreciated. Joe Curtis .

2 1

Update to a single document changes @modified-date on all DB documents in db:list-details()
by France Baril 29 Dec '19

29 Dec '19

Hi, I'm running a few tests after upgrading a web application to 9.3.1. I have this issue where I am trying to get the documents modified since a certain date/time. However, even is a single document is modified db:list-details returns the same modified-date for all listed documents. To reproduce; 1. Run list-details() on a DB to see dates. 2. Thought WebDAV, modify one of the document in the DB 3. Run list-details() again on that DB. Expected result: the @modifed-date should be different on the document modified in #2 Actual result: all documents have a new @modified-date. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Lost prof:time in terminal after upgrade to 9.3.1
by France Baril 28 Dec '19

28 Dec '19

Hi, After upgrading to 9.3.1, I no longer get my prof:time info in the terminal. DEBUG is set to true in .basex and I don't remember changing any option on in older installations to enable prof:time. Documentation of profiling module doesn't mention any required settings and I'm not seeing a note in the CHANGELOG either. What am I missing? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 1

Re: [basex-talk] HTTPServer + gzip compression
by Stefan Koch 23 Dec '19

23 Dec '19

1 0

R package
by Ben Engbers 23 Dec '19

23 Dec '19

Hi, Some years ago, I have written a R-client for BaseX. That client used a R-file that could be sourced into your R-code (https://github.com/BaseXdb/basex/tree/master/basex-api/src/main/r/RbaseXCli…). Since not all functions from the server protocol were implemented, I decided to rewrite the client and build a package. This package has now been accepted by Cran (https://cran.r-project.org/web/packages/RBaseX/index.html). I am still working on some improvements but that will take some time. In the meantime, enjoy it. Ben Engbers

1 0

Improper use or potential bug
by France Baril 23 Dec '19

23 Dec '19

This .xq works the first time when returning db:create. However, once the DB are created, if I run it again, files are note replaced. Instead, I get java.lang.ArrayIndexOutOfBoundsException. I can send the DB in private if necessary for debugging. The result is not exactly an index, it's just flattening a few levels of indirection to make future queries faster. I was testing this on 9.2.3. Also a side question, is there a way to rewrite this query so not all DBs are locked? I get lock: global. I would like to lock only DBs that start with 'index-prompt-' I tried hard coding the prefix in the db:create and db:replace fonctions but that didn't help. Since I will have this running on a loop (cannot catch updated on src DB), I don't want to lock the whole system each time this query is running. It does take a good 12 seconds to run. (: USAGE: for $prompt in db:attribute('index-prompt-en-us', 'setup_as_new', 'name')/.. return $prompt => prof:time() :) let $langs := for $lang in db:list()[string-length(.) = 5][substring(., 3, 1) = '-'] return $lang return for $lang in $langs let $index-db := 'index-prompt-' || $lang let $prompt-file-name := 'prompts-' || $lang || '.xml' let $index := <index>{ for $string-group in db:open('global-content')//*[name()='string-group'] let $prompt-this-lang := $string-group/child::*[@xml:lang=$lang][normalize-space(.)!=''] let $prompt-base := if (exists($prompt-this-lang)) then $prompt-this-lang else $string-group/child::*[@xml:lang='en-us'] let $p2 := db:attribute('global-content', $string-group/data(@key), 'key')/..[name()='prompt'][ancestor::*[last()]/name()='prompt-refs'][@package=$string-group/data(@package)][@pkg-version=$string-group/data(@pkg-version)] let $prompts := ( for $prompt-match in $p2 return copy $copy := $prompt-base modify ( for $attr in $prompt-match/@*[name()!='package' and name()!='pkg-version' and name()!='key'] return insert node $attr into $copy ) return $copy ) return $prompts }</index> return if (db:exists($index-db)) then db:replace($index-db, $prompt-file-name, $index) else db:create($index-db, $index, $prompt-file-name , map { 'updindex': true() }) -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

UPDINDEX on custom index structures not working... where is my missing link?
by France Baril 21 Dec '19

21 Dec '19

Hi, I'm trying to build something that is similar to custom indices but that actually returns resolved nodes (nodes created by manipulating and merging nodes from the original DB). 1- I created a script that creates new index DBs. UPDINDEX and AUTOOPTIMIZED are set on both the 'index' DB and the DB from which the new DBs were created 2- I can create a query on any of the new 'index' DBs to extract the nodes I want. 3- After I change the content in the source DB, the response shows that the nodes in the 'index' DBs are not updated. I get the old result. I feel that I am missing a link between the source and the index DBs to make the update mechanism work. Since I do not want to get the original node, but one that I create, I did not use db:node-id or db:open-id shown in the documentation example. Is that where the link is created? CODE THAT CREATES THE INDEX DBs let $langs := for $lang in ('en-us', 'es-es') (:db:list()[string-length(.) = 5][substring(., 3, 1) = '-']:) return $lang return for $lang in $langs let $index := <index>{ for $string-group in db:open('global-content')//*[name()='string-group'] let $prompt-this-lang := $string-group/child::*[@xml:lang=$lang][normalize-space(.)!=''] let $prompt-base := if (exists($prompt-this-lang)) then $prompt-this-lang else $string-group/child::*[@xml:lang='en-us'] let $prompts := for $prompt-match in db:open('global-content')/*[name()='prompt-refs']/*[name()='prompt'][@package=$string-group/data(@package)][@pkg-version=$string-group/data(@pkg-version)][@key=$string-group/data(@key)] return copy $copy := $prompt-base modify ( for $attr in $prompt-match/@*[name()!='package' and name()!='pkg-version' and name()!='key'] return insert node $attr into $copy ) return $copy return $prompts }</index> return db:create('index-prompt-' || $lang, $index, 'prompts-' || $lang || '.xml', map { 'updindex': true(), 'autooptimize': true() }) CODE THAT QUERIES THE 'INDEX' DBS (# db:enforceindex #) { for $prompt in db:attribute('index-prompt-en-us', 'setup_as_new', 'name')/.. return $prompt => prof:time() } -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 7

BaseX 9.3.1: Bug Fixes, Performance Tweaks
by Christian Grün 20 Dec '19

20 Dec '19

Hi all, A new BaseX maintenance release is available. It contains minor bug fixes and performance tweaks: http://basex.org Have fun with the new release, have a good time, Christian BaseX Team

1 0

How many QueryModule instances can be created?
by Johannes Echterhoff 18 Dec '19

18 Dec '19

Hello, We are struggling with a situation where we have built a custom Java QueryModule (as described in http://docs.basex.org/wiki/Java_Bindings) - let's call it M1, and that module is imported by two other XQuery modules (let's call them M2 and M3). When executing an XQuery that imports M1 and the other XQuery modules M2 and M3 within the BaseX GUI, multiple different instances of M1 are created. That is an issue, because we initialise the module M1 with some information (a custom geometry index) before calling any other function of M1. This initialization shall only occur once, because it is quite time-consuming. Also, the information from this initialization procedure must be available whenever the (non-initialization) functions of M1 are called - whether in the XQuery or the other modules M2 and M3. The situation is as follows: * testquery.xq imports the custom module M1 * testquery.xq also imports the XQuery modules M2 and M3, which are stored in other XQuery files; M2 and M3 both import M1 * the custom module is initialized in testquery.xq - not in M2 and M3 * non-initialization functions of M1 are called in testquery.xq, as well as by functions declared in M2 and M3 - but only after initialization functions of M1 have been called in testquery.xq We get exceptions when functions of M1 are called by functions declared in M2 and M3, apparently because multiple instances of M1 have been created by BaseX (tested with the BaseX GUI), and only one of them has been initialized (in testquery.xq). After this lengthy introduction of the issue at hand, here are my questions: * Is it expected behavior that multiple instances of a Java QueryModule (M1, in my scenario) may be created and used during an execution of a query scenario like the one described above - or in general? Or should there only ever be a single such instance, regardless of how many times the module is imported? o Note: The functions used to initialize M1 are non-deterministic and declared as such. Not entirely sure if that makes a difference regarding how many times M1 would be created. * I have the same questions for the case that the Java QueryModule M1 was packaged in a XAR (as described in http://docs.basex.org/wiki/Repository#EXPath_Packaging). Would such a packaging approach actually make any difference? Apologies that I do not have a small, self-contained example project to demonstrate this. I hope that I explained the issue with sufficient detail and clarity. If not, just let me know. Best regards, Johannes P.S.: If you have suggestions for a better approach of handling such a scenario, where a QueryModule must be initialized before it can be used, and there shall only be a single instance of this module within the execution of an XQuery, let me know.

2 8

Re: [basex-talk] Huge No of XML files.
by Liam R. E. Quin 18 Dec '19

18 Dec '19

On Wed, 2019-12-18 at 11:10 +0530, Sreenivasulu Yadavalli wrote: > > > What exactly do you mean by moving collections around?. > > A: moving the collections in the same system. So, you use the Linux "mv" command to do this? Or what? What exactly do you mean by collections? I for one would find it easier if you would stop talking in riddles, as my telepathy skills are weak. > And every day we have to > update the existing collection with call data. So finding the > collection is > taking more time How do you look for the collection? Isn't it a separate BaseX database? > > Are you taking a database with 100 million documents and renaming > 50,000 of them? > > What operations exactly are slow? > > A: finding the existing collection. find / -name collection.db ? This is a little frustrating in that you are asking for people's help but not explaining the problem. Are you saying that fn:collection() is slow in BaseX? What arguments are you passing it exactly? What is the size, in gigabytes, of the database, on disk? How many documents are in it? Can you give step-by-step EXACT AND PRECISSE instructions so someone else could reproduce the problem you have having? Complete and exact instructions, with sample files if needed, so they can reproduce the problem on their own computer? A database with 80,000 files is easy to "find" here, and opens quickly, in a small fraction of a second. It doesn't take hours. Is something else running on your computer that makes it slow?? Note: please remember to copy the list in your replies, as the BaseX people are far more knowledgeable about BaseX than i am :) My goal as an analyst is to get you to explain the problem you are having clearly enough that you can get an answer :) Liam -- Liam Quin, https://www.delightfulcomputing.com/ Available for XML/Document/Information Architecture/XSLT/ XSL/XQuery/Web/Text Processing/A11Y training, work & consulting. Barefoot Web-slave, antique illustrations: http://www.fromoldbooks.org

1 0

Text index
by Giuseppe G. A. Celano 12 Dec '19

12 Dec '19

Hi, I am wondering whether it is possible to use indexes in a script even if a database is not created explicitly/previously. I see that sometimes, when comparing different XML texts accessed via doc(), text indexes are automatically created/used, but it is not clear to me whether/how I can specify/force the use of them also in the script. Thanks. Best, Giuseppe

2 1

Xslt:processor() and xslt:version() incorrect with Saxon 9.1B
by Majewski, Steven Dennis (sdm7g) 12 Dec '19

12 Dec '19

I have noticed that BaseX xslt:processor() and xslt:version() returns incorrect info when used with Saxon 9.1B It appears to identify it as a Saxon processor, and assumes it’s Saxon HE and version 3.0 . This is different from what the XSLT system-property function returns. ( I’m using Saxon9B because I have stylesheets based on that version that use external java functions. I’m going to be updating these to use BaseX XQuery functions to pass params into the stylesheet instead of those external functions internal to the stylesheets, and I was hoping I could use those xslt:processor() function to keep track of which Saxon library was active as I was migrating the stylesheets. Setting CLASSPATH on the command line works OK for that use case, but I’m working on RESTXQ web apps, so I need to keep track of config when web app was started. ) Xq/processor.xq: let $XS := <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0" > <xsl:output method="text" /> <xsl:template match="/" > <xsl:value-of select="system-property( 'xsl:vendor' )" />, <xsl:value-of select="system-property( 'xsl:vendor-url' )" /> XSLT Version=<xsl:value-of select="system-property( 'xsl:version' )" /> </xsl:template> </xsl:stylesheet> return (xslt:transform-text( <null/>, $XS ), concat('(', xslt:processor(), ', Version:', xslt:version(), ')') ) $ basex Xq/processor.xq Apache Software Foundation (Xalan XSLTC), http://xml.apache.org/xalan-j XSLT Version=1.0 (Java, Version:1.0) $ CLASSPATH=$SAXON9HE basex Xq/processor.xq Saxonica, http://www.saxonica.com/ XSLT Version=3.0 (Saxon HE, Version:3.0) $ CLASSPATH=$SAXON91B basex Xq/processor.xq SAXON 9.1.0.8 from Saxonica, http://www.saxonica.com/ XSLT Version=2.0 (Saxon HE, Version:3.0) I think it would be better to make XQuery xslt functions return the same values as XSLT system-property function. However, I would understand why you might not want to make an incompatible and slower change to current behavior, especially for a rather rare use case. If you keep the current behavior, I suggest a documentation note about how the function determines that value and that it may not be accurate in all circumstances. I can obviously write my own function as above to get correct values. ( I know I mostly only write to this list when I have a problem or find an issue, however this *really* is a very solid implementation. Thank You! ) — Steve Majewski

2 1

running in parallel
by celano＠informatik.uni-leipzig.de 09 Dec '19

09 Dec '19

Hi, I am trying to run two BaseX scripts in parallel using: xquery:fork-join( ( function() {xquery:eval(xs:anyURI('extract_from_ocr1.xq'))} , function (){xquery:eval(xs:anyURI('extract_from_ocr2.xq'))} ) ) As far as I can understand (read below), the scripts are kind of run in parallel, but still the time benefit of that does not seem much in comparison with running in sequence (~25s vs ~28s). The files contain the same function, which reads files from a directory, performs some calculation, and saves the result in a file (the two scripts work on different directories). I infer that the previous script is run in parallel because the files for the results are created at the same time. I tried to do the same with GNU parallel, and in that case the files are actually run in parallel. Do we know why the execution time is not (more or less) halved in BaseX? Thanks. Ciao, Giuseppe

5 5

Weird: mixed content trimmed unexpectedly
by Arjan Loeffen 09 Dec '19

09 Dec '19

Dear BaseX People, after many (happy!) projects using BaseX I have found that curl -i -X PUT --basic --user admin ^ -H "Content-Type: application/xml" -d "<text> test for <element/> me </text>" "http://localhost:8984/rest/LeapinLists/test.xml" stores <text>test for<element/>me</text> To the database. Notice the spaces in the XML string. What may have caused this behavior? Any suggestions on what to do here? I tried it on Basex 9.3, the latest edition right now. -- *Arjan Loeffen* Armatiek BV & Armatiek Solutions BV 06-12918997

6 8

file pattern when creating DB
by radim-havlicek＠post.cz 09 Dec '19

09 Dec '19

Hello, I would like to ask about filters. I'd like to call XQuery db:create("DB", "c:/Temp/defaultDocuments/", "/") but with filter pattern * becase without that pattern it adds *.xml files only. I would like to add all files from that directory and sub-directories. Is it possible to put the filter pattern there? I discovered ADD TO / "C:/Temp/defaultDocuments" does exactly what I want, but I would much rather use XQuery like db:create or db:add("DB", "Temp/defaultDocuments", "/") but the db:add filters the files with *.xml. Is it posssible to add all files with any XQuery? Thank in advance for your reply. Best regards, Radim Havlicek

3 6

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk