Hi all I would be too interested in this type of feature (geospacial indexes). This leads to more general feature: schema aware processing. Currently (as far as I know) the dateTime values are indexed as strings, what is in many cases quite inefficient. Knowing the type of the value and using related type of index could lead to much more efficient queries.

On the other hand we must accept, that this type of feature brings quite some complexity - e.g. one has to provide schemas for the data, what to do, if some xml file is not following the schema etc.

It reminds me my old CAD programming times - my client told me, "stay in 2D as long as you can, 3D is not adding but multiplexing the complexity of the work".

This said I would completely understand BaseX team sticking with current "easy" way of doing things.

With best regards

Jan

*Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky@gmail.com http://cz.linkedin.com/in/vlcinsky

On 3 January 2012 10:45, Erdal Karaca erdal.karaca.de@googlemail.comwrote:

That is a great question.

I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-)

[Forgot to "reply to all", i.e. this message was already sent to Ingo]

2012/1/2 Schildmann, Ingo Schildmann@karb.de

...

Hi,

Our company evaluates BaseX for our project.

A new requirement is to show spatial data with a geographic information system.

Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?

http://exist-db.org/extensions.html#module_spatial

Regards, Ingo

Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann

---

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

-- 1 + 1 = 10

---

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

Hi Jan,

This leads to more general feature: schema aware processing. Currently (as far as I know) the dateTime values are indexed as strings, what is in many cases quite inefficient. Knowing the type of the value and using related type of index could lead to much more efficient queries.

this is something we may want to tackle with the next major update of the database layout (BaseX 8.0). We can't promise, though, if we'll introduce schema aware processing. Instead, we'll rather improve our runtime analysis of incoming data, and store it the most efficient way, and the optimizations will also work for documents without schema information.

What kind of geospatial queries (EXPath vs MarkLogic vs eXist) would you like to see introduced?

Christian

20 GB uncompressed. FYI/Hint: Here is a mapping of the OSM xml structure: http://wiki.openstreetmap.org/wiki/API_v0.6/XSD

2012/1/7 Christian Grün christian.gruen@gmail.com

Erdal,

thanks for your report. How large was the total, uncompressed size of the file you were reading in?

Christian ___________________________

On Tue, Jan 3, 2012 at 10:45 AM, Erdal Karaca < erdal.karaca.de@googlemail.com> wrote:

...

That is a great question.

I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-)

[Forgot to "reply to all", i.e. this message was already sent to Ingo]

2012/1/2 Schildmann, Ingo Schildmann@karb.de

...

Hi,

Our company evaluates BaseX for our project.

A new requirement is to show spatial data with a geographic information system.

Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?

http://exist-db.org/extensions.html#module_spatial

Regards, Ingo

Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann

---

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

-- 1 + 1 = 10

---

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

Am Samstag, 7. Januar 2012, 17:03:40 schrieb Christian Grün:

...

20 GB uncompressed. FYI/Hint: Here is a mapping of the OSM xml structure: http://wiki.openstreetmap.org/wiki/API_v0.6/XSD

Thanks. Out of interest: at what stage did BaseX stop the import? Do you have a link to the original file?

I found this: http://download.geofabrik.de/osm/europe/germany.osm.bz2

---

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

Would be nice to have KML support in addition to GML, but I suppose there are tools to support GML use with Google Maps, for example: http://www.dyasdesigns.com/geoxml/

MarkLogic supports multiple formats: The Geo module provides support for geospatial queries using GML, KML, GeoRSS/Simple, or Metacarta Geospatial markup.

Sure would be exciting to have geospatial in BaseX!

Eric

On Fri, Jan 6, 2012 at 10:55 AM, Rositsa Shadura < rositsa.shadura@uni-konstanz.de> wrote:

Hi Ingo, hi all,

until now we at BaseX have not discussed the implementation of a geospatial API. However, I would like to ask you what is actually your requirement: a module which provides functions for querying spatial data or a feature for indexing such data or both? :) I ask because the replies from Jan and Erdal referred to indexes, while this from Eric was more about a module for querying such data. Currently there is a specification provided by EXPath[1] which defines an extensive geospatial API. The only implementation of this specification is, as far as I know, this provided by Zorba[2]. The ones offerred by eXist[3] and MarkLogic[4] do not follow it or provide just a subset of the functions in it. Do you think that an implementation of the EXPath geospatial API would be useful for you?

Regards, Rositsa

[1] http://expath.org/spec/geo [2] http://zorba-xquery.com/site2/**doc/latest/zorba/xqdoc/xhtml/** expath.org_ns_geo.htmlhttp://zorba-xquery.com/site2/doc/latest/zorba/xqdoc/xhtml/expath.org_ns_geo.html [3] http://demo.exist-db.org/**exist/functions/spatialhttp://demo.exist-db.org/exist/functions/spatial [4] http://developer.marklogic.**com/pubs/4.0/apidocs/GEO.htmlhttp://developer.marklogic.com/pubs/4.0/apidocs/GEO.html

On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo Schildmann@karb.de wrote:

Hi,

...

Our company evaluates BaseX for our project.

A new requirement is to show spatial data with a geographic information system.

Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?

http://exist-db.org/**extensions.html#module_spatialhttp://exist-db.org/extensions.html#module_spatial

Regards, Ingo

Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de http://www.karb.de/ Mail: schildmann@karb.de mailto:schildmann@karb.de Skype: ischildmann

-- Using Opera's revolutionary email client: http://www.opera.com/mail/

______________________________**_________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-**konstanz.de BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.**de/mailman/listinfo/basex-talkhttps://mailman.uni-konstanz.de/mailman/listinfo/basex-talk