thijsbrentjens / stetl

Stetl, Streaming ETL, is a lightweight, geospatial ETL framework. Stetl uses existing transformation tools like GDAL/OGR and XSLT and is glued through Python. A config file specifies an ETL chain of modules. Stetl is speed-optimized by using native calls like ogr2ogr, libxml and libxslt (via lxml). Stetl is in particularly meant in ETL cases where either ogr2ogr or XSLT alone is not sufficient. This mostly involves schema transformations as required for INSPIRE and local GML-based complex datasets. Stetl has proven to be able to handle 10's of millions of features/records through a technique dubbed "gml-splitting" (and outputting into a deegree blobstore, which could be dubbed "gml-spitting").