PostgreSQL/PostGIS format not supported in OGR installed in postgis/alpine image

[davidlec]

Hello,

I want to use ogr2ogr, directly from the postgis/postgis:16-3.4-alpine image, to load geopackage into the postgreSQL database, but I got the error that the PostgreSQL/PostGIS format in not supported. Effectively this format is not listed when I execute ogrinfo --formats.

Is there any way to solve my problem? I try some solutions proposed, but none are working. Initially I was using the Debian:bullseye version of the image, but since I need an earlier version of GEOS, I try to make it work on Alpine. Thanks for your help.

[ImreSamu]

but since I need an earlier version of GEOS, I try to make it work on Alpine.

Alpine usually includes more recent versions of GEOS, PROJ, and GDAL, but these are maintained by Alpine maintainers, who generally aim for minimal size, so I don't have a simple solution for that.

I'm not sure if I fully understand your requirements,
but if you need relatively recent versions of GEOS and GDAL, here are some options you could try for ogr2ogr:

1.) The postgis/postgis:16-master image includes development versions of GDAL and GEOS.

2.) You could try the ~test system ( https://github.com/ImreSamu/docker-postgis ) with the following image:
imresamu/postgis:16-3.4-bookworm ( GEOS=3.11, GDAL=3.6, PROJ=9.1, and SFCGAL=1.4. )

3.) Alternatively, from the test system, you could use the experimental recent image, which contains the latest versions of everything.
It is built weekly from source, and if something is missing, it's easier to integrate it than into a Debian or Alpine package:
imresamu/postgis:16-recent-bookworm ( PostGIS=3.4.3, GEOS=3.13.0, PROJ=9.5.0, GDAL=3.9.2, CGAL=5.6.1, SFCGAL=1.5.2 )

4.) Another option to try (though I haven't tested it) is to use the GDAL project's latest Docker image:
https://github.com/OSGeo/gdal/tree/master/docker
You can use this for ogr2ogr and connect it to the PostGIS service via docker-compose.

---

for example:

$ docker run -it --rm imresamu/postgis:16-recent-bookworm bash -c "ogrinfo --formats" 
Supported Formats:
  FITS -raster,vector- (rw+): Flexible Image Transport System (*.fits)
  PCIDSK -raster,vector- (rw+v): PCIDSK Database File (*.pix)
  netCDF -raster,multidimensional raster,vector- (rw+s): Network Common Data Format (*.nc)
  PDS4 -raster,vector- (rw+vs): NASA Planetary Data System 4 (*.xml)
  VICAR -raster,vector- (rw+v): MIPL VICAR file
  JP2OpenJPEG -raster,vector- (rwv): JPEG-2000 driver based on JP2OpenJPEG library (*.jp2, *.j2k)
  PDF -raster,vector- (w+): Geospatial PDF (*.pdf)
  MBTiles -raster,vector- (rw+v): MBTiles (*.mbtiles)
  BAG -raster,multidimensional raster,vector- (rw+v): Bathymetry Attributed Grid (*.bag)
  EEDA -vector- (ro): Earth Engine Data API
  OGCAPI -raster,vector- (rov): OGCAPI
  ESRI Shapefile -vector- (rw+v): ESRI Shapefile (*.shp, *.dbf, *.shz, *.shp.zip)
  MapInfo File -vector- (rw+v): MapInfo File (*.tab, *.mif, *.mid)
  UK .NTF -vector- (rov): UK .NTF
  LVBAG -vector- (rov): Kadaster LV BAG Extract 2.0 (*.xml)
  OGR_SDTS -vector- (rov): SDTS
  S57 -vector- (rw+v): IHO S-57 (ENC) (*.000)
  DGN -vector- (rw+v): Microstation DGN (*.dgn)
  OGR_VRT -vector- (rov): VRT - Virtual Datasource (*.vrt)
  Memory -vector- (rw+): Memory
  CSV -vector- (rw+v): Comma Separated Value (.csv) (*.csv, *.tsv, *.psv)
  GML -vector- (rw+v): Geography Markup Language (GML) (*.gml, *.xml)
  GPX -vector- (rw+v): GPX (*.gpx)
  LIBKML -vector- (rw+v): Keyhole Markup Language (LIBKML) (*.kml, *.kmz)
  KML -vector- (rw+v): Keyhole Markup Language (KML) (*.kml)
  GeoJSON -vector- (rw+v): GeoJSON (*.json, *.geojson)
  GeoJSONSeq -vector- (rw+v): GeoJSON Sequence (*.geojsonl, *.geojsons)
  ESRIJSON -vector- (rov): ESRIJSON (*.json)
  TopoJSON -vector- (rov): TopoJSON (*.json, *.topojson)
  OGR_GMT -vector- (rw+v): GMT ASCII Vectors (.gmt) (*.gmt)
  GPKG -raster,vector- (rw+vs): GeoPackage (*.gpkg, *.gpkg.zip)
  SQLite -vector- (rw+v): SQLite / Spatialite (*.sqlite, *.db)
  WAsP -vector- (rw+v): WAsP .map format (*.map)
  PostgreSQL -vector- (rw+): PostgreSQL/PostGIS
  OpenFileGDB -raster,vector- (rw+v): ESRI FileGDB (*.gdb)
  DXF -vector- (rw+v): AutoCAD DXF (*.dxf)
  CAD -raster,vector- (rovs): AutoCAD Driver (*.dwg)
  FlatGeobuf -vector- (rw+v): FlatGeobuf (*.fgb)
  Geoconcept -vector- (rw+v): Geoconcept (*.gxt, *.txt)
  GeoRSS -vector- (rw+v): GeoRSS
  VFK -vector- (ro): Czech Cadastral Exchange Data Format (*.vfk)
  PGDUMP -vector- (w+v): PostgreSQL SQL dump (*.sql)
  OSM -vector- (rov): OpenStreetMap XML and PBF (*.osm, *.pbf)
  GPSBabel -vector- (rw+): GPSBabel (*.mps, *.gdb, *.osm, *.tcx, *.igc)
  OGR_PDS -vector- (rov): Planetary Data Systems TABLE
  WFS -vector- (rov): OGC WFS (Web Feature Service)
  OAPIF -vector- (ro): OGC API - Features
  SOSI -vector- (ro): Norwegian SOSI Standard
  EDIGEO -vector- (rov): French EDIGEO exchange format (*.thf)
  SVG -vector- (rov): Scalable Vector Graphics (*.svg)
  Idrisi -vector- (rov): Idrisi Vector (.vct) (*.vct)
  XLS -vector- (ro): MS Excel format (*.xls)
  ODS -vector- (rw+v): Open Document/ LibreOffice / OpenOffice Spreadsheet (*.ods)
  XLSX -vector- (rw+v): MS Office Open XML spreadsheet (*.xlsx, *.xlsm)
  Elasticsearch -vector- (rw+): Elastic Search
  Carto -vector- (rw+): Carto
  AmigoCloud -vector- (rw+): AmigoCloud
  SXF -vector- (rov): Storage and eXchange Format (*.sxf)
  Selafin -vector- (rw+v): Selafin
  JML -vector- (rw+v): OpenJUMP JML (*.jml)
  PLSCENES -raster,vector- (ro): Planet Labs Scenes API
  CSW -vector- (ro): OGC CSW (Catalog  Service for the Web)
  VDV -vector- (rw+v): VDV-451/VDV-452/INTREST Data Format (*.txt, *.x10)
  MVT -vector- (rw+v): Mapbox Vector Tiles (*.mvt, *.mvt.gz, *.pbf)
  NGW -raster,vector- (rw+s): NextGIS Web
  MapML -vector- (rw+v): MapML
  Parquet -vector- (rw+v): (Geo)Parquet (*.parquet)
  Arrow -vector- (rw+v): (Geo)Arrow IPC File Format / Stream (*.arrow, *.feather, *.arrows, *.ipc)
  GTFS -vector- (rov): General Transit Feed Specification (*.zip)
  PMTiles -vector- (rw+v): ProtoMap Tiles (*.pmtiles)
  JSONFG -vector- (rw+v): OGC Features and Geometries JSON (*.json)
  MiraMonVector -vector- (rw+v): MiraMon Vectors (.pol, .arc, .pnt) (*.pol, *.arc, *.pnt)
  TIGER -vector- (rov): U.S. Census TIGER/Line
  AVCBin -vector- (rov): Arc/Info Binary Coverage
  AVCE00 -vector- (rov): Arc/Info E00 (ASCII) Coverage (*.e00)
  HTTP -raster,vector- (ro): HTTP Fetching Wrapper

or

$ docker run -it --rm ghcr.io/osgeo/gdal:alpine-small-latest  sh -c "ogrinfo --formats" 
Supported Formats: (ro:read-only, rw:read-write, +:update, v:virtual-I/O s:subdatasets)
  PCIDSK -raster,vector- (rw+v): PCIDSK Database File (*.pix)
  PDS4 -raster,vector- (rw+vs): NASA Planetary Data System 4 (*.xml)
  VICAR -raster,vector- (rw+v): MIPL VICAR file
  JP2OpenJPEG -raster,vector- (rwv): JPEG-2000 driver based on JP2OpenJPEG library (*.jp2, *.j2k)
  PDF -raster,vector- (w+): Geospatial PDF (*.pdf)
  MBTiles -raster,vector- (rw+v): MBTiles (*.mbtiles)
  EEDA -vector- (ro): Earth Engine Data API
  OGCAPI -raster,vector- (rov): OGCAPI
  ESRI Shapefile -vector- (rw+v): ESRI Shapefile (*.shp, *.dbf, *.shz, *.shp.zip)
  MapInfo File -vector- (rw+v): MapInfo File (*.tab, *.mif, *.mid)
  UK .NTF -vector- (rov): UK .NTF
  LVBAG -vector- (rov): Kadaster LV BAG Extract 2.0 (*.xml)
  OGR_SDTS -vector- (rov): SDTS
  S57 -vector- (rw+v): IHO S-57 (ENC) (*.000)
  DGN -vector- (rw+v): Microstation DGN (*.dgn)
  OGR_VRT -vector- (rov): VRT - Virtual Datasource (*.vrt)
  Memory -vector- (rw+): Memory
  CSV -vector- (rw+v): Comma Separated Value (.csv) (*.csv, *.tsv, *.psv)
  GML -vector- (rw+v): Geography Markup Language (GML) (*.gml, *.xml)
  GPX -vector- (rw+v): GPX (*.gpx)
  KML -vector- (rw+v): Keyhole Markup Language (KML) (*.kml)
  GeoJSON -vector- (rw+v): GeoJSON (*.json, *.geojson)
  GeoJSONSeq -vector- (rw+v): GeoJSON Sequence (*.geojsonl, *.geojsons)
  ESRIJSON -vector- (rov): ESRIJSON (*.json)
  TopoJSON -vector- (rov): TopoJSON (*.json, *.topojson)
  OGR_GMT -vector- (rw+v): GMT ASCII Vectors (.gmt) (*.gmt)
  GPKG -raster,vector- (rw+vs): GeoPackage (*.gpkg, *.gpkg.zip)
  SQLite -vector- (rw+v): SQLite / Spatialite (*.sqlite, *.db)
  WAsP -vector- (rw+v): WAsP .map format (*.map)
  PostgreSQL -vector- (rw+): PostgreSQL/PostGIS
  OpenFileGDB -raster,vector- (rw+v): ESRI FileGDB (*.gdb)
  DXF -vector- (rw+v): AutoCAD DXF (*.dxf)
  CAD -raster,vector- (rovs): AutoCAD Driver (*.dwg)
  FlatGeobuf -vector- (rw+v): FlatGeobuf (*.fgb)
  Geoconcept -vector- (rw+v): Geoconcept (*.gxt, *.txt)
  GeoRSS -vector- (rw+v): GeoRSS
  VFK -vector- (ro): Czech Cadastral Exchange Data Format (*.vfk)
  PGDUMP -vector- (w+v): PostgreSQL SQL dump (*.sql)
  OSM -vector- (rov): OpenStreetMap XML and PBF (*.osm, *.pbf)
  GPSBabel -vector- (rw+): GPSBabel (*.mps, *.gdb, *.osm, *.tcx, *.igc)
  OGR_PDS -vector- (rov): Planetary Data Systems TABLE
  WFS -vector- (rov): OGC WFS (Web Feature Service)
  OAPIF -vector- (ro): OGC API - Features
  EDIGEO -vector- (rov): French EDIGEO exchange format (*.thf)
  SVG -vector- (rov): Scalable Vector Graphics (*.svg)
  Idrisi -vector- (rov): Idrisi Vector (.vct) (*.vct)
  ODS -vector- (rw+v): Open Document/ LibreOffice / OpenOffice Spreadsheet (*.ods)
  XLSX -vector- (rw+v): MS Office Open XML spreadsheet (*.xlsx, *.xlsm)
  Elasticsearch -vector- (rw+): Elastic Search
  Carto -vector- (rw+): Carto
  AmigoCloud -vector- (rw+): AmigoCloud
  SXF -vector- (rov): Storage and eXchange Format (*.sxf)
  Selafin -vector- (rw+v): Selafin
  JML -vector- (rw+v): OpenJUMP JML (*.jml)
  PLSCENES -raster,vector- (ro): Planet Labs Scenes API
  CSW -vector- (ro): OGC CSW (Catalog  Service for the Web)
  VDV -vector- (rw+v): VDV-451/VDV-452/INTREST Data Format (*.txt, *.x10)
  MVT -vector- (rov): Mapbox Vector Tiles (*.mvt, *.mvt.gz, *.pbf)
  NGW -raster,vector- (rw+s): NextGIS Web
  MapML -vector- (rw+v): MapML
  GTFS -vector- (rov): General Transit Feed Specification (*.zip)
  PMTiles -vector- (rov): ProtoMap Tiles (*.pmtiles)
  JSONFG -vector- (rw+v): OGC Features and Geometries JSON (*.json)
  MiraMonVector -vector- (rw+v): MiraMon Vectors (.pol, .arc, .pnt) (*.pol, *.arc, *.pnt)
  TIGER -vector- (rov): U.S. Census TIGER/Line
  AVCBin -vector- (rov): Arc/Info Binary Coverage
  AVCE00 -vector- (rov): Arc/Info E00 (ASCII) Coverage (*.e00)
  HTTP -raster,vector- (ro): HTTP Fetching Wrapper

[davidlec]

1.) The postgis/postgis:16-master image includes development versions of GDAL and GEOS.

I already try this option, it solve my problem, but using the latest version of libraries is problematic. ( For example, the GEOS version is 3.14.dev and it that version there is a bug in the ST_Relate function which don't return expected results )

2.) You could try the ~test system ( https://github.com/ImreSamu/docker-postgis ) with the following image: imresamu/postgis:16-3.4-bookworm ( GEOS=3.11, GDAL=3.6, PROJ=9.1, and SFCGAL=1.4. )

3.) Alternatively, from the test system, you could use the experimental recent image, which contains the latest versions of everything. It is built weekly from source, and if something is missing, it's easier to integrate it than into a Debian or Alpine package: imresamu/postgis:16-recent-bookworm ( PostGIS=3.4.3, GEOS=3.13.0, PROJ=9.5.0, GDAL=3.9.2, CGAL=5.6.1, SFCGAL=1.5.2 )

For solution 2 and 3 I have an error when I try to create a new database in the image. Here is what I got:

ERROR:  The template database was created using collation version 2.31, but the operating system provides version 2.36.template database "template1" has a collation version mismatch 

ERROR:  template database "template1" has a collation version mismatch
SQL state: XX000
Detail: The template database was created using collation version 2.31, but the operating system provides version 2.36.
Hint: Rebuild all objects in the template database that use the default collation and run ALTER DATABASE template1 REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.

4.) Another option to try (though I haven't tested it) is to use the GDAL project's latest Docker image: https://github.com/OSGeo/gdal/tree/master/docker You can use this for ogr2ogr and connect it to the PostGIS service via docker-compose.

I already try this, but we have problem connecting 2 container, it work well with docker-compose, but our final use in singularity image and it's not working for now.

[ImreSamu]

Maybe you can extend the postgis/postgis:16-3.4-alpine image.
like:

FROM  postgis/postgis:16-3.4-alpine
RUN apk search --no-cache  gdal*
RUN apk add --no-cache  gdal-driver-all gdal-tools

test:

$ docker run -it --rm postgis:16-3.4-alpine-full-gdal sh -c  "ogrinfo --formats | grep Post"
  PostgreSQL -vector- (rw+): PostgreSQL/PostGIS
  PGDUMP -vector- (w+v): PostgreSQL SQL dump (*.sql)

Or you can customize - installing only the important gdal-driver:

$ docker run -it --rm postgis/postgis:16-3.4-alpine sh -c "apk search --no-cache  gdal*"
fetch https://dl-cdn.alpinelinux.org/alpine/v3.20/main/x86_64/APKINDEX.tar.gz
fetch https://dl-cdn.alpinelinux.org/alpine/v3.20/community/x86_64/APKINDEX.tar.gz
gdal-3.9.2-r0
gdal-bash-completion-3.9.2-r0
gdal-dev-3.9.2-r0
gdal-doc-3.9.2-r0
gdal-driver-all-3.9.2-r0
gdal-driver-arrow-3.9.2-r0
gdal-driver-basisu_ktx2-3.9.2-r0
gdal-driver-cad-3.9.2-r0
gdal-driver-carto-3.9.2-r0
gdal-driver-elastic-3.9.2-r0
gdal-driver-exr-3.9.2-r0
gdal-driver-fits-3.9.2-r0
gdal-driver-gif-3.9.2-r0
gdal-driver-gmlas-3.9.2-r0
gdal-driver-hana-3.9.2-r0
gdal-driver-hdf5-3.9.2-r0
gdal-driver-heif-3.9.2-r0
gdal-driver-jp2openjpeg-3.9.2-r0
gdal-driver-jpeg-3.9.2-r0
gdal-driver-jpegxl-3.9.2-r0
gdal-driver-kea-3.9.2-r0
gdal-driver-libkml-3.9.2-r0
gdal-driver-mssqlspatial-3.9.2-r0
gdal-driver-mysql-3.9.2-r0
gdal-driver-netcdf-3.9.2-r0
gdal-driver-odbc-3.9.2-r0
gdal-driver-ogdi-3.9.2-r0
gdal-driver-parquet-3.9.2-r0
gdal-driver-pcidsk-3.9.2-r0
gdal-driver-pcraster-3.9.2-r0
gdal-driver-pdf-3.9.2-r0
gdal-driver-pg-3.9.2-r0
gdal-driver-plscenes-3.9.2-r0
gdal-driver-png-3.9.2-r0
gdal-driver-postgisraster-3.9.2-r0
gdal-driver-tiledb-3.9.2-r0
gdal-driver-vfk-3.9.2-r0
gdal-driver-webp-3.9.2-r0
gdal-driver-wms-3.9.2-r0
gdal-driver-xls-3.9.2-r0
gdal-tools-3.9.2-r0
java-gdal-3.9.2-r0
py3-gdal-3.9.2-r0
py3-gdal-pyc-3.9.2-r0

ERROR: The template database was created using collation version 2.31,

Ouch ... it is a "known" database initialisation problem ( if the database directory is not empty )

Based on the Official Docker Postgres Doc : --locale-provider=icu is recommended

• https://github.com/docker-library/docs/tree/master/postgres#locale-customization
  • $ docker run -d -e LANG=de_DE.utf8 -e POSTGRES_INITDB_ARGS="--locale-provider=icu --icu-locale=de-DE" -e POSTGRES_PASSWORD=mysecretpassword postgres:15-alpine
• https://www.postgresql.org/docs/16/locale.html#LOCALE-PROVIDERS
  • --locale-provider=icu --icu-locale=en

Or don't change the [ bullseye <--> bookworm ]

• Docker image for version 15.3 throws collation warnings docker-library/postgres#1099
• or need a imresamu/postgis:16-recent-bullseye image

[davidlec]

FROM  postgis/postgis:16-3.4-alpine
RUN apk search --no-cache  gdal*
RUN apk add --no-cache  gdal-driver-all gdal-tools

This solution finally works, thank you!

Also setting POSTGRES_INITDB_ARGS seem to solve the other problem. Thanks