GDAL Cli Snippets

Useful examples working with GDAL

gdaladdo

Add overviews to *.tif files in batch mode

for i in `find *.tif`; do gdaladdo -r average $i 2 4 8 16 32; done

ogrinfo

Create spatial index (*.qix) to shapefiles in batch mode

for i in `find *.shp |cut -d '.' -f 1 ` ; do echo ogrinfo -sql "CREATE SPATIAL INDEX ON $i"  $i.shp; done

gdalbuildvrt

Create virtual raster from a folder containing Geotiff files

gdalbuildvrt file.vrt folder_name/*.tif

Create virtual raster from a folder containing PNG World files

gdalbuildvrt file.vrt folder_name/*.png

gdal2tiles

Create tiles to disk from GeoTiff file. Zoom level 6 to 18

gdal2tiles.py file.tif floder_name  -z 6-18 -r antialias

gdalwarp

PNG to GeoTiff and reprojection UTM 31N-ETRS89 to PseudoMercator (Google)

gdalwarp -s_srs EPSG:25831 -t_srs EPSG:3857 /home/geostart/file.png /home/geostart/file.tif

Convert a Virtual Raster (.vrt) file to another format

gdalwarp -of GTiff source.vrt output.tif

gdal_grid

Virtual file with ascii point data to GeoTiff

gdal_grid  -of GTiff -ot Float64 -l point_layer /home/geostart/file.vrt /home/geostart/file.tif

gdaldem

Create a hillshade from a dem Geotiff

gdaldem hillshade /home/geostart/filedem.tif   /home/geostart/filehillshade.tif

gdal_polygonize

convert tif raster to vector polygons Shapefile

gdal_polygonize.py -8 -nomask -b 1 input.tif  -f  "ESRI Shapefile" output.shp

convert tif raster to vector polygons MBTiles

gdal_polygonize.py -8 -nomask -b 1 input_4326.tif  -f  "MBTiles" output.mbtiles -lco NAME=nameoutput  -dsco WRITE_BOUNDS=YES  -dsco MAX_FEATURES=20000000  -dsco MAXZOOM=15

ogr2ogr

Convert and reproject Geopackge to MbTiles (vector-tiles) GDAL>= 2.4

ogr2ogr -f MVT output.mbtiles input.gpkg -s_srs EPSG:4326 -t_srs EPSG:3857 -dsco MAXZOOM=20 -dsco MINZOOM=12 -dsco FORMAT=MBTILES -dsco MAX_SIZE=1500000 -dsco NAME=output_name_dataset -dsco EXTENT=8192 -lco NAME=output_name_layer -lco MAXZOOM=20 -lco MINZOOM=12

Convert PostGIS to MbTiles (vector-tiles) GDAL>= 2.4

ogr2ogr -f MBTILES -dsco MINZOOM=7 -dsco MAXZOOM=22 /home/geostart/file.mbtiles "PG:host=127.0.0.1 user=postgres password=xxxxxx dbname=postgres_dbname sslmode=disable" public.viewxxx

Convert Shapefile to MbTiles (vector-tiles) GDAL>= 2.4

ogr2ogr -f MVT output.mbtiles input.shp -s_srs EPSG:25831 -t_srs EPSG:3857 -dsco MAXZOOM=20 -dsco MINZOOM=12 -dsco FORMAT=MBTILES -dsco MAX_SIZE=1500000 -dsco NAME=output_name_dataset -lco NAME=output_name_layer -lco MAXZOOM=20 -lco MINZOOM=12

Convert Shapefile to GeoPackege

ogr2ogr -f GPKG /home/geostart/file.gpkg /home/geostart/file.shp

Convert CSV with WKT geom field to GeoJSON

ogr2ogr -f "GeoJson" "file.geojson" "file.csv" -sql "SELECT *, CAST(fieldname as geometry) FROM file"

Shapefile to GeoJSON force geometry creation

ogr2ogr -f "GeoJson" "/home/geostart/file.geojson"  "/home/geostart/file.shp" -nlt POLYGON

Shapefile to PostGIS

ogr2ogr -overwrite -f "PostgreSQL" -nln public.tableName PG:"host=127.0.0.1 user=postgres password=xxxxxx dbname=postgres_dbname"
/home/geostart/file.shp -lco GEOMETRY_NAME=geom  -skipfailures

Shapefile to PostGIS promote Multipolygon

ogr2ogr -nlt PROMOTE_TO_MULTI  -overwrite -f "PostgreSQL" -nln public.table_name PG:"host=127.0.0.1 user=postgres password=xxxxxx dbname=postgres_dbname" /home/geostart/file.shp -lco GEOMETRY_NAME=geom -skipfailures

Postgis to PostGIS with SQL

ogr2ogr -overwrite -f "PostgreSQL"  --config PG_USE_COPY YES -nln table_name  -lco GEOMETRY_NAME=geom PG:"host=127.0.0.1 user=user_postgres password=XXXXXX dbname=output_database_name"  PG:"host=127.0.0.2 user=user_postgres password=XXXXXX dbname=input_database_name" -sql "SELECT * from table_name"

Oracle to PostGIS with reprojection

ogr2ogr -s_srs EPSG:25831 -t_srs EPSG:3857 -overwrite -f "PostgreSQL" -nln public.table_name PG:"host=127.0.0.1 user=postgres password=xxxxxx dbname=postgres_dbname" OCI:"oracle_user/oracle_pass@(DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 127.0.0.1)(PORT = 1521)))(CONNECT_DATA = (SID =SID_ORACLE_MACHINE)))" -sql "SELECT A.SHAPE SHAPE, B.FIELD1 FIELD2,DELEGACIO,FIELD7,FIELD4,FIELD3 FROM TABLE1.FIELD4 A, TABLE1.FIELD5 B WHERE A.FIELD3=B.F31_PC AND A.TIPO='U'" -skipfailures

Oracle to PostGIS using SQL sentence

ogr2ogr  -overwrite -f "PostgreSQL" -nln public.table_name PG:"host=127.0.0.1 user=postgres password=xxxxxx dbname=postgres_dbname" OCI:"oracle_user/oracle_pass@(DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 127.0.0.1)(PORT = 1521)))(CONNECT_DATA = (SID =SID_ORACLE_MACHINE)))" -sql "SELECT A.SHAPE SHAPE, B.FIELD1 FIELD2,DELEGACIO,FIELD7,FIELD4,FIELD3, C.FIELD8 FROM TABLE1.FIELD4 A, TABLE1.FIELD5 B, TABLE1.FIELD6 C WHERE A.FIELD3=B.F31_PC AND A.FIELD3 = C.F31_PC AND B.FIELD7=900" -skipfailures

Shapefile to Oracle with reprojection

ogr2ogr -s_srs EPSG:25831 -t_srs EPSG:25831 -f OCI OCI:"USER/PASSWORD@(DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 127.0.0.1)(PORT = 1521)))(CONNECT_DATA = (SID =SID_ORACLE_MACHINE)))" "/home/geostart/file.shp"

Oracle to GeoJSON

ogr2ogr  -append -f "GeoJSON" /home/geostart/file.geojson OCI:"USER/PASSWORD@(DESCRIPTION = (ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = 127.0.0.1)(PORT = 1521)))(CONNECT_DATA = (SID =SID_ORACLE_MACHINE))):PRG.PCIVIL_PAP" -skipfailures -mapFieldType All

Step 1: Convert XLSX to CVS

ogr2ogr -f CSV /home/geostart/file.csv /home/geostart/file.xlsx

Step 2: Join CSV and Shapefile to create a GeoPackage

ogr2ogr -f CSV /home/geostart/file.csv /home/geostart/file.xlsx
ogr2ogr -f GPKG -sql "select name_shapefile.*, joincsv.* from name_shapefile left join 'joincsv.csv'.joincsv on name_shapefile.fieldID = joincsv.fieldID" /home/geostart/file.gpkg /home/geostart/file.shp -skipFailures

Shapefile to Shapafile with filter value

ogr2ogr -s_srs EPSG:25831 -t_srs EPSG:4326 -overwrite output.shp input.shp -where "NameField = 400"

gdal_translate

MBTILES to GeoTiff

gdal_translate -oo ZOOM_LEVEL=14  /home/geostart/file.mbtiles  /home/geostart/file.tif

XYZ ASCII file to GeoTiff

gdal_translate -of GTiff   /home/geostart/file.xyz  /home/geostart/file.tif

TIFF to XYZ

gdal_translate  -s_srs EPSG:25831 -a_srs EPSG:3857 -outsize 25% 25% -a_nodata none -co COLUMN_SEPARATOR=; -co ADD_HEADER_LINE=YES -b 1 -of XYZ /home/geostart/file.tif /home/geostart/file_dem.xyz

GeoTiff to MBTILES

gdal_translate  /home/geostart/file.tif  /home/geostart/file.mbtiles    -co NAME=name_file -co QUALITY=75 -co ZOOM_LEVEL_STRATEGY=UPPER -co TILE_FORMAT=JPEG  -co WRITE_BOUNDS=YES -of MBTILES                             

gdaladdo -r average /home/geostart/file.mbtiles 2 4 8 16

Tif to Raster MBTiles :

gdal_translate  /home/geostart/file.tif  /home/geostart/file.mbtiles    -co NAME=name_file -co ZOOM_LEVEL_STRATEGY=UPPER -co TILE_FORMAT=PNG -co RESAMPLING=NEAREST  -co WRITE_BOUNDS=YES -of MBTILES                             

gdaladdo /home/geostart/file.mbtiles 2 4 8 16

MBTILES to MBTILES cropping by bounding box and zoom level

gdal_translate /home/geostart/file_in.mbtiles /home/geostart/file_out.mbtiles -co TILE_FORMAT=JPEG -co QUALITY=85 -of MBTILES -oo MINX=164729 -oo MINY=5167665 -oo MAXX=201866 -oo MAXY=5185641 -oo ZOOM_LEVEL=17 -co WRITE_BOUNDS=YES

gdaltransform

Vertical transformation orthometric to ellipsoidal XYZ Ascii file

gdaltransform -s_srs "+proj=longlat +datum=WGS84 +geoidgrids=/home/gdaldata/egm96_15.gtx +no_defs" -t_srs "+proj=longlat +datum=WGS84 +units=m +no_def" < /home/geostart/file.xyz > /home/geostart/file_elip91.xyz

Other resources

https://www.bostongis.com/?content_name=ogr_cheatsheet#41

https://gdal.org/tutorials/

https://geoserver.geo-solutions.it/educational/en/raster_data/processing.html

https://developers.planet.com/planetschool/getting-started-with-gdal/

https://github.com/dwtkns/gdal-cheat-sheet

https://github.com/USGS-Astrogeology/GDAL_scripts