Sentinel 2 Data Fetcher

This Python library simplifies the download of satellite images from the Copernicus Sentinel-2 satellite. The data are fetched from the Google cloud storage Sentinel-2 data. Please feel free to contact us if you find issues or have any suggestions for improvements. See for an example tests/main.py.

Prevered OS: Use Linux (We testet the data fetcher on Ubuntu 20)

Google tool requirement: Install gsutil (https://cloud.google.com/storage/docs/gsutil_install)

Google gsutil authentication (You need a google account): Create a .boto file in your home director by calling gsutil config in a teminal window. Please flow instruction after prompt how to set authetication by creating a .boto file.

Installation

• Create a Virtual Environment and activate it.

  python3 -m venv venv
  . venv/bin/activate

• Install the Package via pip.

  pip install sat-mapping-cyborg-ai

Usage

• Import the Library

  from sat_mapping import FolderData, folders_time_frame, Paths, download

• Set the Path to where you want to store the Satellite Data.

  paths = Paths("<ANY/VALID/PATH>")

• Start the Download. (Note: One year needs around 110 GB Disk Space.)

  • The download uses Google gsutil if there is no gsutil configuration (.boto) in your home directory, gsutil config will be called to generate one.

  • Gsutil config asks the user for a token and a Google project id.

  • For tiles see Sentinel-2 data.

    download(paths, years=[2019], tiles=["32TMT"], months=[7, 11])

• Load a folder.

  folder_name = paths.folders[0]
  upper_left = (100000.0, 0.0)       # Postion on tile in [m]
  lower_right = (109800.0, 10000.0)  # Postion on tile in [m]
  data = FolderData(join(paths.data_path, folder_name), upper_left, lower_right)

• Display the image. (if matplotlib is not installed use pip install matplotlib)

  import matplotlib.pyplot as plt
  
  picture = data.data[:, :, [3, 1, 2]]  # NIR, GREEN, BLUE
  fig: plt.Figure = plt.figure()
  plt.imshow(picture)
  plt.show()

• Quirkes

Google authetication over .boto file
After authentication (Url call & key confirme) you must see a token in the .boto file like below. gs_oauth2_refresh_token = 1//09Kxxxxxxxx

Error: ModuleNotFoundError: No module named 'tkinter'
Means: The tkinter python packege is not installed
Test if installed: python3 -m tkinter
Install: sudo apt install python3-tk -y
Test if installed: python3 -m tkinter
Install lib: pipe tk

Mac OS multiprocessing error:
If you experience problems with multiprocessing on MacOS, they might be related to https://bugs.python.org/issue33725. You can disable multiprocessing by editing your .boto config or by adding the following flag to your command: -o "GSUtil:parallel_process_count=1". Note that multithreading is still available even if you disable multiprocessing.

Mac OS OpenJPEG/glymur: RuntimeError: You must have a version of OpenJPEG at least as high as 2.3.0 before you can read JPEG2000 images with glymur. Your version is 0.0.0
See: https://glymur.readthedocs.io/en/latest/detailed_installation.html