Skip to content

geeup: Simple CLI for Earth Engine Uploads

Compare
Choose a tag to compare
@samapriya samapriya released this 23 May 04:05
· 67 commits to master since this release

This came from the simple need to handle batch uploads of both image assets to collections but also thanks to the new table feature the possibility of batch uploading shapefiles into a folder. Though a lot of these tools including batch image uploader is part of my other project geeadd which also includes additional features to add to the python CLI, this tool was designed to be minimal so as to allow the user to simply query their quota, upload images or tables and also to query ongoing tasks and delete assets. I am hoping this tool with a simple objective proves useful to a few users of Google Earth Engine.

This also needs earthengine cli to be installed and authenticated on your system and earthengine to be callable in your command line or terminal

To install geeup: Simple CLI for Earth Engine Uploads you can install using two methods

pip install geeup

or you can also try

git clone https://github.com/samapriya/geeup.git
cd geeup
python setup.py install

For linux use --user flag it there are issues

pip install geeup --user

geeup_054

Changelog

0.5.4

  • Major version improvements to performance and codebase
  • Added rename tool to allow file renaming to EE rules
  • Added natural sorting to sort filenames to be ingested
  • Added capability for image and table upload to check for both existing assets and assets in task queue before retrying
  • Added task check capability to avoid 3000 tasks in queue
  • Updated and optimized failure checks and logging
  • Added path and asset schema check for EE rulesets
  • Updated docs and readme

0.5.3

  • Major version removed selenium support as stable method
  • Overall improvements to performance and codebase
  • Updated docs and ReadMe

0.5.1

  • Now support both zipped shapefile as well as batch CSV upload
  • General Improvements

0.5.0

  • fixed typo in version check

v0.4.9

  • Improvements to redundancy in code
  • Improvements to version check for tool
  • General cleanup

v0.4.8

  • Fixed issue with epoch time conversion for 1970s and issue with second vs millisecond parsing

v0.4.7

  • Both table and image upload support using cookies and better error handling.
  • Improved zipshape tool to avoid error handling
  • Image upload to collection now support pyramiding policy
  • Cookie setup tool now auto enables long string for Linux

v0.4.6

  • Now pass cookies for authentication and image and table uploaders.
  • Added readme docs and feature to the tool
  • Minor improvements to the overall tool.

v0.4.5

  • Replaced firefox_options with options for selenium 3.14 and higher related to issue 24 for selsetup
  • updated earthengine-api requirement to 0.1.238
  • update tasks fetch from earthengine api

v0.4.4

  • Replaced firefox_options with options for selenium 3.14 and higher related to issue 24
  • Fixed issues with tarfile extraction for mac and linux.

v0.4.3

  • Updated quota tool to handle Google Cloud Projects in GEE

v0.4.2

  • Fixed issue with geckodriver path and better path parsing
  • Added CI check for geckodriver

v0.4.1

  • Fixed selenium parser issue Issue 19
  • Implemented Cloud API fix for table uploads
  • Improved Cloud API fix for Imagery upload with improved manifest handling
  • Improvement and code cleanup

v0.4.0

  • Updated earthengine API library requirements to 0.1.222
  • Added version check tool for auto version check with PyPI

v0.3.7

  • Revisions to account for changes to API and client library 0.1.215
  • Now checks vertex count for each shapefile and logs warning with those exceeding million vertices while zipping.
  • Uses table manifest to perform table uploads designed to be more robust.
  • Simpler recursive delete functionality.
  • Overall General improvements.

v0.3.5

  • Fixed downloader for pipwin for release >= 0.4.8
  • Improved overall package installation for windows

v0.3.4

  • Supports python3 only since v0.3.4
  • Added stackoverflow based auth fix for some users Issue 13 and Issue 16.
  • General improvements.

v0.3.3

  • Added fix for handling no data in manifests while uploading.

v0.3.2

  • Fixed issue with selsetup.

v0.3.1

  • Fixed issue with raw_input and input for selsetup.
  • Fixed selenium path for windows and other platforms.
  • General improvements to ReadMe

v0.3.0

  • Fixed issue 13 non relative import.
  • Fixed issues with package import.

v0.2.9

  • Fixed issues caused by --no-use_cloud_api in earthengine-api package