Skip to content

Roadmap

Maeda Tomoki edited this page Aug 20, 2021 · 24 revisions

cliboa roadmap

Description of each items

  • New Feature
    • Add PostgreRead and PostgreWrite
    • Add RedshiftDownload
      • Add RedshiftDownload step class by old architecture
    • Add lazy load for environment.py
      • Add functionalities, lazy loading to environment.py
  • Refactoring, Improvements
    • Refactor several util classes to adapter classes
      • Regactoring targets: csv.py,file.py,ftp_util.py,gcp.py,gpg.py,http.py,sftp.py,sqlite.py
    • Integrate ETL error handling
      • Currently ETL error handling is not integrated, so unify error handling.
    • Refactor layer structure
      • Current layer structure is client->core->scenario->adapter->util. Modified structure is interface->core->scenario->adapter->util
    • Separate ETL processes to another pypi package
      • Separate ETL processing like cliboa.SftpDownload or cliboa.BigQueryWrite. @see https://github.com/cliboa
      • Refactoring scenario layer is necessary.
  • CI/CD
    • Add black, isort check
Clone this wiki locally