-
Notifications
You must be signed in to change notification settings - Fork 13
Roadmap
Maeda Tomoki edited this page Mar 18, 2022
·
24 revisions
- New Feature
- Add PostgreRead and PostgreWrite
- Add lazy load for environment.py
- Add functionalities, lazy loading to environment.py
- Refactoring, Improvements
- Refactor pipenv to poetry
- pipenv is slow to install, so replace pipenv to poetry. However, pipenv scripts are useful so use them continuously.
- Refactor several util classes to adapter classes
- Regactoring targets: csv.py,file.py,ftp_util.py,gcp.py,gpg.py,http.py,sftp.py,sqlite.py
- Integrate ETL error handling
- Currently ETL error handling is not integrated, so unify error handling.
- Refactor layer structure
- Current layer structure is client->core->scenario->adapter->util. Modified structure is interface->core->scenario->adapter->util
- Separate ETL processes to another pypi package
- Separate ETL processing like cliboa.SftpDownload or cliboa.BigQueryWrite. @see https://github.com/cliboa
- Refactoring scenario layer is necessary.
- Refactor pipenv to poetry
- CI/CD
- Add isort check
- Add isort -rc --check to CI
- Add layer dependency check
- Add import-linter to CI
- Add isort check
- Security
- Update pypi packages with vulnabilities checked by GitHub