Skip to content

firewut/data-transform-pipelines-api

Repository files navigation

Build Status license

About

Data Transformation API.

Basic Pipeline of Transformation may look like:

  • Receive an Image
    • Resize Image to 500x500
    • Add Watermark to Image using URL or Base64 Image as a watermark
    • Grayscale Image
    • Notify any HTTP Service about result completion

API Documentation

API Documentation available after a startup under http://127.0.0.1:8000/api/v1/free/docs/

Requirements

Every Worker may have it's own requirements. Check setup.py for package requirements.

Execution

Using docker-compose: Starts Queue, Database, Workers and API Itself

docker-compose up

# curl -X GET http://127.0.0.1:8000/api/

or

pip install .

cd src 
./manage.py migrate
./manage.py collectstatic
./manage.py sync_processors

redis-server
celery -A core worker -l info --concurrency 8 --max-tasks-per-child 2

env DEBUG=True DJANGO_LOGS_DIR=/tmp/ ./manage.py runserver 8000

About

Data Transformation Pipelines API

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published