Daily Incremental load ETL pipeline for Ecommerce company using AWS Lambda and AWS EMR cluster, Deployed using Apache airflow in a docker container.
docker
dockerfile
aws
postgres
lambda
aws-lambda
docker-compose
docker-container
aws-s3
lambda-functions
postgresql
aws-emr
aws-ec2
redshift
oltp
aws-emr-clusters
aws-glue
redshift-aws
glue-jobs
lambda-trigger
-
Updated
Mar 17, 2023 - Python