Skip to content

Latest commit

 

History

History
10 lines (6 loc) · 926 Bytes

File metadata and controls

10 lines (6 loc) · 926 Bytes

Snowflake-Bigquery-Data-Migration

Automated Pipeline Deployment

Diagram

AIRFLOW DAG VIEW

Diagram

Leveraged GitHub Actions to automate the deployment of a GCP pipeline for Snowflake to BigQuery data migration. Utilized sensex-data-analysis as the data source and Snowflake storage integration feature to load data to GCS. Implemented workflow management and transformation using Composer (Airflow) and Dataflow