Data Engineering examples covering Airflow and Mage for workflows; dbt for BigQuery, Redshift, ClickHouse; Spark and Kafka for Batch/Streaming Processing
kafka
spark
pyspark
kafka-streams
spark-sql
workflow-orchestration
ksqldb
dbt-bigquery
dbt-postgres
dbt-clickhouse
dbt-redshift
-
Updated
Sep 17, 2024 - Python