- Loads Brooklyndata olist dataset(https://app.mode.com/brooklyndata/tables) to Snowflake
- Creates data models using dbt
- Have a snowflake account setup
- Install Snowsql: https://docs.snowflake.com/en/user-guide/snowsql-install-config
- Follow steps to configure snowsql: https://docs.snowflake.com/en/user-guide/snowsql-config
- Have Python3 installed
- To create and load raw data to DB:
- replace(<ACCOUNT_NAME>, <LOGIN_NAME>) and run:
snowsql -a <ACCOUNT_NAME> -u <LOGIN_NAME> -f create_load_data.sql
- input password
- install dbt
python3 -m venv venv source venv/bin/activate pip install -r requirements.txt
- update dbt snowflake credentials in
profile_credentials
cd gold
source ../profile_credentials
dbt run
dbt test --store-failures
dbt docs generate
dbt docs serve