This is a event driven meta data ingestion tool that I am building with Azure leveraging several of Azure PaaS services.
-
Updated
Dec 11, 2022 - JavaScript
This is a event driven meta data ingestion tool that I am building with Azure leveraging several of Azure PaaS services.
Content for What's new in Databricks talk
Notes about platforms such as Azure-Databricks, Apache Spark, Azure-DevOps etc.
Successfully established a machine learning model using PySpark which can accurately classify whether a bank customer will churn or not up to an accuracy of more than 86% on the test set.
Terraform template which shows how to connect E2E from Azure Databricks to an HDInsight HBase cluster
A summative coursework for CSC8101 Engineering for AI
Data Engineering Project - Python, PySpark & SQL - Azure Data Factory (ADF), DataBricks, Synapse Analytics, Azure Data Lake Storage (ADLS) Gen2, Power BI, Tableau and Looker Studio
Get up and running quickly with Spark Structured Streaming on Azure Databricks using Azure Event Hubs
Azure DevOps extension for interacting with Azure Databricks via REST API
Data Engineering Project using Tokyo Olympic Data
[👩🏫] In this repository I'll show you how to use Azure Databricks for development and training machine learning models, and build a MLOps pipeline to serving them with CI/CD process.
Tokyo-olympic-azure-data-engineering-end-to-end-project
Import data from a CSV into a Hive partitioned and non-partitioned table
A simple pipeline to transform data within Azure Data Factory using Azure Databricks. Although it is written in Scala the same can be replicated in Python.
Azure Databricks notebook sample to connect Blob Storage of Azure Log Analytics
Shows how to install auto-sklearn on an Azure Databricks cluster
Add a description, image, and links to the azure-databricks topic page so that developers can more easily learn about it.
To associate your repository with the azure-databricks topic, visit your repo's landing page and select "manage topics."