Data Pipeline for CDC data from MySQL DB to Amazon OpenSearch Service through Amazon Kinesis using Amazon Data Migration Service(DMS).

Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS

Sample project that describes how you can handle schema within your Django application.

This python script generates a JSON file for the AWS DMS table mappings section

AWS DMS Serverless data pipeline from MySQL to S3

Data Pipeline for CDC data from MySQL DB to Amazon Kinesis Data Streams through Amazon Kinesis using Amazon DMS Serverless

This is an exporter for monitor status of AWS DMS replication tasks.

Automated script developed in Mage.ai to monitor and validate the status of AWS DMS CDC tasks, ensuring data integrity and synchronization. Sends notifications for any detected validation issues.

Contains a Python script designed to validate data replication tasks in AWS Database Migration Service (DMS). The script checks for potential issues such as missing or duplicate data in the tables being replicated.

This repo contains a python file while exports DMS statistics

Ingest CDC from MySQL in one VPC to Amazon Kinesis Data Streams in another VPC with AWS DMS.

The AWS DMS Task Restart and Status Checker is a Python script designed to restart various AWS Database Migration Service (DMS) tasks and check their status. This script leverages AWS SDK (Boto3) and Mage.ai for DMS task integration and management, ensuring efficient and reliable task handling.