Udemy - Streaming Data Pipeline from Confluent Kafka to AWS MYSQL DB

Level: All | Genre: eLearning | Language: English | Duration: 14 Lectures ( 1h 40m ) | Size: 814 MB
Hands on course to build Real Time Data Streaming Pipeline from Confluent Kafka to Lambda to AWS MySQL RDS from scratch
What you'll learn
Hands On course to learn to use Confluent Kafka & AWS Cloud Platforms
Learn basics of navigating & using AWS Cloud Platform services like Lambda, RDS-MYSQL, IAM, Cloudwatch, Secrets Manager & more
Learn basics of Confluent Platform and overview of services like: Topics, Connectors, API Keys, Clusters & more
Watch & Learn to build on your AWS + mConfluent Accounts- Real Time Data Streaming pipeline from Confluent to AWS RDS using Serverless Lambda Compute
Requirements
Be able to create AWS Cloud Platform Account (Free Tier)
Be able to create Confluent Kafka Platform Account
Basic understanding of Python
Description
In this hands-on course, participants will follow along step-by-step to build a real-time streaming data pipeline that sends data from Confluent Kafka to AWS Lambda and finally into an AWS RDS MySQL Database. This course is designed to provide practical, real-world skills by walking through each component of the architecture, ensuring that learners not only understand the concepts but also apply them directly in a cloud environment.On the AWS side, participants will gain experience working with several important services, including AWS IAM for securing resources, AWS Secrets Manager for managing sensitive credentials, and AWS CloudWatch for monitoring and logging the data pipeline in action. These services are essential for building secure, scalable, and reliable applications in the cloud.On the Confluent Kafka side, learners will set up a fully managed Kafka cluster, create topics for message streaming, and configure a fully managed Source Connector to simulate real-world data ingestion. This gives participants valuable exposure to enterprise-grade Kafka infrastructure without the overhead of managing the platform themselves.By the end of this course, participants will have built a working, scalable pipeline, gained insights into cloud-native architectures, and acquired hands-on experience that can be directly applied to real-world projects or professional roles.This course is suitable for budding Cloud Engineers, mid level Data Engineers, Product Owners, Product Mangers, Scrum Masters and Technology Leaders looking to get a hands-on experience of building a Real time Streaming Data Pipeline.
Who this course is for
Beginner Cloud Developers looking to build Real Time Data pipeline development skills and add a real life project to resume
MId Level to Sr. Cloud Developers to quickly gain understanding of building Real Time Streaming Data Pipelines using AWS + Confluent Platforms
Product Owners looking to build understanding of capabilities, risks & issues in building data pipeline using AWS + Confluent Kafka platform
Product Managers looking to build understanding of capabilities, risks & issues in building data pipeline using AWS + Confluent Kafka platform
Technology Leaders looking to deepen understanding of capabilities, efforts, risks & issues in building data pipeline using AWS + Confluent Kafka platform
Solution Architects looking for building hands-on Data Pipeline using AWS MySQL DB + Confluent Kafka Platforms
Homepage