All Courses
Pipelines, Airflow & dbtIntermediate → SeniorNEW
Data Engineering
Build production data pipelines end-to-end — ETL vs ELT, batch vs streaming, medallion architecture, Apache Airflow orchestration, pipeline design patterns, data contracts, and production monitoring.
4.9rating0 students4h 30m total4 lessons
What you'll learn
Understand ETL vs ELT and when to apply each pattern
Choose between batch, micro-batch, and streaming based on latency requirements
Design the medallion architecture — Bronze, Silver, Gold layers
Build and orchestrate DAGs in Apache Airflow with retries, sensors, and XComs
Apply ingestion strategies: full load, incremental, CDC, snapshots
Define data contracts between producer and consumer teams
Monitor pipelines with row count validation, freshness checks, and alerting
Final Project
Build a full Airflow DAG: ingest from API → validate → transform → load to Snowflake with alerting
Curriculum
4 lessons · 4h 30mCourse Info
Lessons4 lessons
Total time4h 30m
LevelIntermediate → Senior
Students0
Rating4.9 / 5.0