10.02.2025
Building Data Pipelines with Apache Airflow
with
Shashank Kalanithi
Design, Build, and Optimize Scalable Cloud Data Pipelines with AWS, Azure, and GCP
2 hours of content
125 students
$99.00
Lifetime access
14-Day Money-Back Guarantee
What you get:
- 2 hours of content
- 20 Interactive exercises
- World-class instructor
- Closed captions
- Q&A support
- Future course updates
- Course exam
- Certificate of achievement
Building Data Pipelines with Apache Airflow
A course by
Shashank Kalanithi
$99.00
Lifetime access
14-Day Money-Back Guarantee
What you get:
- 2 hours of content
- 20 Interactive exercises
- World-class instructor
- Closed captions
- Q&A support
- Future course updates
- Course exam
- Certificate of achievement
$99.00
Lifetime access
$99.00
Lifetime access
14-Day Money-Back Guarantee
What you get:
- 2 hours of content
- 20 Interactive exercises
- World-class instructor
- Closed captions
- Q&A support
- Future course updates
- Course exam
- Certificate of achievement
What You Learn
- Design and implement scalable cloud-based data pipelines using tools like Apache Airflow, AWS Glue, Azure Data Factory, and Google Cloud Composer
- Master ETL/ELT processes and integrate data orchestration seamlessly across AWS, Azure, and GCP
- Optimize cloud resources and manage costs with advanced strategies for logging, auto-scaling, and reserved capacity
- Ensure data pipeline security with best practices like secrets management, role-based access controls, and data encryption
- Troubleshoot pipeline failures, manage outages, and build resilient systems with effective monitoring and logging tools
- Develop hands-on expertise in data storage and warehousing solutions, including AWS S3, Azure Blob Storage, and Google BigQuery
Top Choice of Leading Companies Worldwide
Industry leaders and professionals globally rely on this top-rated course to enhance their skills.
Course Description
Learn for Free
![Introduction to data pipelines](https://cf-images.eu-west-1.prod.boltdns.net/v1/jit/6258000438001/a3dd06f8-0eb8-42cf-988e-4e65bfa42749/main/1280x720/2m26s400ms/match/image.jpg)
1.1 Introduction to data pipelines
5 min
![Data pipeline architecture](https://cf-images.eu-west-1.prod.boltdns.net/v1/jit/6258000438001/00a6cb7c-fc9d-470c-b7d1-cc1fa15e0df2/main/1280x720/3m22s325ms/match/image.jpg)
1.2 Data pipeline architecture
7 min
![ETL vs. ELT](https://cf-images.eu-west-1.prod.boltdns.net/v1/jit/6258000438001/2724908d-2ac9-420b-abcb-31c89ec2c815/main/1280x720/1m23s232ms/match/image.jpg)
1.4 ETL vs. ELT
3 min
![Designing a data pipeline](https://cf-images.eu-west-1.prod.boltdns.net/v1/jit/6258000438001/90ba1615-586e-4bb6-9f9f-b31a72c36bf0/main/1280x720/1m20s618ms/match/image.jpg)
1.5 Designing a data pipeline
3 min
![Introduction to Apache Airflow](https://cf-images.eu-west-1.prod.boltdns.net/v1/jit/6258000438001/33531847-31ec-43e7-a001-0f2fdb8c9b11/main/1280x720/1m48s853ms/match/image.jpg)
2.1 Introduction to Apache Airflow
4 min
Interactive Exercises
Practice what you've learned with coding tasks, flashcards, fill in the blanks, multiple choice, and other fun exercises.
Practice what you've learned with coding tasks, flashcards, fill in the blanks, multiple choice, and other fun exercises.
![fill-blank-selection exercise](https://365datascience.com/resources/assets/images/fill-blank-selection.webp)
![order exercise](https://365datascience.com/resources/assets/images/order.webp)
![categorize exercise](https://365datascience.com/resources/assets/images/categorize.webp)
![true-false exercise](https://365datascience.com/resources/assets/images/true-false.webp)
![single-choice exercise](https://365datascience.com/resources/assets/images/single-choice.webp)
![multiple-choice exercise](https://365datascience.com/resources/assets/images/multiple-choice.webp)
![flashcards exercise](https://365datascience.com/resources/assets/images/flashcards.webp)
![fill-blank-typing exercise](https://365datascience.com/resources/assets/images/fill-blank-typing.webp)
Curriculum
- 2. Hands-on with Apache Airflow10 Lessons 44 MinIntroduction to Apache Airflow4 minInstallation of Apache Airflow4 minAirflow UI7 minDAGs and tasks5 minAirflow architecture5 minAirflow operators4 minAirflow hooks2 minIntroduction to the BashOperator7 minIntroduction to the PythonOperator3 minBuilding an end-to-end pipeline3 min
- 3. Advanced data pipeline concepts5 Lessons 34 MinAdvanced data pipeline concepts7 minPipeline failure4 minEnsuring data pipeline reliability11 minBackfilling pipelines7 minChange data capture5 min
- 4. Building pipelines in the cloud4 Lessons 26 MinBuilding pipelines in the cloud8 minSecurity in the cloud6 minCost management in the cloud8 minManaging outages in the cloud4 min
Topics
Data Engineering
Course Requirements
- Intro to Data Engineering
- Intro to Python
Who Should Take This Course?
Level of difficulty: Beginner
- Aspiring Data Engineers
- Current Data Engineers
- Data Analysts and Scientists
- Cloud Enthusiasts
- Tech-Savvy Business Professionals
- tudents and Graduates
Exams and Certification
A 365 Data Science Course Certificate is an excellent addition to your LinkedIn profile—demonstrating your expertise and willingness to go the extra mile to accomplish your goals.
![Exams and certification](https://365datascience.com/resources/assets/images/exams-and-certification-ds.webp)
Meet Your Instructor
![Shashank Kalanithi](https://365datascience.com/resources/team/hdbtjvalebl-isuwtiv8z6d-profile-photo.jpg)
Shashank Kalanithi is data engineer at Meta. His previous experience includes being a senior data analyst at the fashion retailer Nordstrom, where he worked on ML solutions to help augment the data team’s capabilities. He designed tools and dashboards that optimize the workflow and gather valuable data on the company’s numerous locations. Shashank also runs his own data analyst service where he helps companies organize, study, and extract insights to increase in-house efficiency and profitability. His YouTube channel, which he started in 2020, has accumulated over 149K subscribers.
What Our Learners Say
365 Data Science Is Featured at
Our top-rated courses are trusted by business worldwide.