Intro to Data Engineering

Name: Intro to Data Engineering
Price: 36 USD

with Shashank Kalanithi

4.8/5

(63)

Get an Introduction to the Data Engineering and the Career Opportunities It Offers

4 hours 46 lessons

Start course

46 High Quality Lessons

0 Practical Tasks

4 Hours of Content

Certificate of Achievement

Course Overview

Do you want to find out if Data Engineering is the right career path for you? Are you interested in exploring one of the hottest tech professions? If that’s the case, then our Intro to Data Engineering course is the perfect fit for you. Learn data engineering from course instructor Shashank Kalanithi, who has rich experience in the data and tech field. He has held roles as a data analyst, data scientist, data engineer, and currently works as a software engineer at Meta. Shashank is passionate about teaching and is eager to pass on his experience to you. His engaging teaching style combined with his notable professional experience make him the perfect tutor for you. But what does a data engineer do? A data engineer designs, builds, and maintains systems for collecting, storing, and analyzing data. Our data engineering course is perfect for people who are looking into a career in data engineering, as well as for those who have already landed a data engineering job but are still in the early days of their journey. Why is this the perfect course for data newcomers? You will: - Be able to determine if data engineering is a career path that interests you - Understand the difference between common roles: data analyst vs data scientist vs data engineer vs software engineer (note: data engineering skills allow you to transition to any of the other roles as you advance in your career) - Learn fundamental data engineering concepts, how to become a data engineer, and how to land your first job Why is this the perfect course for entry level data engineers? Because in this training, you will: - Gain a big picture understanding of the data engineering field and its requirements - Benefit from Shashank's years of experience and gain valuable insights to excel in your job - Understand the different paths you can take in your career progression - Discover methods to enhance data engineering processes within your company What’s included in our data engineer training? Intro to Data Engineering begins with an overview of the data engineering career path. You will learn about the data engineering role, the technical skills needed on the job, and the different potential paths for career development. Then, you will learn about data architecture—a critical topic in data engineering. This field involves creating a structured framework for managing data. You'll also explore data orchestration, which is the automation of the flow and processing of data across different systems. Our data engineering course also covers relational databases, non-relational databases, and the software engineering skills required for data engineering. You will learn about crucial data engineering tools and frameworks like SQL, NoSQL, Python, APIs, Version Control, Docker and Containerization, Hadoop, Spark, Kafka, and more. Finally, Shashank will wrap up the Intro to Data Engineering course with insights on important aspects like data security and privacy. We hope you are very excited about this course! Start your data engineering journey today!

Topics covered

Data Engineering

What You'll Learn

The perfect course if you want to become a data engineer. Get a proper introduction to the field from a world-class expert.

Determine if data engineering is the right career choice for you

Discover potential career paths within data engineering

Learn data engineering fundamentals

Benefit from the knowledge of an experienced data engineer

Acquire key technical data engineering skills

Learn strategies to enhance data processes at your company

Curriculum

Introduction Free

1 Lesson 3 Min

Get an introduction to the course author and learn how the "Intro to Data Engineering" course will boost your career.

What will this course teach you Free
Data Engineering Career

6 Lessons 46 Min

In this section of the course, you will learn what a data engineer is, the different data engineering lifecycles, and the career paths related to data engineering. Shashank Kalanithi offers a comprehensive comparison to other data science and software engineering professions, allowing you to understand how data engineers contribute to an engineering team and what precisely their role is.

What is a Data Engineer? Free

Data Engineering lifecycle Free

Similar careers to Data Engineering

Data Engineering service models

Data Engineer leveling guide

Technical skills of a Data Engineer
Data Architecture

6 Lessons 55 Min

This part of the course introduces the concept of data architecture, its uses, and its implementation as a data engineer. Data architecture is the overarching structure and design principles guiding the collection, storage, management, and use of data within an organization.

What is Data Architecture

A sample Data Architecture

Data lakes, Swamps, Warehouses, and Marts

Modern data stack

Connecting to data

Good Data Architecture
Data Orchestration

2 Lessons 14 Min

Data orchestration helps us coordinate, schedule, and run data workflows. Get an introduction to how companies use tools like Apache Airflow for their data orchestration needs.

Data Pipelines and Data Orchestration

Apache Airflow
Relational Databases

4 Lessons 19 Min

Relational databases are the core aspect around which most data engineering work revolves. Every data engineering job will have you interacting with relational databases.

Relational Database Overview

Organizing Relational Databases

Relational Database Types

Interacting with Relational Databases SQL
Non-relational Databases

7 Lessons 20 Min

NoSQL databases are designed to handle large volumes of structured, semi-structured, and unstructured data, providing flexible schemas and scalability that traditional relational databases lack. Learning about NoSQL is essential because it equips you with the skills to manage and analyze diverse data types efficiently in modern big data environments.

ACID Properties

Document Databases

Key-Value Database

Object Storage

Columnar Database

Graph Database

No-SQL Database Questions
Software Engineering

9 Lessons 34 Min

This section of the course covers crucial software engineering aspects necessary for effective data engineering. You'll learn about scaling techniques (horizontal vs. vertical), use Python for scripting and automation, interface with APIs, manage tasks using shell scripting and cron, maintain versions with tools like Git and Mercurial, ensure code quality through testing, deploy applications using Docker, and manage infrastructure efficiently. These skills are foundational for building and maintaining scalable and robust data processing systems.

Horizontal Scaling vs Vertical Scaling

Python

APIs

Shell Scripting

Cron

Version Control - Git - Mercurial

Testing

Docker and Containerization

Infrastructure Management
Big Data Engineering

4 Lessons 11 Min

In this part of the course, we will go over some of the larger concepts you have heard of and will provide a foundational understanding of what big data is. However, we will not go into too much detail because very few companies need to use these technologies at the scale required by Big Tech companies.

What is Big Data?

Hadoop

Spark

Kafka
Data Modeling

4 Lessons 15 Min

This section delves into Data Modeling, a cornerstone of data engineering that ensures structured and efficient data storage and retrieval. You'll explore the transformation from logical to physical data models, entity-relationship diagrams, normalization principles for database optimization, and the Kimball and Inmon approaches to data warehousing.

Logical Physical Data Model

Entity Relationship Diagrams

Normalization

Kimball and Inmon Data Warehousing
Security and Privacy

3 Lessons 8 Min

The concluding lessons of the Intro to Data Engineering course underscore the critical importance of security and privacy in data engineering. You will learn core principles related to how to minimize access rights for users, accounts, and computing processes to only those resources absolutely necessary for their functions, in an effort to enhance overall system security.

The Non-optionality of Security and Privacy

PII

Principle of Least Privilege

Student feedback

4.8/5

63 ratings

5 stars

56 (89%)

4 stars

4 (6%)

3 stars

3 (5%)

2 stars

0 (0%)

1 star

0 (0%)

Eugene A. Gakpo

25.05.2024

very informative, addressing if not all components. I score this 4 stars as would like to see more practical exercises. Especially extracting data architecture and data orchestration.

kasirye Moses

22.07.2024

it is great. The key concepts are broken down very well and many practical examples are given along the way.

KRIPA SHANKAR

27.05.2024

This course is not as attractive as others because course content and instructor voice is not quite clear.

Basilio Cubadjomia

16.06.2024

Awesome course, I really appreciate the way you explained it, it was awesome and well explained.

Ankush Bawa

27.06.2024

Very good course in explaining and highlighting the concepts related to Data engineering.

“You can take advantage of my years of experience, which I have condensed into this 3-hour course, to determine if Data Engineering is the right career path for you and how you can progress in your career as a data engineer.”

Shashank Kalanithi

Data Engineer at Meta