Embark on a comprehensive 10.5-hour video course covering the essentials of Data Engineering with Python and SQL for 2024. Explore the distinctions between Data Engineers and Data Scientists, delve into the Data Engineering Lifecycle, and gain hands-on experience with Python and SQL through practical tutorials. Discover Big Data technologies like Hadoop and Spark, and learn about cloud platforms including AWS, CloudFront, HoneyCode, and Amplify. Witness live demonstrations of AWS HoneyCode and Amplify, and understand Data Warehousing tools such as Amazon Redshift and Snowflake. Master key programming concepts including Python data structures, flow control, inheritance, NumPy, Pandas, and data visualization using Matplotlib and Seaborn. Apply your skills to a real-world IPL data project. Dive into SQL with a focus on HR Database Management Systems. Explore Big Data concepts, ETL processes, Hadoop architecture, and real-time analytics. Gain insights into cloud computing fundamentals, various cloud providers, and specific AWS services. By the end of this extensive tutorial, acquire a solid foundation in the critical skills required for a successful career in Data Engineering.
Data Engineering Roadmap and Full Course with Python and SQL for 2024
Overview
Syllabus
Introduction
Introduction to Data Engineering
Data Engineer vs Data Scientist
Important Skills for Data Engineering
Data Engineering Lifecycle
Data Structures in Python: Tuple, List, Dictionary & Set
Flow Control Statements
Inheritance in Python
Python Numpy
Python Pandas
Data Visualization with Python: Matplotlib
Data Visualization with Python: SeaBorn
Python Project on IPL Data
SQL - Introduction and Installation
Data Types in SQL
Hands-on based on HR Database Management System
Introduction to Big Data
ETL Extract-Transform-Load
Introduction to Hadoop
Distributed Computing
Hadoop Architecture
HDFS File Storage
Introduction to Oozie and HDFS Processing
Hadoop Clusters
Hadoop Ecosystem
Introduction to Spark
Introduction to Real-Time Analytics
Difference between Batch & Real-Time Systems
Input Output Connectors
Twitter Streaming in Real-Time - Demo
What is Data Warehouse for Data Engineer
Need of Data Warehouse
Top Data Warehouse Tools
What is Cloud Computing?
World before Cloud Computing
World before Cloud Computing
Need For Cloud Computing
Working of Cloud Computing
Cloud Providers
Basics of AWS
AWS CloudFront
Demo: AWS CloudFront
AWS HoneyCode
AWS Amplify
Demo: AWS Honeycode & AWS Amplify
Summary
Taught by
Great Learning
