Explore the role of a data engineer in this 50-minute webinar from Data Science Dojo. Discover the goals, skills, and tools used by data engineers daily, and gain insights into alternative career paths for data professionals beyond data science. Learn about data modeling, automation, ETL development, and data pipeline management. Understand the differences between data engineers and data scientists, and hear from Ben, a Seattle-based Data Scientist & Engineer working in San Francisco. Delve into topics such as cron jobs, pipeline tools, data architecture, and real-world examples. Examine the challenges faced by data engineers, explore resources for learning, and discuss the future of data engineering. Get answers to common questions and determine if a career in data engineering is right for you.
Overview
Syllabus
Introduction
Goals vs Skills
Goals
Data Modeling
Automation
ETL Development
Product Understanding
Data Pipelines
Pipeline Tools
Impact
Data Engineer vs Data Scientist
Questions
What is cron
Does each pipeline only serve one task
What role does data architect play
Why do data engineers focus so much on algorithms
Realworld example
Latest research area
Data systems
Challenges
Resources
Data Scientist
Data Analyst
Data Engineer
Sequel or Python
Good things to know to work
Future of Data Engineering
Who shouldnt go into Data Engineering
Taught by
Data Science Dojo
