Data engineers are facing a wide variety of problems every day. Learn best practices on how to approach the typical challenges.
Overview
Syllabus
Introduction
- Introduction
- What you should know
- The data engineer
- All important data engineering project phases
- General challenges faced
- Understanding the status quo
- Collecting the right requirements
- Defining good KPIs
- Keeping implementation efforts in mind
- Choosing the right architecture and framework
- Predicting costs and scaling better
- The right benchmarking of existing tools
- Definition of work packages and responsibilities
- Risk assessment
- Testing the right parts
- Having a good documentation
- Approaches to monitoring
- Approaches to bug fixing
- Awesome training of staff, current and new
- How to improve processes
- Conclusion and outlook
Taught by
Andreas Kretz
