Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Data Management - Full Stack Deep Learning - March 2019

The Full Stack via YouTube

Overview

Explore data management essentials for deep learning projects in this comprehensive lecture. Delve into data labeling, storage, versioning, and processing techniques. Learn about the data flywheel concept, annotator training, labor sources, and service comparisons. Discover database scalability, data lake organization, and versioning strategies. Examine task dependencies and workflow management tools like Luigi and Airflow. Gain practical insights for implementing efficient data pipelines in machine learning projects.

Syllabus

Introduction
Data Flywheel: an initial manually labeled dataset enables self- improvement with user data
Roadmap
Training the annotators is crucial
Sources of Labor
Service Companies
Software
Data Storage
Database scalable storage and retrieval of structured data
Data Lake
What goes where
Data Versioning
Level 2
Motivational Example We have to train a photo popularity predictor every night.
Task Dependencies
Makefile limitations
Luigi and Airflow

Taught by

The Full Stack

Reviews

Start your review of Data Management - Full Stack Deep Learning - March 2019

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.