Completed
How individuals can contribute to AI benchmarking.
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Shaping AI Benchmarks and Open-Source Development - Percy Liang Interview
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 Discussion on benchmarking incentives with references to Kaggle.
- 3 Nuanced challenges of language model overfitting.
- 4 How to effectively choose AI models using leaderboards.
- 5 Advice on selecting models for company use.
- 6 Importance of having a robust model evaluation framework.
- 7 How individuals can contribute to AI benchmarking.
- 8 Discussion on specialized vs. generalized model performance.
- 9 Insights into the complexities of benchmarking AI agents.
- 10 Real-world applications and limitations of AI agents.
- 11 Percy reflects on his TED talk regarding open vs. closed source models.
- 12 Introduction to TogetherAI and its mission for open AI development.
- 13 Combining AI with music creation.
