Completed
Standard Inference Protocol
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Serving Machine Learning Models at Scale Using KServe
Automatically move to the next video in the Classroom when playback concludes
- 1 Introduction
- 2 Background about KServe
- 3 Milestones
- 4 Model Development
- 5 Challenges
- 6 KServe
- 7 KServe Components
- 8 Standard Inference Protocol
- 9 HTTP Protocol
- 10 GRPC Protocol
- 11 New Scalability Problem
- 12 Current Approach
- 13 Problem
- 14 Compute resource limitations
- 15 Maximum pod limitations
- 16 Maximum IP address limitations
- 17 Model Mesh Solution
- 18 Performance Test
- 19 Latency Test
- 20 Model Mesh
- 21 Roadmap
- 22 Questions
- 23 Original Design
