Enhancing the Performance Testing Process for gRPC Model Inferencing at Scale
CNCF [Cloud Native Computing Foundation] via YouTube
Overview
Syllabus
Introduction
Model Deployment
Kubernetes
Complexities
Kserve
Scalability
Model Mesh
Model Mesh Features
Performance Testing Automation
Performance Testing Setup
Performance Testing Environment
QFlow Pipeline
K6 Load Tools
GRPC
Prometheus
Demo
Testing
Testing Log
Testing Results
Cashmiss Action
Should I use Model Mesh
Taught by
CNCF [Cloud Native Computing Foundation]