Explore the process of configuring Docker to run popular open-source Large Language Models (LLMs) in this 41-minute conference talk from DockerCon 2023. Learn how to integrate Weights & Biases (W&B) to generate useful charts and automate evaluations. Discover techniques for transitioning from a local development environment to GitHub actions triggered by W&B. Presented by Chris Van Pelt, Co-Founder of Weights & Biases, this talk provides insights into leveraging Docker and W&B for effective LLM evaluation and automation. Gain practical knowledge on containerization, machine learning workflows, and DevOps integration for AI/ML projects.
Evaluating LLMs with Weights & Biases and Docker Desktop
Overview
Syllabus
Evaluating LLMs with Weights & Biases and Docker Desktop (DockerCon 2023)
Taught by
Docker
Related Courses
-
Enterprises Using MLOps - The Changing LLM Landscape and MLOps Pipelines
-
Improving Accuracy of LLM Applications
-
LLM Engineering: Master AI & Large Language Models (LLMs)
-
Bring Your App into the AI-Age with Weaviate and Docker - DockerCon 2023
-
Supercharge Your Training With PyTorch Lightning and Weights & Biases
-
Aligning LLM Judges for Better Evaluations in RAG Pipelines
