Class Central is learner-supported. When you buy through links on our site, we may earn an affiliate commission.

YouTube

Wasm as the Runtime for LLMs - Advantages and Applications

CNCF [Cloud Native Computing Foundation] via YouTube

Overview

Explore the emerging trend of WebAssembly (Wasm) as a runtime for Large Language Models (LLMs) in this 28-minute conference talk by Michael Yuan from Second State. Learn why Python-based LLM applications are facing challenges due to performance, size, and complexity issues, and discover how compiled languages like C, C++, and Rust are gaining traction in LLM frameworks. Understand the benefits of using Wasm for LLM applications, including improved efficiency, safety, and performance with a smaller footprint. Witness demonstrations of running Llama 2 models in Wasm and developing LLM agents in Rust for Wasm environments. Gain insights into real-world use cases, such as LLM-based code review and book-based learning assistants, complete with live demonstrations.

Syllabus

Wasm Is Becoming the Runtime for LLMs - Michael Yuan, Second State

Taught by

CNCF [Cloud Native Computing Foundation]

Reviews

Start your review of Wasm as the Runtime for LLMs - Advantages and Applications

Never Stop Learning.

Get personalized course recommendations, track subjects and courses with reminders, and more.

Someone learning on their laptop while sitting on the floor.