Creating Cloud Native Agents and Extensions for Large Language Models

Explore the creation of cloud native agents and extensions for Large Language Models (LLMs) in this 36-minute conference talk by Xiaowei Hu from Second State. Discover how WebAssembly (Wasm) emerges as a lightweight, portable, and secure runtime for LLM plugins, addressing the limitations of current plugin infrastructures. Delve into the open source community's efforts in leveraging and building Wasm container infrastructure for LLM plugins. Examine major use cases and adoptions in R&D management, DevRel, marketing automation, and training/learning. Gain insights into the technology stack and Rust SDKs developed by the community to enable these LLM applications. Learn how these innovations enhance LLMs like ChatGPT by adding key functionalities such as memory, senses, and hands through APIs and plugins.