Extending a High-performance Data Streaming System with WebAssembly

Explore the integration of WebAssembly (Wasm) into high-performance data streaming systems in this 27-minute conference talk by Tyler Rockwood from Redpanda. Discover how Wasm-powered functions built directly into streaming storage systems can solve 60-70% of use cases, eliminating data ping-pong and reducing system latency and resource requirements. Delve into the challenges faced when integrating a Wasm runtime into Redpanda, a distributed high-performance streaming storage engine built with the Seastar framework. Learn about the unique obstacles encountered in supporting arbitrary user functions within an execution environment that has strict bounds on memory consumption and latency. Gain insights into the developer experience that balances ease of use with performance optimization in this demanding environment.