Building a Research Platform with Armada on OpenStack and Kubernetes
OpenInfra Foundation via YouTube
Overview
Learn how to build a robust research platform combining OpenStack and Kubernetes in this 33-minute conference talk presented by Kevin Hannon at OpenInfra Foundation. Discover the architecture and implementation of Armada, an open-source project developed at G-Research that enables high-throughput job scheduling and efficient resource management for quantitative researchers. Explore how to leverage OpenStack for hardware provisioning while utilizing Kubernetes to support diverse workflows ranging from analytics to machine learning. Master the techniques for managing thousands of prioritized jobs across multiple Kubernetes clusters, addressing the challenges of hardware utilization and queue management when job demands exceed capacity. Gain practical insights into creating an open-source research infrastructure that meets the substantial hardware requirements of modern quantitative research operations.
Syllabus
Armada Building a research platform on top of Openstack and Kubernetes
Taught by
OpenInfra Foundation