On Building General, Zero-Shot Robot Policies - EI Seminar

Explore the cutting-edge research on building general, zero-shot robot policies in this seminar presented by Mahi Shafiullah at MIT. Delve into the development of Robot Utility Models (RUMs), a framework designed to train and deploy robot policies capable of generalizing to new environments without finetuning. Learn about innovative tools for efficient data collection in mobile manipulation tasks, multi-modal imitation learning techniques, and on-device policy deployment using commodity robots. Discover how RUMs achieve a 90% success rate in novel environments and their ability to adapt to different robot and camera setups. Gain insights into the importance of training data, data scaling strategies, the need for diverse yet high-quality demonstrations, and methods for robot introspection and performance improvement. Access open-sourced code, data, and models through the robotutilitymodels.com website to further explore this groundbreaking research in robotics and artificial intelligence.