Explore the potential of foundational models in robotics and their impact on human-computer interfaces in this lecture from the CS 601.471/671 NLP: Self-supervised Models class. Discover how large models can empower users with generative AI capabilities, removing the need for engineers in the loop. Examine ChatGPT's application in robotics, including autonomous flight experiments and design principles for effective usage. Learn about deployment strategies with user involvement, multi-modal properties, and community support through prompt libraries and simulators. Gain insights into mathematical definitions and system overviews as the lecture delves into the future of robotics and AI integration.
Foundational Models for Robotics: Removing the Engineer from the Loop
Center for Language & Speech Processing(CLSP), JHU via YouTube
Overview
Syllabus
Foundational Models for Robotics: Removing the Engineer from the Loop
Goal: use large models to empower any user with the capabilities of generative Al
What is the future of human-computer interfaces: Remove the engineer from the loop. Bring in the user.
ChatGPT for Robotics: Deployment example Autonomous flight experiments
Design principles for effective ChatGPT usage
Deployment with the user in the loop When a conversation is needed for complex tasks
Multi-modal emerging properties Hallucination over colors, shapes and geometry
Community support: prompt library and simulator
Mathematical definitions
System overview
Taught by
Center for Language & Speech Processing(CLSP), JHU
