Watch a 12-minute conference talk from the 37th Annual ACM Symposium on User Interface Software and Technology (UIST 2024) exploring how large language models can be leveraged to optimize mixed reality user interfaces through contextual awareness. Learn about SituationAdapt, an innovative approach that dynamically adjusts UI elements based on environmental factors and user situations in mixed reality environments. Discover how situation-aware reasoning using LLMs can enhance the user experience by automatically adapting interface components to match real-world contexts and user needs.
SituationAdapt - Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM Reasoning
Association for Computing Machinery (ACM) via YouTube
Overview
Syllabus
SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM Reasoni
Taught by
ACM SIGCHI
Related Courses
-
Desk2Desk: Optimization-based Mixed Reality Workspace Integration for Remote Side-by-side Collaboration
-
TouchInsight - Uncertainty-aware Rapid Touch and Text Input for Mixed Reality from Egocentric Vision
-
In-Situ Guidance for Interactive Tactic Training in Mixed Reality
-
Enhancing Physical Object Interaction in Virtual Reality via Interaction State-Aware
-
SonifyAR - Context-Aware Sound Generation in Augmented Reality
-
VisionTasker - Mobile Task Automation Using Vision-Based UI Understanding and LLM Task Planning
