Building World Model Intelligence: The Crucial Role of Perception

Explore the critical role of multimodal sensing in developing comprehensive world models for AI in this conference talk by Jianfei Yang at #ICBS2024. Delve into the limitations of large language models in interacting with the physical world and understand how multimodal sensing serves as a crucial perception component. Examine the latest advancements in wireless multimodal sensing, focusing on the fusion of WiFi signals with other sensory inputs for enhanced perception capabilities. Learn about innovative techniques to augment standard WiFi infrastructures with versatile sensing functionalities. Discover strategies for improving the adaptability and generalization of AI perception models, as well as realizing efficient AI perception models. Gain insights into integrated sensing and communications, and understand how ubiquitous sensing contributes to building more powerful world models. Explore the potential applications of these technologies in smart environments, healthcare, and beyond in this hour-long presentation from BIMSA.