Alternative Smartphone Interactions Based on Sensor Data

Explore innovative approaches to smartphone and tablet interactions in this conference talk from JSConf EU 2014. Delve into the array of sensors available in modern mobile devices, including touch screens, GPS, cameras, proximity sensors, gyroscopes, compasses, microphones, accelerometers, and even humidity sensors. Discover how these sensors can be leveraged to enhance and expand upon traditional keyboard and swipe/pinch interaction paradigms. Examine conceptual and concrete examples of implementing new interaction types, including a demonstration of augmenting a real-life search engine for smartphone use. Learn how to access sensor data directly from JavaScript and gain insights into transforming raw data into structured input for web applications. Investigate the shift away from text-based input towards interaction methods better suited to the unique capabilities of mobile devices.