Spatial Audio-Enhanced Multimodal Graph Rendering for Data Trend Learning on Touchscreens

Explore a 15-minute conference talk from CHI 2024: The ACM CHI Conference on Human Factors in Computing Systems that delves into the design of a multimodal feedback scheme with integrated spatial audio for nonvisual exploration of histograms and scatter plots on touchscreens. Learn about the hardware and algorithms used to control vibrations and sonification adjustments through pitch changes and directional stereo output. Discover the results of formative testing with blind or visually impaired participants, which suggest that spatial audio can enhance trend identification in data, albeit with potential effects on mental graph representation. Gain insights into the iterative, human-centered approach of rendering multimodal graphics on touchscreens and understand the contribution of this new scheme for efficiently capturing data trends in complex representations.