Smartphone-Based Handwritten Signature Verification Using Acoustic Signals

Explore an innovative approach to handwritten signature verification using acoustic signals in this 20-minute conference talk from the ACM Interactive Surfaces and Spaces Conference. Delve into SonarSign, a system that leverages inaudible acoustic signals and smartphones' built-in speakers and microphones to capture dynamic handwritten signature patterns for verification. Learn how the system utilizes channel impulse response (CIR) estimation and an attentional multi-modal Siamese network for end-to-end signature verification. Discover the system's performance in real-world scenarios, achieving an impressive 98.02% AUC and 5.79% EER for unseen users. Gain insights into this novel approach that eliminates the need for specialized devices like sensor-instrumented pens or tablets, potentially revolutionizing on-line automatic handwritten signature verification for enhanced property safety and secure information exchange.