The Doctor Will See You Now - Machine Learning for Telehealth

Explore the development of a browser-based telehealth application that enables doctors to conduct virtual patient consultations during the pandemic. Discover how machine learning in the browser, powered by TensorFlow.js, was utilized to implement a virtual backgrounds feature for professional-looking video calls. Learn about the BodyPix segmentation model for identifying individuals in images and how to apply ML segmentation data to create virtual backgrounds using HTML Canvas compositing techniques in JavaScript. Witness a live demonstration of this feature in action with a sample video chat web application running on Twilio. Gain insights into the intersection of front-end development, machine learning, and telehealth from Mark Brouch, a Software Engineer at Doximity, who shares his expertise in pushing the boundaries of browser capabilities with emerging technologies.