A.I. in the Multiverse - Measuring ROI When A/B Tests Are Not Possible

Explore the challenges of measuring AI's impact on business metrics when traditional A/B testing is not feasible in this 31-minute conference talk from the Toronto Machine Learning Series. Discover innovative approaches to assessing AI contributions to revenue in e-commerce settings, presented by Jacopo Tagliabue, Lead A.I. Scientist at Coveo. Learn how deep learning models can be utilized to evaluate the impact of search and recommendation APIs on digital shop revenues. Gain insights into generalizable methods for monitoring ML pipeline performance without relying on A/B testing, applicable across various business contexts.