What Matters in a Measure? A Perspective from Large-Scale Search Evaluation

Explore a thought-provoking conference talk on evaluation metrics in large-scale search systems. Delve into the insights shared by Paul Thomas, Gabriella Kazai, Nick Craswell, and Seth Spielman as they discuss "What Matters in a Measure?" from the perspective of large-scale search evaluation. This 16-minute presentation, part of the SIGIR 2024 conference organized by the Association for Computing Machinery (ACM), offers valuable perspectives on the critical aspects of measurement in search engine evaluation. Gain a deeper understanding of the complexities involved in assessing search performance and the key factors that contribute to meaningful evaluation metrics in the field of information retrieval.