Perspectives on Evaluating Diverse Open Web Search Applications with TIREx

Explore a comprehensive lecture on evaluating open web search applications through TIREx, delivered by PhD student Maik Fröbe from Friedrich-Schiller-University Jena at the University of Padua's Search Engines course. Dive into the OpenWebSearch.eu project's mission to foster a diverse search engine ecosystem in Europe, with particular focus on evaluation methodologies using TIRA/TIREx across more than 30 IR test collections. Learn through hands-on demonstrations of Docker, ir_datasets, PyTerrier, and TIRA, gaining practical knowledge for submitting solutions to LongEval 2024 via TIREx. Benefit from Fröbe's expertise as an active developer of TIRA/TIREx and his extensive experience organizing shared tasks including Touché and SCAI, while understanding how these tools contribute to improved reproducibility in research prototypes and the broader goals of the Open Search Foundation.