Explore a 14-minute conference presentation from SIGIR 2024 that investigates the capabilities of Large Language Models (LLMs) in making utility judgments. Learn from researchers Hengran Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Yixing Fan, and Xueqi Cheng as they present their findings on evaluating LLMs' ability to assess and determine the usefulness of information, a critical aspect in information retrieval and content evaluation systems.
Are Large Language Models Good at Utility Judgments? - Evaluation Study
Association for Computing Machinery (ACM) via YouTube
Overview
Syllabus
SIGIR 2024 W1.3 [fp] Are Large Language Models Good at Utility Judgments?
Taught by
Association for Computing Machinery (ACM)
Related Courses
-
Large Language Models with Semantic Search
-
Multi-granular Adversarial Attacks Against Black-box Neural Ranking Models - Lecture 1
-
Finetuning Large Language Models
-
Large Language Models Can Accurately Predict Searcher Preferences
-
Steering Large Language Models for Cross-lingual Information Retrieval - Multilingual Retrieval
-
Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs
