Explore a 14-minute conference presentation from SIGIR 2024 that investigates the capabilities of Large Language Models (LLMs) in making utility judgments. Learn from researchers Hengran Zhang, Ruqing Zhang, Jiafeng Guo, Maarten de Rijke, Yixing Fan, and Xueqi Cheng as they present their findings on evaluating LLMs' ability to assess and determine the usefulness of information, a critical aspect in information retrieval and content evaluation systems.
Are Large Language Models Good at Utility Judgments? - Evaluation Study
Association for Computing Machinery (ACM) via YouTube
Overview
Syllabus
SIGIR 2024 W1.3 [fp] Are Large Language Models Good at Utility Judgments?
Taught by
Association for Computing Machinery (ACM)
Related Courses
-
Multi-granular Adversarial Attacks Against Black-box Neural Ranking Models - Lecture 1
-
Large Language Models with Semantic Search
-
Finetuning Large Language Models
-
Large Language Models Can Accurately Predict Searcher Preferences
-
Steering Large Language Models for Cross-lingual Information Retrieval - Multilingual Retrieval
-
H2O ai Large Language Models (LLMs) - Level 2
