Computational Semantics Evaluation - The Origins of Senseval and Evolution of SemEval

Explore the origins and evolution of computational semantics evaluation through this 56-minute lecture from the Alan Turing Institute. Delve into the history of Senseval and SemEval datasets, examining their impact on the field of computational linguistics. Discover how these evaluation exercises have shaped algorithms, data, and research communities. Investigate various semantic tasks, including word sense disambiguation, lexical substitution, and semantic textual similarity. Analyze the benefits and challenges of these evaluation methods, with a particular focus on semantic representation issues. Gain insights from Dr. Diana McCarthy, an experienced computational linguist, as she discusses the pros and cons of representation-independent tasks and their implications for interpreting results and designing future evaluations.