Completed
start with expert coding, for benchmark
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
Ground Truth - The Uses and Abuses of Human Annotation in Text Analysis - Professor Kenneth Benoit
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 the curious notion of "ground truth"
- 3 the curious notion of ground truth
- 4 sources of ground truth
- 5 examples in text analysis
- 6 sometimes it's far from obvious
- 7 how do we validate latent positions?
- 8 a recoding experiment
- 9 intercoder agreement
- 10 misclassification
- 11 more recent investigations
- 12 text annotation using the crowd
- 13 example: labelling immigration sentences
- 14 example: economic and social policy
- 15 start with expert coding, for benchmark
- 16 deployment on Crowdflower
- 17 inter-coder agreement
- 18 comparing experts to crowd-coders
- 19 correlation of aggregate measures
- 20 experts were just a less variable crowd
- 21 example: immigration policy
- 22 test for immigration policy
- 23 quality control: very important
- 24 conclusions
