Completed
Open questions
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
The Abuse Uncertainty Principle, and Other Lessons Learned from Measuring Abuse on the Internet - David Freeman - USENIX Enigma Conference - 2020
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Sometimes I wish I worked on ad ranking...
- 3 Abusive content on Facebook
- 4 Measuring abuse is hard!
- 5 Measuring abuse: The Dark Ages
- 6 Measuring Abuse: The Renaissance
- 7 Benefits of Measurement (in addition to a quieter office)
- 8 How do we get there?
- 9 Count what you blocked These things have to be bad, right?
- 10 Have users do the labeling Crowdsource the work via reporting/appeals flows.
- 11 Human labeling Get experts to decide for you.
- 12 Deployment at Facebook Used for internal direction and/or external reporting of
- 13 Deployment at Facebook Used for internal direction on
- 14 Comparison of approaches
- 15 Example: Rate Limiting
- 16 "Proof" of Goodhart's Law
- 17 Corollary: "Abuse Uncertainty Principle"
- 18 Living with the Uncertainty Principle For spam detection at Facebook, we split signals into two classes
- 19 Other coping mechanisms
- 20 Challenge: Build an Abuse Adapter!
- 21 Open questions
- 22 Thank you!
