Completed
Living with the Uncertainty Principle For spam detection at Facebook, we split signals into two classes
Class Central Classrooms beta
YouTube videos curated by Class Central.
Classroom Contents
The Abuse Uncertainty Principle, and Other Lessons Learned from Measuring Abuse on the Internet - David Freeman - USENIX Enigma Conference - 2020
Automatically move to the next video in the Classroom when playback concludes
- 1 Intro
- 2 Sometimes I wish I worked on ad ranking...
- 3 Abusive content on Facebook
- 4 Measuring abuse is hard!
- 5 Measuring abuse: The Dark Ages
- 6 Measuring Abuse: The Renaissance
- 7 Benefits of Measurement (in addition to a quieter office)
- 8 How do we get there?
- 9 Count what you blocked These things have to be bad, right?
- 10 Have users do the labeling Crowdsource the work via reporting/appeals flows.
- 11 Human labeling Get experts to decide for you.
- 12 Deployment at Facebook Used for internal direction and/or external reporting of
- 13 Deployment at Facebook Used for internal direction on
- 14 Comparison of approaches
- 15 Example: Rate Limiting
- 16 "Proof" of Goodhart's Law
- 17 Corollary: "Abuse Uncertainty Principle"
- 18 Living with the Uncertainty Principle For spam detection at Facebook, we split signals into two classes
- 19 Other coping mechanisms
- 20 Challenge: Build an Abuse Adapter!
- 21 Open questions
- 22 Thank you!
