Pinterest built an AI-powered system to measure prevalence of policy-violating content by tracking what users actually see rather than relying solely on reports. The system uses ML-assisted sampling weighted by impressions and risk scores, then labels content at scale using multimodal LLMs validated against human reviewers.
Table of contents
Why Prevalence MattersWhat We MeasureMethods at a GlanceSystem OverviewImplementation NotesDashboard and AlertingImpactConstraints and Trade‑offsFuture FocusAcknowledgementsSort: