Fake Teens Tested Real Danger
Meta’s Project Cannes, as reported by WIRED, allegedly used hundreds of contractors managed through Covalen to pose as minors and test rival chatbots with high-risk prompts involving suicide, sex, eating disorders, drugs, and other sensitive subjects. Meta defended the work as routine safety testing, but the use of fake teen identities, rival platforms, crisis prompts, and large-scale response collection turns ordinary benchmarking into something more ethically charged. Chatbot safety is becoming adversarial: companies are probing competitors’ guardrails, collecting evidence, and mapping weaknesses in areas involving children and vulnerable users. The deeper problem is that emotionally persuasive chatbot products now require dark, legally sensitive, and ethically complicated safety testing, while the industry still lacks clear accountability for how such testing is approved, conducted, and used.