Discord bans (then unbans) around 8400 accounts because of a CSAM neural hash collision
Summary
Discord’s safety systems allegedly misfired, banning around 8,400 accounts due to a CSAM detector collision involving square-grid images. Accounts were subsequently unbanned, but the incident highlights vulnerabilities in automated moderation, potential privacy and abuse risks, and the need for more robust safeguards and auditing of AI-driven enforcement.