OpenAI Offers Free CSAM Detection API and Strengthens ChatGPT Child-Safety Controls
Emerging Technology Risk · 2 sources · Updated 4h ago · First seen Nov 17, 2026

OpenAI introduced an image classifier designed to identify potential child sexual abuse material (CSAM), including AI-generated images, and is offering it free through an API to vetted organizations. Early internal testing reduced the number of images requiring human review by 48% while identifying roughly the same amount of abusive material as its existing system. The classifier supports rather than replaces human reviewers; partner evaluations used different measures, and the preliminary results do not establish industry-wide effectiveness.
OpenAI is also introducing stronger ChatGPT interventions for users seeking material that sexualizes children, including conversation removal, 24-hour suspensions, and referrals to specialist support. The broader initiative includes developer safety guidance and AI-powered tools for authorized child-safety investigators. Organizations considering the classifier should evaluate its performance against their own content and review workflows rather than assume the reported reduction in review volume will generalize to their environments.


