Combating online child sexual exploitation & abuse

In keeping with our mission to develop safe and beneficial AGI, we are focused on preventing, detecting and disrupting any attempt to use our models to support child sexual exploitation and abuse. We incorporate protections both pre-deployment and in our production models and products, and are committed to partnering with others in government, industry, and experts to effectively prevent the creation and distribution of AI-generated child sexual abuse material (CSAM) and child sexual exploitation material (CSEM).

Users are explicitly prohibited from using any OpenAI service for illicit activity, including exploiting, endangering, or sexualizing anyone under 18 years old. We prohibit use of our services for:

• CSAM, whether or not any portion is AI generated; 

• grooming of minors; 

• exposing minors to age-inappropriate content, such as graphic self-harm, sexual, or violent content; 

• promoting unhealthy dieting or exercise behavior to minors; 

• shaming or otherwise stigmatizing the body type or appearance of minors; 

• dangerous challenges for minors; 

• underaged sexual or violent roleplay, and underaged access to age-restricted goods or activities.

These policies extend to developers who are building applications on top of our technology: if developers are building tools targeted at minors, those tools may not allow the creation of sexually explicit or suggestive content. We monitor our services for violations of these policies, and ban users and developers who are found to violate them.

We train our AI models responsibly

We’re committed to responsibly sourcing our training datasets to safeguard them from image-based sexual abuse. We detect and remove CSAM and CSEM from training data, and report any confirmed CSAM to the relevant authorities, including NCMEC. This initial step is designed to prevent the model from developing capabilities of producing CSAM or CSEM in the first instance.