OpenAI launches free CSAM classifier, ChatGPT warnings

8 sources
  • OpenAI on Monday released a free image classifier, trained with NCMEC, that it calls the first broadly available CSAM tool flagging AI-generated material.
  • ChatGPT will warn users seeking abusive content, delete the chat and pause access for 24 hours; repeat offenders risk bans or police reports.
  • The launch comes as OpenAI faces lawsuits alleging its technology harmed users, especially children, while rival chatbots like Grok produced sexualized imagery, TechCrunch reported.
Sources (8)
  1. 1 Strengthening the fight against online child sexual abuse with new tools and support openai.com
  2. 2 OpenAI releases a new image classifier and ChatGPT warnings to combat CSAM | TechCrunch techcrunch.com
  3. 3 Combating online child sexual exploitation & abuse openai.com
  4. 4 OpenAI Report on Child Safety Reporting cdn.openai.com
  5. 5 CSAM guidance | OpenAI API developers.openai.com
  6. 6 OpenAI Launches New CSAM Detection and ChatGPT Warnings sqmagazine.co.uk
  7. 7 OpenAI rolls out image classifier and ChatGPT warnings to fight CSAM cryptobriefing.com
  8. 8 OpenAI Adds ChatGPT Warnings for Requests Seeking Child Sexual Abuse Material www.tokenpost.com