OpenAI and Character.AI tighten safety after chatbot-linked suicides
OpenAI and Character.AI are tightening safeguards after increasing reports of adults and teens forming unhealthy attachments to chatbots. A series of suicides linked to users' emotional dependence on AI companions has prompted senators to propose regulation and AI companies to begin making changes. AI relationship bots have surged in popularity, especially among younger users seeking connection. But safety researchers have shown that AI companions can encourage self-harm and expose minors to adult content. OpenAI recently updated ChatGPT's default model to better recognize and support people in moments of distress. Character.AI announced that it will remove the ability for users under 18 to engage in open-ended chats on its platform. The company says the change will take effect no later than Nov 15.
OpenAI and Character.AI tighten safety after chatbot-linked suicides