AI companion chatbots — including Character.AI, Replika, and built-in AI features in Snapchat ("My AI") and Meta platforms — allow users to converse with AI personas. They have no meaningful age verification and vary widely in content safeguards.
Cases have emerged of chatbots engaging children in romantic or sexual roleplay, providing self-harm methods to children who expressed suicidal thoughts, and encouraging unhealthy dependency on AI as a substitute for human connection. By mid-2026, US courts are handling multiple lawsuits linking Character.AI to teen suicides.
In Malaysia, MCMC issued AI User Guidelines in April 2026 advising parents to restrict children's unsupervised access to AI companions. The EU AI Act, in force from mid-2026, requires age-assurance mechanisms for AI systems interacting with minors. A worsening concern flagged by the IWF in 2026 is the use of AI image-generation tools — including AI chatbots such as xAI's Grok — to generate child sexual abuse material (CSAM) from ordinary photos; IWF analysts have identified AI CSAM being actively shared on chatbot services and used to simulate abuse scenarios. Child safety experts globally are united in calling for urgent, consistent enforcement.