Two years after the death of thirteen-year-old Juliana Peralta, her parents are still searching for answers while raising a broader alarm about the dangers of artificial intelligence tools that operate without clear protections. Juliana died by suicide in her Colorado home, and investigators later found a chatbot app open on her phone. Her parents had never heard of it. They believed they had been attentive to every part of their daughter’s online and offline life, yet the app revealed a corner of the digital world they did not realize existed until it was too late.
For many years, organizations across the country have been fighting to make the digital age safer for children. This effort has recently yielded significant legislative victories on both the state and federal level. Laws have strengthened protections around social media, data collection, and online harassment, aiming to keep children from harm in a rapidly evolving digital world. But a new problem has emerged: AI chatbots, which in several horrifying cases have actively supported the suicide ideation of young Americans.
This past weekend, a segment on 60 Minutes highlighted one such case, where a “companion bot” on Character AI was told by a teen that she was suicidal 55 times. Despite the repeated pleas for help, her parents say the bot never provided resources or guidance. They believed she was simply texting with friends, unaware that she was spiraling into distress with an AI companion that she was also engaging with sexually. Experts now warn that the sexual grooming of children by AI companions is not a marginal issue but a growing and largely unregulated threat.
The dangers of unregulated AI are broad and complex. Systems designed to imitate human conversation and emotional understanding can create attachments in vulnerable users without ever possessing actual empathy. Teens may turn to these programs for guidance, comfort, or companionship, unaware that the interactions are programmed simulations, not a source of real support. These systems can also generate convincing but false information at scale, which can be used for scams, disinformation campaigns, or harassment. Many AI platforms collect sensitive personal data without clear disclosure, leaving users exposed to misuse or breaches. And because there are no consistent standards, safety measures vary widely from company to company, leaving parents and users to navigate the risks on their own.
“People deserve transparency when it comes to technology. Being transparent with customers and the public while also making sure that technology is secure are key components for AI and tech companies when it comes to being ethical and secure,” explains Iterate.ai co-founder Brian Sathianathan. “Technology moves faster than legislative regulations. Companies need to proactively set and follow standards and keep consumers informed of these standards.” His words underscore the importance of companies taking responsibility, rather than relying solely on lawmakers to catch up to fast-moving technology.
The consequences of unregulated AI extend beyond emotional and mental health risks. Automated systems are increasingly used in high-stakes areas such as hiring, lending, housing, and policing. When AI models are trained on biased data, they can reinforce systemic inequalities, producing unfair outcomes that are difficult to contest. Without proper oversight, these biases can go unexamined, amplifying discrimination.
Children and teens remain especially vulnerable because many AI tools are widely accessible and not designed with younger users in mind. Juliana’s parents say their hope in sharing her story is to encourage other families to ask difficult questions about the digital tools their children use, including apps and platforms that may not be widely known.
Their grief highlights the urgent need for stronger safety standards and oversight. AI is transforming communication, education, and daily life, and its potential benefits are real. But without clear rules around privacy, security, transparency, and age-appropriate design, these systems pose risks that are often invisible until tragedy strikes. The experience of the Peralta family, alongside national reporting, serves as a stark reminder that technology often moves faster than public awareness and regulation, and that meaningful protections for young users are more critical than ever.