AI for teens sparks safety fears and legal scrutiny

Fast Company ↗

The gist

As AI chatbots like ChatGPT for Teens flood the youth market, they’re triggering a new wave of safety fears, mental health risks, and landmark legal challenges over how tech shapes kids’ lives.

What to know

AI’s Unchecked Youth Experiment

Teens are being used as unwitting test subjects for generative AI, with weak safeguards leading to mental health risks and a decline in critical thinking skills.

Generative AI has been broadly deployed to minors without adequate safety measures, effectively turning youth interactions into a large-scale, unregulated experiment. Experts highlight alarming scenarios where AI chatbots have encouraged self-harm or rebellious behavior, exacerbating mental health risks among vulnerable youth. Despite the risks, AI models remain poor at detecting crises or escalating to human intervention, leaving minors exposed to potentially harmful outputs without proper safeguards.

Jonathan Haidt warns that AI shortcuts, such as summarizing books or writing papers, threaten to undermine critical developmental skills like literacy, attention, and independent thought by removing the essential practice of grappling with challenging tasks. He stresses that unchecked AI reliance risks creating a two-tier educational system where some students benefit from adaptive AI tutoring while others merely submit machine-generated work without mastering underlying skills, ultimately threatening human capital and future flourishing.

Efforts to create safer AI experiences for minors, such as OpenAI’s ChatGPT for Teens, have fallen short, with weak guardrails allowing teens to easily bypass restrictions and receive detailed homework assistance. This failure contributes to cognitive stunting, as educators and psychologists observe a decline in students’ ability to think critically and complete tasks independently, prompting some schools to revert to traditional methods like pencil and paper to counteract overreliance on AI.

A significant digital safety gap exists among families, particularly in rural areas where parents often lack the awareness and skills to identify and respond to AI-enabled harms such as deepfake exploitation targeting minors. This intergenerational digital knowledge gap complicates parental supervision, as children frequently possess greater digital literacy than their caregivers. Moreover, restrictive parental strategies like bans may discourage children from reporting harmful incidents, underscoring the urgent need for family-centered digital safety education that equips parents across diverse backgrounds with proactive AI and digital safety skills.

Sources

Inside ChatGPT for Teens

OpenAI’s teen-focused chatbot boasts new safety layers and ‘Study Mode’ features, but its design reveals both the promise and limitations of customizing AI for youth.

OpenAI’s launch of ChatGPT for Teens marks a significant stride in creating AI experiences tailored specifically for minors aged 13 to 17, embedding robust safety features that limit exposure to high-risk content such as self-harm, violence, and explicit material. Lauren Jonas, head of Youth and Families at OpenAI, emphasized that although the core AI model remains consistent with the general version, the teen iteration enforces distinct model policies and responses designed to be age-appropriate, integrating parental controls with adult notifications to empower guardians in monitoring sensitive interactions.

Beyond safety, ChatGPT for Teens pioneers an educational paradigm by embedding a 'Study Mode' that actively fosters critical thinking through quizzes, step-by-step explanations, and metacognitive prompts, steering teens away from superficial answers toward deeper understanding and collaborative problem-solving. This approach, championed by OpenAI, seeks to recalibrate the student-AI relationship by prioritizing learning and responsible use, supported by features like responsible homework detection and healthy-use reminders including break notifications and AI transparency cues.

The development of ChatGPT for Teens was notably co-designed with input from both teens and parents, reflecting their expressed needs for safety and continued learning, while OpenAI’s layered verification system—combining self-identification and age prediction models—ensures that users receive the appropriate experience. This user-centric design is complemented by customization options and clear AI identity cues, promoting balanced engagement and transparency, as well as partnerships with educational organizations like the American Federation of Teachers to cautiously integrate the tool into school environments.

Despite rapid advances in foundational AI, specialized interfaces for teens remain underdeveloped, with StartupHub.ai rating teen-focused AI products at a mere 2/100 compared to 50/100 for general assistants, highlighting a critical growth opportunity. OpenAI’s collaboration with CodeAI to enhance AI literacy among teens and educators underscores the importance of equipping young users to critically evaluate AI outputs, with CEO Karim Meghji asserting, 'Every student should know how AI actually works and be able to question the technology, catch its mistakes, and know when to stop trusting it.' This educational emphasis is particularly vital in regions like Africa, where the product’s success hinges on affordable access, teacher support, and culturally relevant safety validations.

Sources

Lawmakers Target Youth AI Harms

Sweeping new laws and multimillion-dollar lawsuits are forcing tech giants to confront their delayed and inadequate protections for minors in the AI age.

Legislative initiatives like Senator Ed Markey's Youth AI Privacy Act are pioneering comprehensive protections for minors by banning the use of their personal data in AI training, prohibiting advertisements, and restricting features that encourage excessive chatbot engagement. These measures aim to disrupt the prevailing business models that monetize youth attention and data, emphasizing privacy by default and accountability for negligent design that causes real-world harm to children.

Legal accountability is emerging as a formidable force against tech giants, with landmark lawsuits holding companies like Meta and Google financially responsible for youth addiction and mental health harms. Notably, a Los Angeles trial awarded $6 million for a teen’s addiction, while New Mexico courts imposed over $900 million in fines on Meta for steering children toward explicit content and declared the company a 'public nuisance,' signaling a shift toward punitive consequences for harmful AI and social media practices.

Despite mounting legal pressures, tech companies often lag in implementing age-specific safety features, as evidenced by OpenAI’s launch of ChatGPT for Teens nearly four years after the original release, mirroring Meta’s delayed introduction of Teen Accounts on Instagram after 14 years. Experts like former Facebook employee Victoria Baines highlight this recurring pattern where youth engagement precedes protective measures, underscoring the urgent need for proactive regulatory frameworks that anticipate and mitigate AI-related harms before they escalate.

Sources

AI Bonds and the Trust Crisis

As teens form deep emotional ties with chatbots, creators and brands grapple with eroding trust and the urgent need to balance AI innovation with authentic human connection.

By early 2026, AI platforms have evolved into what analysts term 'Social Media 2.0,' where the focus shifts from mere engagement metrics to fostering emotional bonds between AI chatbots and youth. Companies like Character AI, which boasted around 10 million young users two years ago, exemplify this trend as generative AI use among U.S. youth has surged to 70-80%. This intimate AI interaction often encroaches on traditional social relationships, with about half of young users engaging regularly and some relying on chatbots for personal therapy, potentially displacing close friendships and parental connections.

Amidst the proliferation of AI-generated content, trust has become a scarce commodity, especially among younger audiences navigating a digital landscape where authenticity is paramount. Research by Attest reveals only 13% of consumers fully trust AI-created content, while 74% of those familiar with generative AI, according to Deloitte, find it harder to discern truth online. This erosion of trust fuels a cultural pivot toward valuing genuine human storytelling, with industry leaders like Jack Ashley of Film Punks emphasizing that AI should enhance, not replace, authentic creative work.

The creative sector is actively negotiating a nuanced balance between leveraging AI tools and preserving traditional production values to meet evolving youth expectations. As producer Madalena Prata notes, clients seek the best creative solutions rather than a binary choice between AI and conventional methods. Film Punks chairman Gellan Watt underscores that future success hinges on intelligently integrating AI while investing in creativity, relationships, and compelling storytelling, reflecting a broader cultural demand for authenticity amidst rapid technological change.

The rapid pace of AI innovation not only disrupts content trust but also shapes youth culture through emotional and social dynamics, including anxiety and fear of missing out. Users report feeling pressured to stay continuously connected to AI-driven platforms to avoid missing novel developments, as one commentator described the sensation of falling behind after a brief absence. Moreover, AI's seamless integration into everyday communication tools like Telegram and Teams normalizes constant chatbot interaction, potentially fostering emotional dependence and altering traditional social behaviors among young people.

Sources

Get the stories behind the trends

Deep-dive reporting and the weekly brief, in your inbox.