Friday, 4 April 2025
27.2 C
Singapore
28.1 C
Thailand
20.3 C
Indonesia
26.9 C
Philippines

Character AI claims First Amendment protection in lawsuit over teen suicide

Character AI defends itself in a lawsuit claiming it contributed to a teenโ€™s suicide, arguing First Amendment protection for its AI-generated content.

Character AI, a platform enabling users to engage in roleplay with AI chatbots, is at the centre of a legal battle after being sued by the mother of a 14-year-old who tragically died by suicide. The company has filed a motion to dismiss, claiming the First Amendment shields its platform.

In October, Megan Garcia filed a lawsuit in the U.S. District Court for the Middle District of Florida, accusing Character AI of contributing to her son Sewell Setzer III’s death. Garcia alleges her son developed an emotional attachment to a chatbot named “Dany” on the platform, becoming increasingly isolated from the real world as he texted the chatbot obsessively.

Garcia demands stricter safety measures, arguing that the platform should impose changes limiting chatbots’ ability to generate personal stories and anecdotes. After Setzerโ€™s death, Character AI introduced several safety updates, including enhanced detection and intervention for content violating its service terms. However, Garcia insists these measures are insufficient.

First Amendment defence

In its motion to dismiss, Character AIโ€™s legal team argues that the First Amendment protects the platform, which safeguards expressive speech, including computer-generated content. The filing states, “The First Amendment prohibits tort liability against media and technology companies arising from allegedly harmful speech, including speech allegedly resulting in suicide.”

The motion further argues that restricting Character AI would violate the First Amendment rights of its users, not the company itself. According to the filing, this position equates chatbot-generated content to other forms of expressive media, such as video games.

Wider implications for AI platforms

The lawsuit has broader implications for AI companies, particularly regarding the legal status of AI-generated content under U.S. law. While Character AIโ€™s motion does not explicitly cite Section 230 of the Communications Decency Actโ€”a law protecting platforms from liability for third-party contentโ€”it highlights ongoing debates about whether Section 230 covers AI-generated speech.

The motion also suggests that the plaintiffs aim to prompt legislative action against technologies like Character AI, warning that this could stifle innovation in the generative AI industry. โ€œThese changes would radically restrict the ability of Character AIโ€™s millions of users to generate and participate in conversations with characters,โ€ the filing reads.

Character AI faces several other lawsuits regarding minorsโ€™ interactions with its content. In one case, a 9-year-old was reportedly exposed to โ€œhypersexualised content,โ€ while another lawsuit claims a chatbot promoted self-harm to a 17-year-old user.

Additionally, in December, Texas Attorney General Ken Paxton launched an investigation into Character AI and 14 other tech companies for alleged violations of childrenโ€™s online safety and privacy laws. Paxton described the investigation as critical in ensuring compliance with regulations protecting children from harm.

Character AI operates within the burgeoning field of AI companionship apps, which has raised concerns among mental health experts. Critics warn that such platforms could exacerbate loneliness and anxiety, especially for vulnerable users.

Founded in 2021 by Google AI researcher Noam Shazeer, Character AI has received significant backing, with Google reportedly investing US$2.7 billion in the company. Despite its legal challenges, the platform claims it continually improves safety features, including dedicated tools for teens and stricter content moderation.

The lawsuit raises complex questions about the balance between technological innovation and safeguarding users, particularly minors, from harm. As the case unfolds, its outcome could set significant precedents for regulating AI platforms.

Hot this week

NVIDIA Blackwell platform sets new performance benchmark in MLPerf Inference v5.0

NVIDIAโ€™s GB200 NVL72 sets a new benchmark in MLPerf Inference v5.0 with 30x token throughput, leading AI factory performance.

Android Auto beta now supports full-screen gaming

Android Autoโ€™s latest beta introduces full-screen gaming, allowing you to play Candy Crush Soda Saga and Angry Birds 2 while parked.

Google’s Gemini 2.5 Pro AI model is now available for all users

Google's Gemini 2.5 Pro AI model is now available for all users, offering advanced coding and reasoning abilities with a free trial for Gemini Advanced.

Qualcomm expands AI research with MovianAI acquisition

Qualcomm has acquired Vietnamese AI research firm MovianAI to boost its AI development in smartphones, PCs, and software-defined vehicles.

Spotify introduces AI-powered ads and programmatic ad buying

Spotify unveils AI-powered ads and the Spotify Ad Exchange, making it easier for advertisers to reach Gen Z listeners with real-time bidding.

Spotify introduces AI-powered ads and programmatic ad buying

Spotify unveils AI-powered ads and the Spotify Ad Exchange, making it easier for advertisers to reach Gen Z listeners with real-time bidding.

YouTube expands shopping affiliate programme in Singapore through Shopee partnership

YouTube teams up with Shopee to launch its Shopping affiliate programme in Singapore, giving creators new ways to monetise their content.

Misconceptions about STEM careers continue to deter young women in Singapore

New research shows stereotypes and lack of support are deterring young women from STEM careers, posing a risk to Singaporeโ€™s innovation goals.

Synagie and HKT launch ShopHK to help Hong Kong brands expand into Southeast Asia

Synagie and HKT launch ShopHK, helping Hong Kong SMEs tap into Southeast Asia's booming US$600 billion e-commerce market.

Related Articles