🔗 Share this article

The well-known AI conversation site Character.ai is implementing a significant restriction that will prevent teenagers from engaging in conversations with its artificial intelligence-driven companions.

This move is in response to intense criticism regarding the nature of conversations minors were having with the digital companions.

Legal Pressure

The platform, which started in 2021 and has numerous people, is dealing with multiple lawsuits in the US.

Families have initiated cases, among them related to the loss of a minor, with some describing the platform a "serious risk" to youth.

Changed Rules

Effective November 25th, users below eighteen will only be able to create material such as videos with their characters, instead of engaging in conversations as they presently are able to.

Internet security advocates have supported the change but stated that the feature was inappropriate to be accessible by minors in the beginning.

Platform Announcement

"This decision is a part of our general belief that we need to keep creating the most secure AI platform on the planet for leisure activities," commented Character.ai leader Karandeep Anand.

He mentioned that AI safety is "a evolving challenge" but something the company had taken an "forceful" approach to, with safety measures and preventive measures.

Specialist Views

Online safety organization Internet Matters approved the decision, but noted that safety measures ought to have been implemented from the beginning.

"Our research shows that children are confronted with risky information and put at risk when using AI, such as AI chatbots," the organization commented.

Past Issues

Character.ai has been questioned in the past for hosting potentially harmful or inappropriate chatbots that children could engage with.

Avatars mimicking UK youths were discovered on the platform before being removed.

Later, reporters found a chatbot inspired by convicted sex offender which had logged numerous conversations with users.

Sector Consequences

Social media expert Matt Navarra characterized the situation as a "wake-up call" for the AI industry, which is shifting "from permissionless innovation to reactive controls".

"If a service that develops a minor-friendly service subsequently makes changes, it's demonstrating that controlled interactions don't suffice when the system's emotional engagement is intense," he commented.

Coming Changes

Character.ai says its revised approach will be on providing "enhanced interactive features" and "narrative experiences" for teens.

Updated identity confirmation systems will also be implemented, and the company will support a new AI safety research lab.

Dr Nomisha Kurian, who has studied AI safety, commented it was "a reasonable decision" to control teenagers from interacting with chatbots.

"It helps to differentiate artistic expression from more personal, psychologically vulnerable conversations," she elaborated.

"This constitutes so important for teenage users who are learning to handle personal and online restrictions."

She continued that Character.ai's revised approaches might reflect a "growing period" in the AI industry, where youth protection is gradually being acknowledged as an "pressing matter" for responsible innovation.