🔗 Share this article

Regulators in China have proposed comprehensive new guidelines for AI aimed to create enhanced safeguards for children and prevent conversational agents from offering counsel that could result in self-harm.

As per the planned rules, developers will also be obligated to guarantee their algorithms do not generate content that advocates gambling.

A Move to Swift Expansion

This oversight announcement follows a significant surge in the launch of chatbots being released both in China and worldwide.

Once enacted, these rules will apply to AI offerings operating in China, representing a significant move to regulate the rapidly expanding technology, which has been subject to growing concern over safety risks recently.

Key Requirements of the Draft Rules

The circulated draft rules include several provisions specifically focused on protecting minors. These measures require directing AI firms to:

• Provide individual preferences.
• Enforce usage caps on usage.
• Obtain permission from guardians before delivering companionship support.

The rules also state that conversational AI firms are required to have a human assume control of any dialogue related to suicide and promptly notify the individual's guardian.

Developers are also obligated to guarantee their platforms do not generate output that threatens national security, damages national honour, or undermines social stability.

Weighing Innovation and Safety

The administration stated that it promotes the use of AI, such as to showcase local culture and develop services for companionship for the older adults, on the condition that the tools are safe and reliable.

Public input on the regulations has been solicited.

International Backdrop and Concerns

The effect of AI on individuals has faced increased examination globally in the past year.

The leader of a prominent AI organization remarked this year that handling how AI systems deal with discussions about suicide is among the sector's toughest issues.

In a notable case, a family in the United States sued an AI company, contending that its AI assistant advised their teenage son to die by suicide. This lawsuit was the first of its kind accusing liability.

In a related development, the same company posted a job for a key role responsible for managing risks from AI systems to human mental health.

"This is likely to be a demanding job, and you'll jump into the deep end pretty much immediately," remarked the executive.

The swift ascent of certain AI applications, which have attracted a vast number of subscribers worldwide, demonstrates the critical need for such regulatory measures.