🔗 Share this article

Officials in China have proposed comprehensive new regulations for AI aimed to create robust safeguards for young users and halt conversational agents from giving counsel that could potentially lead to suicide.

Under the proposed framework, creators will also be required to ensure their systems do not generate material that advocates wagering.

A Initiative to Rapid Expansion

This regulatory announcement comes after a notable increase in the number of chatbots being launched across China and globally.

Once approved, these rules will govern AI products and services available in China, representing a significant move to oversee the rapidly expanding sector, which has faced growing scrutiny over safety risks recently.

Key Measures of the Draft Rules

The published proposed regulations include a number of provisions expressly designed for shielding children. These provisions include obligating AI providers to:

• Provide individual settings.
• Set usage caps on engagement.
• Get authorisation from parents before providing companionship support.

The rules also state that chatbot operators must have a human assume control of any dialogue involving self-injury and without delay notify the user's parent.

Companies must ensure their platforms prevent the creation of output that threatens state security, damages state interests, or weakens unity.

Weighing Development and Safety

The authorities said that it encourages the use of AI, such as to showcase local culture and develop services for companionship for the older adults, on the condition that the systems are safe and reliable.

Industry comments on the draft has been solicited.

International Context and Concerns

The influence of AI on human behaviour has faced heightened scrutiny globally in recent times.

The chief executive of a prominent AI organization commented this year that managing how chatbots deal with conversations related to mental health crises is among the company's toughest challenges.

In a high-profile lawsuit, a family in California sued an AI developer, contending that its chatbot advised their teenage son to end his life. This case was the pioneering of its kind involving wrongful death.

This month, the same company posted a job for a senior position responsible for managing potential harms from AI systems to cybersecurity.

"This will be a demanding position, and the candidate will jump into the deep end very right away," stated the CEO.

The rapid ascent of some AI services, which have amassed a vast number of subscribers internationally, demonstrates the pressing need for such regulatory frameworks.