🔗 Share this article

Regulators in China have proposed comprehensive planned rules for AI aimed to create strong safeguards for children and prevent AI assistants from providing counsel that could result in self-harm.

As per the planned regulations, developers will also be obligated to guarantee their systems do not generate content that encourages gambling.

A Response to Fast-Paced Expansion

This regulatory announcement arrives amidst a notable rise in the launch of conversational AI being released both in China and worldwide.

Once finalised, these regulations will cover AI products and services operating in the country, representing a major step to regulate the fast-growing technology, which has faced intense scrutiny over user safety risks in recent months.

Key Provisions of the Proposed Rules

The released draft rules contain several measures particularly aimed at safeguarding young users. These steps involve directing AI providers to:

• Supply individual preferences.
• Implement usage caps on usage.
• Obtain authorisation from legal custodians before offering emotional companionship services.

Additionally AI service providers are required to have a human assume control of any interaction concerning self-harm and immediately inform the individual's guardian.

Companies are also obligated to ensure their systems do not generate content that endangers state security, damages national honour, or weakens unity.

Weighing Innovation and Safety

The administration stated that it promotes the adoption of AI, such as to promote cultural heritage and develop solutions for support for the senior citizens, provided that the systems are secure and trustworthy.

Public feedback on the regulations has been called for.

Global Context and Concerns

The impact of AI on human behaviour has been under heightened review internationally in recent months.

The chief executive of a leading AI company commented this year that handling how chatbots deal with conversations involving suicide is among the company's biggest issues.

In a high-profile incident, a the parents in the United States sued an AI firm, claiming that its system encouraged their teenage son to die by suicide. This lawsuit marked the pioneering of its kind accusing wrongful death.

Recently, the same firm posted a job for a lead role focusing on mitigating risks from AI systems to psychological well-being.

"This is expected to be a challenging position, and you'll enter the complex challenges almost right away," remarked the leader.

The swift ascent of various AI services, which have attracted millions of users globally, highlights the critical need for such governance frameworks.