🔗 Share this article

Regulators in the country have proposed comprehensive planned regulations for AI crafted to create robust safeguards for young users and prevent AI assistants from providing guidance that could encourage violence.

According to the proposed framework, creators will furthermore be obligated to guarantee their systems prevent the production of content that promotes gambling.

A Response to Rapid Adoption

This governance announcement follows a sharp surge in the launch of conversational AI being released within China and around the world.

Once finalised, these rules will apply to AI products and services functioning in China, representing a significant step to govern the fast-growing sector, which has faced intense concern over user safety risks in recent months.

Core Provisions of the New Regulations

The published guidelines contain several provisions expressly focused on safeguarding children. These provisions involve directing AI companies to:

• Provide customised controls.
• Set time limits on usage.
• Get permission from parents before providing therapeutic support.

The rules also state that conversational AI firms have to have a human assume control of any interaction concerning self-harm and without delay alert the user's parent.

AI providers must guarantee their systems prevent the creation of information that compromises public security, undermines national honour, or disrupts unity.

Balancing Development and Security

The authorities said that it promotes the application of AI, including to promote local culture and develop tools for support for the senior citizens, as long as the systems are secure and trustworthy.

Stakeholder feedback on the draft has been requested.

International Backdrop and Scrutiny

The effect of AI on human behaviour has come under increased scrutiny around the world in recent months.

The head of a leading AI organization remarked this year that handling how chatbots engage in dialogues involving suicide is among the sector's toughest issues.

In a notable case, a family in North America filed a lawsuit an AI developer, alleging that its chatbot advised their teenage son to die by suicide. This lawsuit was the first of its kind alleging wrongful death.

This month, the same firm posted a job for a lead position responsible for managing risks from AI models to psychological well-being.

"This is likely to be a demanding job, and you'll jump into the deep end very right away," remarked the CEO.

The rapid growth of some AI applications, which have attracted tens of millions of subscribers globally, highlights the urgent need for such regulatory frameworks.