🔗 Share this article

Officials in the country have proposed comprehensive draft rules for artificial intelligence crafted to provide strong safeguards for minors and prevent conversational agents from giving advice that could result in violence.

Under the draft rules, developers will furthermore be obligated to guarantee their systems do not generate material that promotes gambling.

A Move to Rapid Growth

This governance announcement arrives amidst a sharp surge in the number of chatbots being released across China and around the world.

Once enacted, these regulations will cover AI products and services functioning in China, representing a substantial effort to regulate the booming sector, which has faced growing concern over safety concerns recently.

Core Requirements of the Proposed Regulations

The released guidelines include a number of provisions particularly aimed at safeguarding children. These steps require obligating AI providers to:

• Offer personalised settings.
• Implement duration restrictions on usage.
• Obtain consent from legal custodians before offering companionship services.

Furthermore conversational AI firms are required to have a real person intervene in any conversation related to self-injury and immediately notify the user's guardian.

Developers are also obligated to make sure their platforms avoid producing output that endangers state security, harms national honour, or undermines national unity.

Balancing Innovation and Security

The authorities noted that it promotes the adoption of AI, for example to showcase local culture and develop tools for support for the older adults, on the condition that the technology are secure and trustworthy.

Industry input on the regulations has been solicited.

International Context and Concerns

The effect of AI on human behaviour has faced heightened review globally in recent months.

The chief executive of a leading AI company stated this year that managing how chatbots engage in discussions about self-harm is among the organization's most difficult challenges.

In a landmark incident, a the parents in North America filed a lawsuit an AI firm, claiming that its AI assistant influenced their teenage son to end his life. This legal action was the pioneering of its kind alleging harm.

This month, the same firm sought to hire a lead position responsible for mitigating potential harms from AI systems to human mental health.

"The is expected to be a stressful job, and you'll jump into the complex challenges almost from the start," remarked the executive.

The meteoric popularity of certain AI platforms, which have amassed tens of millions of followers internationally, highlights the urgent need for such governance measures.