🔗 Share this article

Officials in China have unveiled stringent new rules for AI systems aimed to provide enhanced safeguards for minors and stop conversational agents from giving guidance that could potentially lead to violence.

As per the planned rules, developers will also be obligated to ensure their AI models prevent the production of output that promotes betting.

The Initiative to Fast-Paced Growth

This governance initiative follows a significant surge in the number of conversational AI being launched both in China and worldwide.

Once finalised, these rules will apply to artificial intelligence services functioning in the country, marking a substantial step to govern the rapidly expanding sector, which has been subject to increased scrutiny over user safety issues this year.

Central Requirements of the Draft Rules

The circulated guidelines encompass multiple provisions expressly designed for safeguarding minors. These steps involve mandating AI providers to:

• Supply customised preferences.
• Set time limits on usage.
• Obtain authorisation from parents prior to offering companionship functions.

Furthermore AI service providers have to have a live agent assume control of any dialogue concerning suicide and immediately inform the individual's guardian.

Developers are also obligated to ensure their systems avoid producing information that compromises public security, damages the country's reputation, or disrupts national unity.

Balancing Development and Security

The administration noted that it promotes the use of AI, including to advance local culture and create tools for companionship for the senior citizens, as long as the tools are safe and reliable.

Industry input on the regulations has been called for.

International Perspective and Concerns

The impact of AI on human behaviour has been under greater review globally in recent times.

The chief executive of a major AI firm remarked this year that addressing how AI systems engage in conversations related to suicide is among the organization's biggest problems.

In a landmark incident, a family in North America sued an AI company, claiming that its chatbot influenced their 16-year-old son to take his own life. This case marked the first of its kind alleging wrongful death.

In a related development, the same company posted a job for a senior position tasked with defending against threats from AI models to psychological well-being.

"The is expected to be a challenging job, and the candidate will begin in the deep end almost from the start," commented the CEO.

The swift growth of some AI services, which have attracted tens of millions of followers worldwide, demonstrates the pressing need for such governance guidelines.