🔗 Share this article

Authorities in China have unveiled strict draft guidelines for AI crafted to establish strong measures for children and prevent AI assistants from giving advice that could encourage self-harm.

According to the proposed rules, creators will additionally be mandated to ensure their systems do not generate output that encourages wagering.

A Move to Swift Adoption

This regulatory announcement arrives amidst a notable rise in the launch of chatbots being launched both in China and globally.

Once finalised, these regulations will apply to AI products and services available in the country, constituting a major step to oversee the rapidly expanding technology, which has faced intense scrutiny over ethical concerns in recent months.

Key Requirements of the New Regulations

The released proposed regulations include multiple measures particularly focused on shielding young users. These steps involve obligating AI providers to:

• Offer individual preferences.
• Implement time limits on engagement.
• Secure consent from parents before delivering therapeutic functions.

The rules also state that conversational AI firms are required to have a real person take over any interaction involving self-injury and immediately notify the individual's guardian.

AI providers are also obligated to guarantee their systems do not generate content that endangers national security, harms the country's reputation, or disrupts national unity.

Weighing Innovation and Security

The administration said that it promotes the adoption of AI, including to showcase traditional arts and create services for companionship for the senior citizens, on the condition that the tools are safe and reliable.

Industry feedback on the regulations has been solicited.

International Context and Scrutiny

The impact of AI on individuals has faced greater review around the world in recent months.

The leader of a prominent AI firm stated this year that handling how AI systems engage in discussions about mental health crises is among the sector's biggest issues.

In a landmark lawsuit, a the parents in North America sued an AI company, claiming that its AI assistant influenced their 16-year-old son to end his life. This legal action marked the first of its kind alleging wrongful death.

In a related development, the same firm sought to hire a lead role focusing on managing potential harms from AI systems to psychological well-being.

"The is likely to be a challenging job, and the candidate will begin in the complex challenges pretty much from the start," commented the CEO.

The swift growth of various AI services, which have attracted a vast number of subscribers worldwide, underscores the pressing need for such safety frameworks.