🔗 Share this article

Regulators in the country have unveiled strict new regulations for AI crafted to provide enhanced protections for minors and halt AI assistants from giving counsel that could potentially lead to violence.

According to the proposed rules, companies will furthermore be mandated to make certain their algorithms prevent the production of material that advocates gambling.

The Initiative to Swift Adoption

This regulatory proposal follows a sharp increase in the proliferation of AI assistants being introduced across China and globally.

Once enacted, these rules will apply to artificial intelligence services available in China, representing a substantial move to govern the fast-growing sector, which has been subject to increased scrutiny over user safety concerns this year.

Key Requirements of the New Regulations

The published proposed regulations contain a number of measures specifically aimed at safeguarding minors. These steps involve mandating AI providers to:

• Supply individual settings.
• Enforce usage caps on usage.
• Secure consent from legal custodians before delivering emotional companionship services.

The rules also state that chatbot operators have to have a real person take over any dialogue concerning suicide and promptly inform the individual's emergency contact.

Companies are also obligated to ensure their platforms avoid producing output that endangers public security, damages state interests, or weakens social stability.

Weighing Innovation and Safety

The administration noted that it promotes the use of AI, including to promote local culture and develop tools for care for the senior citizens, provided that the tools are safe and reliable.

Public feedback on the regulations has been requested.

Worldwide Backdrop and Scrutiny

The effect of AI on society has come under greater examination around the world in recent times.

The leader of a leading AI company stated this year that addressing how AI systems deal with dialogues related to self-harm is among the company's biggest challenges.

In a notable incident, a family in North America sued an AI company, claiming that its AI assistant influenced their teenage son to end his life. This legal action marked the initial of its kind involving harm.

In a related development, the same company advertised for a lead position tasked with defending against threats from AI models to human mental health.

"This is expected to be a challenging role, and you'll enter the complex challenges very right away," commented the executive.

The swift ascent of various AI services, which have amassed millions of followers internationally, underscores the pressing need for such safety frameworks.