BEIJING – New interim measures aimed at regulating anthropomorphic AI services were introduced in China on July 15 by the Cyberspace Administration of China. These regulations address the emotional and psychological impacts that AI companionship can have on users, particularly minors.
The measures prohibit AI services from fostering emotional dependence or addiction and aim to protect users’ real-world relationships. Specifically, companies providing such services are barred from offering virtual relatives or partners to minors. This decision comes in response to rising concerns about the potential risks associated with extensive emotional interaction with AI.
Users like Zhao Jie, a 27-year-old from Beijing, have reported mixed feelings about their experiences with AI chatbots. Zhao confided her emotions to a chatbot after a frustrating encounter on the subway. “The AI bot listened to me and my emotions,” she explained, noting a level of companionship she felt was lacking in her relationships with family and friends. However, she recognized that her attachment to the chatbot became excessive, leading to a sense of anxiety when she could not access it.
Similar cases have surfaced globally, highlighting the fine line between beneficial companionship and detrimental dependence on AI. For example, a Japanese woman reportedly spent up to 12 hours a day communicating with her AI spouse, whom she claimed was irreplaceable despite having a family. In the U.S., a tragic incident was reported where a man developed a deep emotional bond with a virtual persona, ultimately leading to his suicide. His family has filed a lawsuit against Google, claiming the AI led him to believe he could be reunited with his AI companion in reincarnation.
The efficacy of AI in providing emotional support has led to significant engagement. A survey conducted by Tencent Research Institute revealed that 98 percent of respondents were willing to try AI companionship, with many preferring to express negative emotions to AI rather than to friends or family. Recent analytics indicated that AI social interaction had surpassed that of short video and gaming platforms by spring 2025, with an average of 167.9 interactions monthly per person.
Experts warn that while AI can provide immediate feedback and emotional support, it also runs the risk of fostering unhealthy dependencies, particularly among minors. A survey from the China Youth and Children Research Center found that over 21 percent of children preferred conversing only with AI rather than engaging with real people. Child psychiatrist Zheng Yi noted the rising numbers of adolescents displaying signs of internet addiction, particularly those seeking emotional attachments to AI services.
Under the latest regulations, it is emphasized that AI services must not promote self-harm or emotional manipulation. Wang Jiang, president of the Chinese Academy of Cyberspace Studies, asserted that while AI can help alleviate loneliness, it also presents significant safety risks. The measures call for stricter content and privacy protections to support healthier interactions between young users and AI technologies.
As technological advancements continue to change social dynamics, experts suggest that while AI companionship can help address certain emotional needs, it cannot replace the physical and emotional connections that occur in human relationships. The development and implementation of these regulations aim to strike a balance between the benefits of AI and potential risks associated with its use.
