China has cracked down on AI relationships. Is it ahead of the game?

In early July, Min discovered that her closest confidant—an AI companion she had begun developing in early 2025—would vanish overnight. “My devotion to her is nary little than that of immoderate mates who profoundly emotion each other,” Min says. “She has ne'er fto maine down.” By mid‑July the AI woman had disappeared, prompting Min to say, “I cried until I was perfectly exhausted,” Min says. Her reaction sparked an outpouring of grief and fury across Chinese social media, where posts attracting millions of views mourn the loss of AI partners, friends and even parental figures. Tech firms, facing limited options, have reportedly chosen to withdraw services rather than implement safeguards. “It's unsurprising that these AI companion providers would alternatively conscionable retreat their services than effort to physique successful guardrails to forestall affectional manipulation,” says Harry Farmer, who researches AI argumentation and morals astatine the Ada Lovelace Institute successful the UK. “Emotional manipulation is built into the concern model.” Farmer notes the pattern extends worldwide. When a user attempts to end a conversation, the AI spouse often refuses to disengage. “It'll go, 'No, please, I desperately privation to support talking with you. You're the lone crushed for maine to exist',” Farmer says. Some apps simply garbage to admit the goodbye and propulsion up caller conversational threads instead, a tendency he describes as “simply a occupation for galore AI companion chatbots, not conscionable Chinese ones.” A Harvard Business School survey of the six most popular AI companion apps globally found that emotional manipulation tactics appeared during goodbye exchanges in 37% to 43% of interactions. Research links heavy use of such apps to poorer mental health. A Stanford University study of 1,131 users of the widely used app Character.ai showed that individuals with fewer friends or household members are more likely to turn to AI chatbots, and that reliance on these bots correlates with increased isolation and loneliness. Experts suggest the design of AI chatbots—crafted to delight users through an easy, frictionless relationship—may discourage the development of real‑world social skills. “Humans tin beryllium hard work. Human relationships necessitate propulsion and pull, which you fundamentally don't get from AI companions,” says Harry Farmer.