China’s AI companion rules force Doubao, Qwen shutdowns


TL;DR

ByteDance’s Doubao and Alibaba’s Qwen are disabling custom AI agent features ahead of China’s Interim Measures on anthropomorphic AI interaction services, effective 15 July. The rules target bots offering sustained emotional interaction while sparing workplace and productivity agents. Tencent pulled a similar Yuanbao feature in June, and users are protesting the loss of chat histories.

ByteDance’s Doubao and Alibaba’s Qwen, two of China’s biggest consumer AI apps, are disabling their customised agent features, the South China Morning Post reports. The move comes days before Beijing’s new rules on humanlike AI interaction services take effect on 15 July.

Doubao told users on Friday that its agent feature would go offline on 15 July, citing product function adjustments. Related data will stop being viewable or recoverable inside the app after 15 October.

Qwen followed on Saturday, saying humanlike interactive agents and user-created agents would be disabled on 10 July, with broader agent functions offline by 15 July. Users will lose access to agent settings and their previous conversations.

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!

Both apps let users build named assistants, tutors, role-playing characters, or companions with fixed personas and speaking styles. Tencent removed a similar feature from its Yuanbao assistant in June, and Chinese state media confirms the shutdowns are about regulatory compliance.

The new rules

The Interim Measures for AI Anthropomorphic Interaction Services were issued in April by the Cyberspace Administration of China and four other agencies. They cover services that simulate human personality traits, thinking patterns, and communication styles to provide sustained emotional interaction.

Customer service bots, knowledge Q&A, workplace assistants, and education and research tools are excluded, provided they avoid sustained emotional interaction. The measures cite risks spanning extremist content, privacy leaks, harm to mental health, and addiction, and require anti-addiction systems and identity checks for minors.

“Current agents are not yet mature,” Pan Helin, a member of an expert committee at China’s Ministry of Industry and Information Technology, told the SCMP. He said the policy prioritises safety, practical use, and standardisation.

Companions out, workers in

Beijing is not against agents as such. Regulators issued guidance in May on the managed development of AI agents, and China released national standards in June covering agent identity, discovery, interaction, and tool use.

The pattern suggests China wants agents as productivity infrastructure while squeezing companion bots that form quasi-social bonds with users. Researchers have long documented the risks of such bonds, from AI girlfriends’ hunger for personal data to what Wharton academics call cognitive surrender.

Platforms outside China face growing pressure over emotionally engaging bots too, with Meta posing as teens to test rival chatbots on sensitive topics. Beijing has simply chosen to regulate first and let the products catch up.

The timing stings for both companies, which are pouring resources into AI, from Alibaba’s homegrown accelerator chips to Doubao’s push to become China’s default assistant. It also lands as Beijing tightens control of the sector in other ways, including plans to vet US investment in its top AI firms.

Users mourned the shutdowns openly, with one Weibo poster calling the agents long-standing emotional support and lamenting the lack of any easy way to export chat histories. In China’s agent economy, the companions go first and the workers stay.



Source link

Leave a Reply

Subscribe to Our Newsletter

Get our latest articles delivered straight to your inbox. No spam, we promise.

Recent Reviews


TL;DR

Meta stripped NameTag facial recognition code from its AI app one day after WIRED exposed it on 50 million phones. Meta says no decision has been made.

Meta removed nearly all traces of an unreleased facial recognition system from its smart glasses companion app on Friday, one day after WIRED reported that the software had been quietly embedded in an app installed on more than 50 million phones. The feature, which Meta internally called NameTag, was designed to convert faces captured by the company’s Ray-Ban smart glasses into unique biometric signatures and compare them against a database stored on the user’s device. WIRED also found that faces the system failed to recognise were cropped, indexed, and stored locally for future processing.

Andy Stone, Meta’s vice president of communications, told WIRED on Monday that the feature is “purely exploratory,” adding that no final decision has been made on what to do with it. That characterisation sits uneasily with the evidence WIRED documented. The version of Meta AI published the day of WIRED’s Thursday report contained several code libraries explicitly named for face recognition, a process for running the NameTag recognition pipeline, and a “Person recognised” alert the app would have shown if someone were identified.

Friday’s release stripped all of it out, along with a folder where the app would have stored the cropped images and biometric signatures of unrecognised faces. Meta did not answer WIRED’s questions about why the code was removed or whether the changes were planned before the story was published. A few fragments remain in the latest version, including an internal debug menu label and a dormant link meant to open a recognised person’s profile, pointing to parts of the system that are no longer there.

The 💜 of EU tech

The latest rumblings from the EU tech scene, a story from our wise ol’ founder Boris, and some questionable AI art. It’s free, every week, in your inbox. Sign up now!

The gap between Meta’s public statements and the code WIRED found is the central tension. Before the Thursday report, Stone dismissed the findings by writing that the company could not answer questions about how the system would work because “the feature does not exist.” Andrew Bosworth, Meta’s chief technology officer, called the reporting “incredibly misleading” and “absolutely dishonest.” Yet the code was functional enough to include three AI models, one to detect faces, another to crop them, and a third to encode them as biometric data, all embedded in the companion app for a product already at the centre of a mounting privacy crisis.

Meta declined to answer ten questions WIRED posed before publishing, including whether it had already created the database of face profiles NameTag uses, how long the app retains photographs and biometric data of unrecognised people, and whether that data would ever be sent back to Meta’s servers. The company also did not respond to questions about whether it was building NameTag for blind or low-vision users, or to criticism from privacy advocates who warned the system could let stalkers and abusers identify strangers in public.

NameTag first surfaced in February, when The New York Times, citing internal Meta documents, reported that the company was developing face recognition for its smart glasses and considering a launch as early as this year. One internal memo reportedly described releasing the feature during a “dynamic political environment” when privacy and civil liberties advocates would be distracted by other concerns. WIRED subsequently found that much of NameTag’s machinery had been built into the Meta AI app as early as January, months before any public acknowledgement, adding another layer to the company’s pattern of shipping first and disclosing later when it comes to its smart glasses.

Kade Crockford, director of the technology for liberty programme at the American Civil Liberties Union of Massachusetts, said the removal does not undo the original decision to ship the code and pointed to it as evidence that consumer privacy needs stronger legal protection than Congress has been willing to provide. The Massachusetts House of Representatives last week unanimously passed a consumer privacy bill that, if enacted as written, would impose strong enforcement provisions including a private right of action allowing aggrieved users to sue. “State lawmakers need to do their job and step up to protect consumer privacy,” Crockford said.

Meta’s sneaky tactics in slipping the face-recognition code into its smart glasses show exactly why data privacy bills need the teeth of strong enforcement,” Crockford added. “Companies like Meta prioritise their bottom line, so lawmakers need to speak in the only language its C-suite understands.” Whether a code removal prompted by investigative reporting constitutes a victory or merely a tactical retreat depends on what Meta does next, and on whether the regulatory pressure building on both sides of the Atlantic produces enforceable consequences before the feature quietly returns under a different name.



Source link