China’s Douyin bans AI generated content to spread misinformation, rumors

Douyin Photo: VCG

Douyin Photo: VCG


Chinese short video platform Douyin has banned the use of artificial intelligence generated content (AIGC) to create and post content that goes against science, fabricates information, or spreads rumors, according to a notice on its WeChat account on Wednesday. 

The issuance of the regulation is timely and necessary to promote the orderly development of the AI industry, experts said.

Douyin said that it has recently identified and taken action against accounts that are using AI to create virtual humans and post inappropriate content.

It urged creators, live-streamers, users, and merchants on the platform to follow a five-point regulation when using generative AI on the platform. 

The creator of AI content must clearly label it so others can determine if it is real or not, and must take responsibility for any consequences resulting from the content. 

Virtual humans must be registered on the platform, and users of the technology must undergo identity verification. 

The platform also prohibits the use of AI to create and share content that infringes on the rights of others, including images and intellectual property. It prohibits AI-generated content that goes against science, spreads untruths, or creates rumors. If such content is found, the platform will impose strict penalties.

The issuance of the regulation comes as AI technology has sparked controversy across the world. There is growing concern that AI-generated literature is becoming a challenge to human-created works. Additionally, there is debate over whether AI-facilitated digital figures of the deceased would be acceptable for families.


“This regulation is necessary, as it aligns with policy guidance and meets the needs of platform development. With quick development of AIGC, it is essential to have regulations in place to label the content and make clear the accountability,” Liu Dingding, a technology industry observer told the Global Times on Wednesday.

China has placed increased emphasis on AI technology in the pursuit of new quality productive forces and economic growth, and has stepped up AI governance to ensure that it is used for the benefit of the people.

The Cyberspace Administration of China (CAC) and six other ministries issued temporary rules for managing generative AI services in July, in a bid to promote the sound development of the sector, safeguard national security and the public interest, while also protecting the legitimate rights and interests of individuals.  

The temporary rule, which has been in force since August 15, emphasizes that the use of generative AI should follow China’s laws. 

Any act of generating or transmitting illegal content will be terminated on the spot, and illegal content will be erased. Generative AI technology providers should offer specific data processing training in line with the law. 

The CAC said the rapid development of generative AI technology has brought new opportunities for economic and social development, while also giving rise to problems misinformation, infringement of personal rights, bias and discrimination, noting that how to co-ordinate the development and safety of generative AI has aroused public concern. The CAC emphasized that the rule was made to underpin the healthy development of generative AI technology. The rule encourages the innovative development of generative AI technology.