TikTok's Plan to Combat Misuse of AI-Generated Content

Published On Fri May 10 2024
TikTok's Plan to Combat Misuse of AI-Generated Content

TikTok to label AI-generated content from OpenAI and elsewhere ...

TikTok announced on Thursday its plans to introduce a labeling system for images and videos on its platform that have been created using artificial intelligence. This labeling will be done using a digital watermark called Content Credentials.

Concerns have been raised by researchers about the potential misuse of AI-generated content, especially in the context of influencing U.S. elections. In response to these concerns, TikTok, along with 20 other tech companies, has signed an agreement to combat the spread of such content.

How Digital Watermarks Strengthen C2PA Content Credentials

Implementation of Labeling Policies

While TikTok already identifies AI-generated content created within its own app, the new initiative will extend this labeling to content that is generated externally. Adam Presser, TikTok's head of operations and trust and safety, emphasized the platform's strict policies against the dissemination of unlabeled realistic AI content.

The technology behind Content Credentials was developed by the Coalition for Content Provenance and Authenticity, with support from companies like Adobe and Microsoft. OpenAI, the creator of ChatGPT, has already adopted this technology for its platform.

For instance, when an image is generated using OpenAI's Dall-E tool, a watermark is added to the image file to indicate its AI origin. If such an image is shared on TikTok, it will be automatically flagged as AI-generated content.

OpenAI unites with C2PA Steering Committee

Industry Adoption

YouTube and Meta Platforms have also expressed their intentions to utilize Content Credentials. For this system to be effective, both the creators of generative AI tools and the content distribution platforms must agree to adhere to the industry standard.

TikTok, a subsidiary of ByteDance based in China, currently has 170 million users in the U.S. The recent legislative efforts to force ByteDance to divest TikTok have been met with legal challenges citing concerns over freedom of speech.