In a series of Threads posts this afternoon, Instagram head Adam Mosseri says users shouldn’t trust images they see online because AI is “clearly producing” content that’s easily mistaken for reality. Because of that, he says users should consider the source, and social platforms should help with that.
The Concerns about AI-Generated Content
Mosseri writes, "Our role as internet platforms is to label content generated as AI as best we can," but he admits "some content" will be missed by those labels. Because of that, platforms "must also provide context about who is sharing" so users can decide how much to trust their content.
The Importance of Context
Just as it’s good to remember that chatbots will confidently lie to you before you trust an AI-powered search engine, checking whether posted claims or images come from a reputable account can help you consider their veracity. At the moment, Meta’s platforms don’t offer much of the sort of context Mosseri posted about today, although the company recently hinted at big coming changes to its content rules.
User-Led Moderation
What Mosseri describes sounds closer to user-led moderation like Community Notes on X and YouTube or Bluesky’s custom moderation filters. Whether Meta plans to introduce anything like those isn’t known, but then again, it has been known to take pages from Bluesky’s book.
Conclusion
In light of Mosseri’s concerns, it’s crucial for users to be cautious and critical when consuming online content. By thinking critically about the sources of the information we consume and being aware of the potential for AI-generated content, we can better navigate the online world.
FAQs
Q: What is AI-generated content?
A: AI-generated content refers to content created by artificial intelligence (AI) rather than humans.
Q: Why is AI-generated content a concern?
A: AI-generated content can be easily mistaken for reality, which can lead to the spread of misinformation and disinformation.
Q: What can users do to avoid falling prey to AI-generated content?
A: Users can check the source of the content they consume and be aware of the potential for AI-generated content. They can also use features such as fact-checking and verification tools to ensure the accuracy of the information they consume.

