Meta's platforms showed hundreds of "nudify" deepfake ads, CBS News investigation finds

A CBS News investigation revealed that Meta's platforms hosted hundreds of ads promoting "nudify" deepfake apps, which create sexually explicit images of real people using AI, prompting Meta to remove the ads and block associated URLs. The ads, some targeting men aged 18-65 in the US, EU, and UK, often redirected to websites or app stores offering the deepfake services, raising concerns about user consent, online safety, and the effectiveness of Meta's content moderation, despite its stated policies against non-consensual intimate imagery. Experts suggest that while trust and safety teams at Meta may care, the company is under-resourcing the effort to combat these sophisticated deepfake networks.

Analysis

A CBS News investigation has revealed a significant lapse in Meta's content moderation, with hundreds of advertisements for "nudify" deepfake applications proliferating across its platforms, including Instagram and Facebook, despite Meta's stated policies against non-consensual intimate imagery. These ads, some specifically targeting men aged 18-65 in the United States, European Union, and United Kingdom, promoted AI tools for creating sexually explicit deepfakes, often redirecting to websites charging users $20 to $80 or to app stores like Apple's where such applications were downloadable. Although Meta reported removing flagged ads and blocking associated URLs, citing ongoing efforts against sophisticated evasion tactics, expert Alexios Mantzarlis from Cornell University suggests a potential lack of commitment from Meta's top leadership and under-resourcing of its trust and safety teams. This situation, reflected in a strongly negative sentiment score for Meta (-0.8) and a general market impact score of 0.6, raises significant concerns regarding regulatory compliance, particularly with new legislation like the "Take It Down Act," user safety, especially for minors due to inadequate age verification on associated sites, and potential reputational damage. The continued availability of these tools, even on Apple's App Store and Google's Play Store as noted by Mantzarlis, underscores a broader industry challenge in effectively policing AI-generated exploitative content, touching upon themes of AI ethics, cybersecurity, and data privacy.

Key Decisions for Investors

• Investors should monitor Meta for heightened regulatory scrutiny and potential financial penalties stemming from inadequate content moderation of AI-generated harmful material, which could impact its operational costs and legal liabilities.
• Assess the ongoing reputational risk for Meta, and to a lesser extent Apple, due to the association with the proliferation of deepfake tools, as this could negatively affect user engagement, advertiser confidence, and overall brand value.
• Consider the likelihood of increased investment in trust and safety initiatives at Meta, which may pressure operating margins, and watch for signals of cross-industry cooperation to combat the dissemination of these AI tools.