Back to News
Market Impact: 0.15

Meta says online harassment is up and false flags are down following a change in content moderation policies

META
Technology & InnovationRegulation & LegislationCybersecurity & Data PrivacyManagement & GovernanceMedia & Entertainment
Meta says online harassment is up and false flags are down following a change in content moderation policies

Meta's Q1 2025 integrity report revealed a slight increase in online bullying/harassment and violent/graphic content on Facebook, with prevalence rising to 0.07-0.08% and 0.09% respectively, attributed to increased sharing of violating content in March. These changes follow Meta's January overhaul of content moderation policies, which aimed to reduce enforcement errors by allowing more political content and replacing third-party fact-checkers with community notes. While Meta reports a decrease in overall content actioned and pre-user report takedowns, the company acknowledges the need to balance enforcement with curbing errors, as the policy shift has seemingly led to a short-term uptick in harmful content.

Analysis

Meta's Q1 2025 integrity report reveals a marginal increase in specific categories of harmful content on Facebook, occurring subsequent to significant revisions to its content moderation policies implemented in January 2025. The prevalence of bullying and harassment content saw a slight rise from a range of 0.06-0.07% in Q4 2024 to 0.07-0.08% in Q1 2025. Similarly, violent and graphic content prevalence increased from 0.06%-0.07% to approximately 0.09% over the same period. Meta attributes this uptick primarily to a spike in the sharing of violating content during March and, for violent content, also to ongoing efforts to refine enforcement and reduce mistakes. These figures emerged after Meta overhauled its content moderation strategy, which involved paring down policies to permit more political content, narrowing the definition of "hate speech" to focus on "direct attacks," and notably, replacing third-party fact-checkers with a crowd-sourced "community notes" system akin to that of X. A key reported success of these changes is a significant reduction in content removal error rates, which Meta claims have been cut in half, alongside a decrease in the amount of content actioned before user reports. However, the Q1 data, being the first to reflect these new policies, indicates a potential short-term trade-off where efforts to reduce over-enforcement might correlate with a slight increase in visible violating content. Meta acknowledges it is striving to "strike the right balance" between effective enforcement and minimizing errors. For historical context, bullying and harassment violations were reported at 0.08%-0.09% in Q1 2024, suggesting the current Q1 2025 levels, while up quarter-over-quarter, are not sharply divergent from prior year first-quarter figures.