There was a time when reporting multiple posts from an account would actually make a difference. You could flag eight, ten, maybe a dozen pieces of clearly inappropriate content, and the account would feel it. Enforcement was visible. Content disappeared. Repeat offenders were penalised. It was imperfect, but it worked.
Fast forward a few months to today, and that mechanism has changed. Reporting still exists, but it rarely leads to account-level consequences. Individual posts might be removed, but the accounts themselves often return unscathed, often within hours. The system now tolerates borderline content that generates engagement. The more that content keeps users scrolling, the more it benefits the platform financially. Enforcement has shifted from active policing to selective friction: taps that don’t register, reporting flows that stall, and content areas, profile links, certain stories, images, that are effectively unreportable.
Many accounts exist in a halfway house. Their content is technically blocked from underage users, but the mechanisms for verifying age are weak. The platform largely relies on self-reported information, meaning that anyone old enough to create an account sees this content. At the same time, the content continues to perform, generate engagement, and attract revenue. The system appears to protect younger audiences, while still allowing profitable material to circulate freely, and it assumes that adults wish to see this form of content…
What emerges is a pattern: platforms prioritise money and engagement over user safety. Enforcement is visible only on the surface. Accounts that could be harmful are rarely removed, even after repeated reporting. Many at best are removed for a few hours and then return online, fresh as a daisy, with all the content that was there before as well as the new daily posts. Try reporting those and you will find that the category may be there, but the system ignores the report.
High-performing content is protected indirectly through friction, loopholes, and algorithmic promotion. In other words, the platform has perfected the art of appearing in control while actively tolerating, and sometimes boosting, the very behaviour it publicly discourages.
For users trying to report harmful content, the reality is clear: the system is designed to filter reports, reset violations, and maximise engagement. The leverage of individual users has decreased significantly. The pathway to real enforcement is slow, opaque, and largely reserved for content that crosses a clear legal line. Meanwhile, the engagement engine continues, and profitable accounts thrive.
How Recent Legal Rulings Could Change the Landscape
Last week saw a pair of high-profile jury verdicts in the United States that mark a shift in how courts are willing to scrutinise social media platforms’ responsibilities. In one case, a jury found that a platform had harmed users’ mental health and awarded damages to a plaintiff who argued that addictive design features contributed significantly to her struggles. In a separate state case, another jury found a social media service liable under consumer protection law for failing to safeguard young people from harmful content and ordered a substantial civil penalty.
What makes these verdicts noteworthy is not just the financial awards but the legal reasoning behind them. They move beyond the traditional idea that platforms are merely hosts for user-generated material and instead hold them accountable for the design and effects of their services. One successful strategy in court was to frame algorithms and recommendation systems as part of the product itself rather than passive conduits for whatever content users post.
This legal shift could have implications for the broader ecosystem of content moderation. If more plaintiffs can argue and more courts accept that platform design contributes to harm then the calculus around enforcement, including how harmful content is surfaced, tolerated, or moderated, may change under external pressure. It does not instantly fix reporting mechanisms but it does introduce a real liability risk that could compel platforms to rethink moderation, safety thresholds, age verification, and enforcement systems more seriously than algorithms tuned for engagement alone.
Crucially, these cases are far from settled law. Appeals are expected and outcomes will vary by jurisdiction. But the fact that such verdicts have been reached at all signals that the legal environment may be tilting toward greater accountability for platforms that allow harmful content to persist, especially where it intersects with youth safety.
References:
