Government & Policy

UK’s internet regulator warns social media platforms over risks of inciting violence

Comment

Riot police hold back protesters after disorder broke out on July 30, 2024 in Southport, England.
Image Credits: Christopher Furlong / Getty Images

The U.K.’s internet regulator, Ofcom, has published an open letter to social media platforms raising concerns about the use of their tools to incite violence. The development follows days of violent civil unrest and rioting in towns and cities around the United Kingdom after the slaying of three young girls in a knife attack in Southport on July 30.

Ofcom has powers to sanction video platforms for failing to protect their users from content that’s likely to incite violence or hatred. Under the U.K.’s newer Online Safety Act (OSA), Ofcom’s powers to enforce content moderation standards online have been further expanded to cover all sorts of platforms, including social media services.

Penalties under the OSA can reach up to 10% of global annual turnover — so, on paper, the regulator’s toolbox contains hefty new powers to clamp down on serious content moderation failures.

However, Ofcom is still in the process of implementing the regime. Enforcement on social media platforms is not expected to kick in before 2025, as the regulator continues to consult on guidance for how firms should comply.

Parliament will also need to approve these rules before enforcement starts. Currently, there is no clear legal route for Ofcom to compel social media firms to tackle hateful conduct that may be whipping up violent social unrest.

Nonetheless, in recent days there have been calls for Ofcom’s enforcement timeline to be speeded up in light of the civic unrest and for the regulator to be more proactive in dealing with social media giants.

Speaking to the BBC Radio 4’s World at One program on Tuesday, former minister Damian Collins urged Ofcom to “put the tech companies on notice.”

“Communications on social media platforms that incite violence, create genuine fear people have of being the victim of violent acts, that incite racial hatred, these are already regulatory offences under the Act,” Collins told the BBC. “What Ofcom needs to be doing now is putting the tech companies on notice to say they will be audited using the powers Ofcom has to look at what they did to try and dampen down the spread of extremist content and disinformation related to that extremist content on their platforms.

“[The tech companies] have the power to do that… and my concern is, it’s not just they’re not doing that, they are actively amplifying this content and making the problem worse.”

Concern over the role of social media platforms, including Elon Musk’s X (formerly Twitter), was sparked almost immediately by the swift spread of disinformation about the identity of the minor responsible for killing the three girls.

U.K. media outlets were initially restricted from reporting the identity of the suspect who police had arrested because he is under the age of 18. A judge later lifted the restriction, naming the teen as a British-born citizen called Axel Rudakubana, but not before the information vacuum had been exploited by far right activists using platforms like X to spread false claims that the killer was a Muslim asylum seeker.

Activists also used social media sites and messaging apps such as Telegram to organize fresh unrest. The first violent disturbance took place in Southport the day after the killings. Since then unrest has spread to a number of towns and cities in England and Northern Ireland, with incidents including looting, arson and racist attacks. Several police officers were injured in the clashes.

Musk personally waded into the fray, engaging with content posted on X by far-right influencers intent on using the tragedy to further a divisive political agenda. That includes X user Tommy Robinson (also known as Stephen Yaxley-Lennon), whose account X reinstated last year, lifting a 2018 Twitter ban that had been imposed for breaching the platform’s hateful conduct policies in posts targeting Muslims.

In one of Musk’s own posts remarking on the unrest in the U.K., Musk suggested “civil war is inevitable.” In another, Musk attacked U.K. Prime Minister Keir Starmer, insinuating that his government is responsible for so-called two-tier policing, a right wing conspiracy theory that suggests police are tougher on right-wing criminality.

Ministers have rubbished Musk’s claim and disputed the framing of the violent public disturbances as protests, instead branding the individuals involved “thugs” who are engaged in “criminal acts.”

The government has also vowed to bring the full force of the law to bear on anyone involved. But that still leaves the tricky question of how to handle major tech platforms which are being used to spread content intended to whip up violence and to organize fresh unrest. That specifically includes X, where the owner of a platform is himself amplifying the divisive dogwhistling.

Ofcom’s public letter, which is attributed to Gill Whitehead, its group director for online safety, represents the weakest level of regulatory intervention possible, lacking a strong and forceful call to action for platforms to act. There is only a suggestion to platforms that “you can act now.”

But it may be all Ofcom feels able to do at this point.

“When we publish our final codes of practice and guidance, later this year, regulated services will have three months to assess the risk of illegal content on their platforms, and will then be required to take appropriate steps to stop it appearing, and act quickly to remove it when they become aware of it,” writes Whitehead, underscoring the OSA enforcement gap it’s saddled with — failing new action by the government to speed up the implementation timeline.

“Some of the most widely-used online sites and apps will in due course need to go even further — by consistently applying their terms of service, which often include banning things like hate speech, inciting violence, and harmful disinformation,” the Ofcom letter continues, pointing to some of the incoming duties social media firms will be expected to comply with once the OSA is fully up and running.

The regulator goes on to say it expects “continued engagement” with companies during the OSA implementation period.

“[W]e welcome the proactive approaches that have been deployed by some services in relation to these acts of violence across the UK,” Ofcom adds, ending with a suggestion that platforms shouldn’t wait for the “new safety duties” to kick in but can instead “act now” to ensure their services are “safer for users.”

But without a fully implemented regime to force platforms to clean up their act, Ofcom’s letter may be all too easy for certain chaos-peddlers to ignore.

More TechCrunch

Ola Electric, India’s largest electric two-wheeler maker, saw its shares rise as much as 20% on its public debut on Friday, making it the biggest listing among Indian firms in…

Ola Electric surges in India’s biggest listing in two years

Rocket Lab surpassed $100 million in quarterly revenue for the first time, a 71% increase from the same quarter of last year. This is just one of several shiny accomplishments…

Rocket Lab’s sunny outlook bodes well for future constellation plans 

In 1996, two companies, Patersons HR and Payroll Solutions, formed a venture called CloudPay to provide payroll and payments services to enterprise clients. CloudPay grew quietly over the next several…

CloudPay, a payroll services provider, lands $120M in new funding

The vulnerabilities allowed one security researcher to peek inside the leak sites without having to log in.

Security bugs in ransomware leak sites helped save six companies from paying hefty ransoms

Featured Article

A comprehensive list of 2024 tech layoffs

The tech layoff wave is still going strong in 2024. Following significant workforce reductions in 2022 and 2023, this year has already seen 60,000 job cuts across 254 companies, according to independent layoffs tracker Layoffs.fyi. Companies like Tesla, Amazon, Google, TikTok, Snap and Microsoft have conducted sizable layoffs in the…

A comprehensive list of 2024 tech layoffs

A new “beta rabbit” mode adds some conversational AI chops to the Rabbit r1, particularly in more complex or multi-step instructions.

Rabbit’s r1 refines chats and timers, but its app-using ‘action model’ is still MIA

Los Angeles is notorious for its back-to-back traffic. Three events that promise to bring in millions of spectators from around the world — the 2026 World Cup, the Super Bowl…

Archer to set up air taxi network in LA by 2026 ahead of World Cup

Featured Article

Amazon is fumbling in India

Amazon’s decision to overlook quick-commerce in India is now looking like a significant misstep.

Amazon is fumbling in India

OpenAI’s GPT-4o, the generative AI model that powers the recently launched alpha of Advanced Voice Mode in ChatGPT, is the company’s first trained on voice as well as text and…

OpenAI finds that GPT-4o does some truly bizarre stuff sometimes

On Thursday, Box filled in a missing piece on its AI platform when it bought automated metadata extracting startup, Alphamoon.

Box adds crucial piece to its AI platform with Alphamoon acquisition

OpenAI has announced a new appointment to its board of directors: Zico Kolter. Kolter, a professor and director of the machine learning department at Carnegie Mellon, predominantly focuses his research…

OpenAI adds a Carnegie Mellon professor to its board of directors

Count Spotify and Epic Games among the Apple critics who are not happy with the iPhone maker’s newly revised compliance plan for the European Union’s Digital Markets Act (DMA). Shortly…

Spotify and Epic Games call Apple’s revised DMA compliance plan ‘confusing,’ ‘illegal’ and ‘unacceptable’

Thursday seeks to shake up conventional online dating in a crowded market. The app, which recently expanded to San Francisco, fosters intentional dating by restricting user access to Thursdays. At…

Thursday, the dating app that you can use only on Thursdays, expands to San Francisco

AI companies are gobbling up investor money and securing sky-high valuations early in their life cycle. This dynamic has many calling the AI industry a bubble. Nick Frosst, a co-founder…

Cohere co-founder Nick Frosst thinks everyone needs to be more realistic about what AI can and cannot do

Instagram is rolling out the ability for users to add up to 20 photos or videos to their feed carousels, as the platform embraces the trend of “photo dumps.” Back…

Instagram is embracing the ‘photo dump’

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Anyone paying…

Lyft ‘opens a can of whoop ass’ on surge pricing, Tesla’s Dojo explained and Saudi Arabia pumps $1.5B into Lucid

Flint Capital just closed its third fund at $160 million. Its has a unique strategy for finding its limited partner investors. 

Flint Capital raises a $160M through an unusual fund-raising strategy

Earlier this week it emerged that the DPC had instigated court proceedings seeking an injunction against X over the data processing without consent.

Elon Musk’s X agrees to pause EU data processing for training Grok

During testing, Google DeepMind’s table tennis bot was able to beat all of the beginner-level players it faced.

Google DeepMind develops a ‘solidly amateur’ table tennis robot

The X account announced that its Premium+ subscription would now be “fully” ad-free, leading some to question how this change would affect creator earnings.

As X sues advertisers over boycott, the app ditches all ads from its top subscription tier

Apple has further revised its compliance plan for the European Union’s Digital Markets Act (DMA) rulebook, which, since March, has forced it to give iOS developers more freedom over how…

Apple revises DMA compliance for App Store link-outs, applying fewer restrictions and a new fee structure

The rise of neobanks has been fascinating to witness, as a number of companies in recent years have grown from merely challenging traditional banks to being massive players in and…

Chime and Dave execs are coming to TechCrunch Disrupt 2024

If you visited the Wikipedia website on mobile this week, you might have seen a pop-up indicating that dark mode is ready for prime time.

How to enable Wikipedia’s dark mode

The home security company says attackers accessed databases containing customer home addresses, email addresses, and phone numbers.

Home security giant ADT says it was hacked

The Looking Glass Pro has a 6-inch display and a foldable base. It shows spatial images like those created with the Apple Vision Pro and iPhone 15 Pro.

Looking Glass’ new lineup includes a $300 phone-sized holographic display

TikTok’s latest offering is capitalizing on the app’s ability to serve as a discovery engine for other media — something its users already take advantage of by sharing short clips…

TikTok partners with Warner Bros. to become a discovery engine for TV and movies

Cocoon is a new startup built on the belief that greener steel production and the creation of concrete slag doesn’t have to be an either/or proposition.

Cocoon is transforming steel production runoff into a greener cement alternative

SoundHound, an AI company that makes voice interface tech used by car companies, restaurants and tech firms, is doubling down on enterprise services by playing consolidator in a crowded market.…

SoundHound acquires Amelia AI for $80M after it raised $189M+

Seeking mental health support is a complex process, but some founders believe that using AI to formalize techniques like cognitive behavioral therapy (CBT) can help folks who might not have…

Feeling Great’s new therapy app translates its psychiatrist co-founder’s experience into AI

The U.K.’s antitrust regulator has confirmed that it’s carrying out a formal antitrust investigation into Amazon’s ties with Anthropic, after Amazon recently completed a $4 billion investment into the AI startup.…

UK launches formal probe into Amazon’s ties with AI startup Anthropic