UK Government Urges Ofcom to Ban X Over AI Deepfake Concerns

The UK government has called on Ofcom to use its full regulatory powers, including the ability to effectively ban platforms, to address concerns over unlawful AI-generated images on X, formerly Twitter. The move comes amid a growing backlash against the use of X's AI tool, Grok, to create deepfakes, including the digital removal of clothing from images of individuals.

Ofcom, the UK's communications regulator, has been urged to take decisive action under the Online Safety Act, which grants it the authority to seek court orders to prevent platforms from operating in the UK if they fail to comply with regulations. This includes blocking access to technology and funding through advertisers and other payment sources. While Ofcom's powers have only been used six times since the act's implementation, the government has emphasized the need for a robust response to the deepfake issue.

Government Pressure and Public Outrage

The government's call to action follows widespread public outrage over the misuse of Grok, an AI tool developed by xAI, a subsidiary of X. Reports of the tool being used to create sexually explicit deepfakes, including the digital alteration of images to remove clothing, have sparked concerns about privacy, consent, and the potential for harm. Prime Minister Sir Keir Starmer described the situation as "disgraceful" and "disgusting," pledging full support for Ofcom to take action.

The possibility that Grok could be used to create sexualized images of children has raised particularly alarming concerns. Government sources have stressed the urgency of addressing the issue, noting that Ofcom has the authority to act swiftly in cases involving serious harms or risks to children. The regulator has already made "urgent contact" with X and xAI to investigate the concerns.

Ofcom's Regulatory Powers and Next Steps

Under the Online Safety Act, Ofcom has the power to impose significant penalties on platforms that fail to comply with regulations, including fines and court-ordered bans. While the process typically requires a thorough investigation, Ofcom can expedite action in cases where there is evidence of serious harm or a history of non-compliance. The regulator is currently recruiting a new chair, who is expected to take a more robust approach to internet safety and national security issues.

X has issued a statement warning that anyone using or prompting Grok to create illegal content will face the same consequences as if they uploaded illegal content directly. However, the government's push for Ofcom to use its full powers signals a growing intolerance for platforms that fail to prevent the misuse of AI technologies.

The situation highlights the broader challenges of regulating AI-generated content and the need for stricter oversight as new technologies emerge. As deepfakes become more sophisticated and accessible, governments and regulators worldwide are grappling with how to balance innovation with the protection of individual rights and public safety.