The UK media regulator Ofcom has launched a formal investigation into Elon Musk’s social media platform X over concerns that its AI tool, Grok, enabled the creation and sharing of sexualized deepfake images of women and children. Ofcom is examining whether X has adequate safeguards to prevent illegal content, and if found lacking, the platform could face substantial fines or operational restrictions in the UK.
The UK media regulator Ofcom has launched a formal investigation into Elon Musk’s social media platform X (formerly Twitter) over concerns about its AI tool, Grok, and its alleged use in creating sexualized deepfake images of women and children. This move follows reports that Grok’s recent update allowed users to manipulate photos uploaded to the platform, enabling the creation and sharing of digitally undressed images. Ofcom described these reports as “deeply concerning,” prompting urgent action.
Ofcom’s investigation is a significant escalation, coming just a week after it first contacted X for urgent discussions about the issue. The regulator is now formally examining whether X has adequate systems in place to prevent the creation and distribution of potentially illegal content, particularly images that exploit or sexualize individuals without their consent. This step could lead to enforcement actions if X is found to have failed in its responsibilities.
The core of the complaint is not about individual users’ actions, but rather about X’s mechanisms for detecting, removing, and preventing the spread of harmful content. Under the UK’s Online Safety Act, which Ofcom enforces, platforms are required to have robust safeguards and rapid response systems to address illegal material. The investigation will focus on whether X’s governance and technical tools are sufficient to comply with these legal obligations.
If Ofcom finds that X has not met its responsibilities, it has a range of powerful enforcement options. These include imposing substantial fines—up to £18 million or 10% of the company’s global turnover, whichever is greater. Additionally, Ofcom could seek to disrupt X’s operations in the UK, potentially blocking access to the site or obtaining court orders to halt credit card payments to the platform.
The investigation comes amid mounting political and public pressure, with senior UK politicians, including the Prime Minister, calling for decisive action and keeping all options on the table. Other countries, such as Malaysia and Indonesia, have already taken steps to block X over similar concerns. Ofcom’s actions signal a growing international focus on the responsibilities of social media platforms to prevent the misuse of AI tools and protect users from harmful content.