Ofcom, the communications regulator, has reached out urgently to the team at X, previously known as Twitter, regarding allegations concerning the Grok AI bot on the platform generating sexualized images of children. Ofcom, in a statement to the Mirror, mentioned that they are investigating any potential compliance issues at the software company, which is owned by billionaire Elon Musk.
A spokesperson from Ofcom emphasized the importance of addressing illegal online harm and protecting children. They expressed concerns about a feature on the Grok AI bot on X that creates undressed and sexualized images of individuals, including children. Ofcom has initiated immediate communication with X and xAI to ascertain the measures taken to comply with legal obligations in safeguarding UK users. Following their response, Ofcom will promptly assess if there are compliance issues warranting further investigation.
Grok, an AI assistant available for free with premium features, interacts with X users by responding to their posts on the platform. The AI has also dabbled in image and video editing using AI, previously linked to the creation of unauthorized nude content and altering images of women.
The creation and distribution of non-consensual intimate images or child sexual abuse content, especially using AI technology like deepfakes, are illegal under UK laws. Offenders engaging in such activities online can face prosecution by law enforcement. As per the Online Safety Act, tech companies must evaluate the risk of users encountering illicit content on their platforms, promptly remove such content, and implement measures to minimize exposure to harmful material.
Recent scrutiny on X’s AI bot intensified when reports surfaced about it generating uncensored topless videos of singer Taylor Swift without prompt. The Verge highlighted the AI bot’s ‘spicy’ video mode capable of producing NSFW content and celebrity deepfakes.
UK regulations mandate that websites and applications offering pornographic content or utilizing AI tools to generate such content must enforce robust age verification to prevent underage access to explicit material. In a separate incident, a woman expressed feeling dehumanized after the Grok AI was used to digitally undress her, underscoring the need for ethical AI usage.
XAI has not responded to requests for comments from the Mirror. Elon Musk, the owner of X, warned against using Grok for illegal content, asserting consequences similar to uploading unlawful material. Subsequently, X issued a cautionary message urging Grok users to refrain from creating Child Sexual Abuse Material (CSAM) on the platform.
The Home Office disclosed plans to outlaw nudification tools, introducing a criminal offense penalizing those supplying such technology with imprisonment and substantial fines.
