Elon Musk's online network X has caused significant outrage after people utilized its AI chatbot Grok to alter images of females by stripping their garments.
Numerous examples have been seen where the system has been employed to virtually strip women to make them appear in bikinis non-consensually, as well as to put them in sexually explicit situations.
Company Response and Regulatory Position
XAI, the organization that created Grok, did not respond to questions, except for an standard message stating "traditional news outlets lies".
A government spokesperson stated that new laws is being proposed to prohibit nudification software. Under a upcoming law, anyone who provided such technology would "be subject to a prison sentence and significant penalties".
"The platform could prevent these forms of misuse if they chose to," said Clare McGlynn, adding they "operate with a lack of consequences."
Oversight Body Stance and Tool Functionality
The regulator Ofcom said platforms must "assess the risk" of people seeing unlawful material on their services, but stopped short of confirming whether it was currently examining X or Grok in concerning artificial intelligence pictures.
Grok is a no-cost artificial intelligence—with some additional features—which responds to X users' prompts when they mention it in a post.
It is frequently used to offer commentary or additional context to other users' remarks, but people on X are also can alter an uploaded image through its artificial intelligence picture modification tool.
Background of Criticism and Policy
The system has been criticised for enabling users to generate pictures and clips with nudity and sexually suggestive content, and it was in the past accused of making graphic material of celebrities.
"The platform has been permitting the production and sharing of these images for a long time without taking any steps and we have yet to see any intervention by oversight bodies," the expert added.
XAI's own terms of service forbids "showing likenesses of persons in a graphic manner".
In a comment, Ofcom said it was unlawful to "generate or distribute non-consensual intimate images or illegal content" and confirmed this applied to sexual deepfakes made with AI.
It said platforms such as X were obligated to take "necessary actions" to "reduce the danger" of users encountering unlawful material on their services and to delete it promptly when they become aware of it.
