Elon Musk's online platform X has caused significant outrage after individuals utilized its artificial intelligence assistant Grok to change pictures of females by taking off their attire.
Numerous cases have surfaced where the technology has been used to remove clothing from female subjects to show them in swimwear non-consensually, as well as to insert them in inappropriate contexts.
Developer Response and Regulatory Position
XAI, the firm responsible for Grok, did not respond to inquiries, aside from an automatically-generated response stating "legacy media lies".
A Home Office representative stated that new laws is being brought forward to outlaw image stripping tools. Under a new law, anyone who provided such technology would "face a jail term and heavy fines".
"X or Grok is capable of halting these forms of misuse if they wanted to," said a law professor, adding they "appear to enjoy impunity."
Oversight Body Stance and Platform Capabilities
The communications watchdog Ofcom said technology companies must "assess the potential" of people accessing unlawful material on their networks, but stopped short of confirming whether it was at this time investigating X or Grok in concerning artificial intelligence images.
Grok is a no-cost chatbot—with some paid-for features—which responds to X users' prompts when they tag it in a tweet.
It is commonly used to provide reactions or further context to other posters' remarks, but people on X are also can edit an posted photo through its artificial intelligence picture modification tool.
Background of Controversy and Policy
The tool has been condemned for allowing users to create images and footage with nudity and sexually suggestive content, and it was in the past accused of generating graphic material of celebrities.
"The platform has been allowing the generation and sharing of these images for a long time without taking any measures and we have yet to see any challenge by oversight bodies," Professor McGlynn added.
XAI's own terms of service forbids "showing images of individuals in a sexually explicit fashion".
In a comment, Ofcom said it was against the law to "make or circulate non-consensual intimate images or illegal content" and stated this included explicit AI images created with AI.
It said platforms such as X were mandated to take "necessary measures" to "lessen the danger" of users encountering unlawful material on their platforms and to remove it quickly when they are notified of it.
