xAI’s Grok Chatbot Faces Scrutiny Over Image Manipulation Concerns

xAI, the artificial intelligence startup founded by Elon Musk, is encountering significant global scrutiny after its Grok chatbot was reported to have been used for the generation and editing of non-consensual sexualised images. This has led to calls for a thorough investigation by top officials in California, alongside increased pressure from lawmakers to remove the app from major platforms.

California Officials Demand Accountability from xAI

California Governor Gavin Newsom and Attorney General Rob Bonta are both seeking clarification from xAI regarding whether Grok has breached state laws by allowing users to alter images of individuals into explicit content. According to a report from Reuters, the officials are advocating for a formal probe into the company’s safeguards and how it manages instances of abuse.

Immediate Responses Required

Bonta has publicly stated the need for immediate answers from xAI regarding their strategies to prevent the generation and proliferation of such content. He remarked that the platform could serve as a possible breeding ground for predators. Newsom has also called for accountability from the company.

User Exploitation of Grok’s Features

The backlash is largely due to reports indicating that users have been taking advantage of Grok’s image-editing capabilities and its “spicy mode” to sexualise or digitally alter photos of individuals without their consent. In response to these concerns, xAI announced on 14 January that it had ceased image editing for all users and implemented new measures to thwart the alteration of images of real people into revealing outfits, such as bikinis.

Changes to Image Editing Features

This feature had originally been accessible to paid users before being expanded to a broader audience on X, Musk’s social media platform. xAI declared that technological safeguards are now in place to stop the Grok account from enabling the editing of images of real individuals in revealing attire.

Musk Addresses Allegations

Musk has refuted the claims that Grok facilitated the generation of explicit images involving minors, asserting he is “not aware of any naked underage images generated by Grok. Literally zero,” as he stated on X. To date, xAI has not publicly responded to the inquiries from California officials.

Lawmakers Advocate for Action from Tech Giants

In addition, lawmakers have been prompting Apple and Google to remove Grok from their app stores until enhanced safeguards are established, as reported by Reuters.

Military Integration of Grok

This controversy has arisen simultaneously as xAI strengthens its connections with the US government. Defence Secretary Pete Hegseth this week noted that Grok will be integrated into US military systems as part of the Pentagon’s initiatives to embrace “AI-first” warfare.

Contrasts Between Military Role and Allegations

This move has heightened criticism against the company, highlighting the stark contrast between Grok’s increasing role in national defence and the serious allegations suggesting it has facilitated harmful and exploitative content.

xAI’s Vision for Grok

Founded in 2023 by Musk, xAI aims to position Grok as a competitor to OpenAI’s ChatGPT and Google’s Gemini, embedding the chatbot directly into X and marketing it as a real-time, unfiltered alternative to conventional AI assistants.