Apple Threatens Grok App Ban Amid Deepfake Controversy; xAI Compelled to Address Compliance Issues

Apple Threatens Grok App Ban Amid Deepfake Controversy; xAI Compelled to Address Compliance Issues



Grok Chatbot Faces Recent App Store Controversy

Grok Chatbot Faces Recent App Store Controversy

Grok Chatbot has nearly faced a ban from Apple’s App Store following issues surrounding sexually explicit deepfakes generated by the chatbot. As reported by NBC, Apple identified violations in the guidelines of the App Store by both the X platform and the Grok AI chatbot, leading to a warning from the company about potential removal of the Grok app from its listings.

Despite this significant concern, Apple chose not to release a public statement regarding the violations associated with the AI chatbot. Reports suggest that the company made direct contact with the teams behind X and Grok to address complaints and media coverage regarding the issue.

Apple’s Request for Action

Apple urged the development teams to devise a clear strategy for managing and moderating inappropriate content within the app. Although xAI submitted an updated proposal in response, Apple deemed it insufficient, prompting another round of revisions from X, with only one submission ultimately receiving approval.

According to a letter from Apple to US senators, the company stated, “Apple reviewed the next submissions made by the developers and determined that X had substantially resolved its violations, but the Grok app remained out of compliance. Consequently, we rejected the Grok submission and informed the developer that further changes would be necessary to remedy the violation, or risk removal from the App Store.”

The letter continued by stating, “Following further engagement and modifications by the Grok developer, we concluded that Grok had substantially improved and thus approved its latest submission.”

Political Attention and Global Reactions

The controversy surrounding the Grok deepfake issue drew the attention of three US senators: Ron Wyden, Ben Ray Luján, and Edward Markey, who pressed Apple and Google to eliminate both the X app and the Grok chatbot from their respective stores.

In addition, the Indian government issued a stern notice to X, resulting in the removal of 3,500 posts and the blocking of 600 accounts. Nonetheless, the government remained dissatisfied with X’s prior responses to the notice. Similar measures were taken in the UK, Malaysia, and Indonesia, where X encountered temporary bans.

Furthermore, a separate NBC report has revealed that issues persist within the Grok chatbot, indicating the presence of numerous AI-generated sexualised images of women on the X platform.

Commitment to Safety

xAI takes a strong stance against the creation of non-consensual explicit deepfakes and the misuse of its tools for undressing real individuals. The company maintains robust safeguards to prevent such abuse, which include continuous monitoring of public use, real-time analysis of evasion attempts, regular model updates, prompt filtering mechanisms, and additional protective measures.

The X safety account shared a screenshot of the report and stated, “We strictly prohibit users from generating non-consensual explicit deepfakes and from using our tools to undress real people. xAI has extensive safeguards in place to prevent such misuse, such as continuous monitoring of public usage, analysis of evasion attempts in real time, frequent model updates, prompt filters, and additional safeguards.”


Exit mobile version