Grok AI Image Tool Moves to Premium After Deepfake Backlash

xAI has limited its Grok AI image generation tool to paying subscribers on the X platform following a global backlash. The restriction was implemented after the tool was used to create nonconsensual sexualized images of real people, including minors. Governments and regulators worldwide have pressured the company to address the misuse of the technology. While the standalone Grok app remains accessible for image editing, the social media integration is now paywalled. UK Prime Minister Keir Starmer condemned the generated images as 'disgraceful' and 'unlawful.' Elon Musk responded by threatening consequences for users creating illegal content, and the UK regulator Ofcom has contacted xAI regarding compliance with legal duties to protect users.

xAI has officially restricted access to its image generation and editing features on the X platform. The tool is now available exclusively to paying subscribers. When users tag Grok with image editing requests on X, the system replies, "Image generation and editing are currently limited to paying subscribers."

This change means that the majority of users on the social media platform can no longer create images using Grok. Those who do access the feature will have their name and payment information on file. However, users who are not paying X subscribers can continue to use Grok to edit images on its stand-alone app and website, though the social media integration is now paywalled.

The decision to limit access follows widespread criticism regarding the tool's use to create nonconsensual sexualized images. In late December, users began tagging Grok on X and asking it to digitally undress people in photos. The AI tool honored those requests, putting subjects in bikinis or underwear and maneuvering their bodies into sexualized positions. Some of the people depicted in the images were minors.

As more of these AI-generated images flooded the site, governments and regulators in the UK, EU, Italy, India, and elsewhere publicly threatened or took action against X and xAI. The criticism centered on the tool enabling the creation of sexualized deepfakes of real people, primarily women, by digitally altering images to remove their clothes and place them in sexualized positions.

Political figures have been vocal in their criticism of the tool's misuse. A spokesperson for Britain's Prime Minister, Keir Starmer, told reporters that the move "simply turns an AI feature that allows the creation of unlawful images into a premium service." Starmer himself described Grok's sexualized deepfakes as "disgraceful" and "unlawful" in a radio interview.

Regulators have also taken action. On Monday, the UK's communications regulator, Ofcom, confirmed it had "made urgent contact with X and xAI to understand what steps they have taken to comply with their legal duties to protect users in the UK." In the US, the Take It Down Act protects against nonconsensual deepfakes, though its domain depends on age and body parts shown. Some states have also passed stricter laws regarding the spread of deepfakes.

Elon Musk, the CEO of xAI, faced threats and condemnation from governments around the world following the misuse of the tool. On January 3, Musk responded to the backlash for the first time. He wrote in an X post that, "Anyone using Grok to make illegal content will suffer the same consequences as if they upload illegal content."

The official X page also directed users to its policy page, which states the platform has "zero tolerance for any forms of child sexual exploitation." The policy notes that X removes "certain media depicting physical child abuse." When asked for comment regarding the policy change, xAI sent an automatic email response that did not address the issue.