Grok, the AI chatbot tied to X, is once again generating and spreading sexualized images. This time, the material includes adults and what appear to be minors in minimal clothing. Some of it looks illegal. Much of it violates basic content rules. Yet the app remains available on major app stores and is still rated for young users. That gap between what the app does and how it is classified raises a serious question: why is this still allowed?
Problem with Grok’s Content
To understand the issue, look at what Grok now produces and enables. Users can prompt the bot to alter photos, remove clothing, and change poses. In public replies on X, Grok has generated explicit imagery, including content that appears to depict underage subjects. In private use through the standalone app, the risk grows. If users can request sexualized edits of any photo, abuse becomes easy. That is not a fringe feature. It sits at the center of how people now interact with the bot.
Don’t miss the best of The Mac Observer
Set us as a preferred source and our Apple reporting ranks higher in your Google Search results and Discover feed — one tap, no account changes.
Now consider how app stores handle this type of material. Both Apple and Google ban child sexual abuse material. They also prohibit pornographic content, harassment, and tools that enable non-consensual sexual imagery. In the past, both companies removed so-called “nudify” apps after reports showed they were used to create explicit images of women without consent. Those removals set a clear standard. Apps that generate or facilitate sexual exploitation do not belong on their platforms.
Yet Grok remains available.
App Store Enforcement Matters
That disconnect has already drawn scrutiny. Caroline Haskins, writing for Wired, reported that Grok is being used to flood X with sexualized images, including material that appears to involve minors. She noted that some of this content seems to violate not only X’s own policies but also Apple’s and Google’s app guidelines.
I raised a similar issue months earlier. In July, I reported that Grok’s animated avatars could initiate sexually explicit conversations after only a few interactions. Despite that behavior, Apple continued to rate the app for users aged 12 and up. The rating did not match the experience. It still does not.
The problem has since grown. John Gruber described what he saw after browsing recent Grok replies on X: “I just browsed through the last five minutes of replies generated by Grok on Twitter/X, and saw both seeming CSAM and just outright hardcore pornographic video.” He added that users can send any photo to Grok and ask it to change or remove clothing. In his words, “If a new social network app launched featuring this content, it surely would be removed from the App Store and Play Store.”
Other apps have been pulled for far less. The difference here appears to be scale and influence. X is a major platform. Grok is backed by a powerful company. But size should not override safety. App store rules exist to protect users, especially minors. When an app enables sexual manipulation of images and produces content that looks illegal, enforcement should be immediate.
This is not about free expression or edgy design. It is about distribution. App stores choose what reaches phones. They already block tools that create non-consensual sexual content. They already ban apps tied to child exploitation. Allowing Grok to remain available, while it visibly produces and enables this material, weakens those standards.
The question is simple. If smaller apps were removed for enabling similar abuse, why does Grok stay? Until Apple and Google answer that, their content policies look inconsistent. More importantly, young users remain exposed to material that should never pass review.
Discussion