Apple Updates App Store Rules to Ban ‘Nudify’ AI Apps

Apple on October 16, 2026 updated its App Store review guidelines, more explicitly banning “nudify” apps that use AI tools to generate sexual images without the person’s consent. According to a report by The Verge’s Jay Peters, the revision was a response to growing criticism of Apple over nonconsensual sexual deepfake images generated by AI.

As part of the same day’s update, Apple specified that developers “must proactively prevent and remove” nonconsensual sexual images under content moderation requirements. It also outlined measures against developers who fail to address such images.

developers “must proactively prevent and remove” nonconsensual, sexual images

Developers who “fail to implement appropriate safeguards” or “do not correct violations after notification” may be removed from the App Store. As the wording of the rules became more specific, what had previously been left to the discretion of review authorities became an explicit prohibition.

The Trigger: Nonconsensual Images via Grok

The issue began when X users used xAI’s conversational AI “Grok” earlier this year to generate sexual deepfake images without the subjects’ consent. The situation was worsened by reports that images involving minors were created.

Apple did not remove X or Grok from the App Store. At the same time, it has said it warned U.S. senators that it would remove Grok. The rule revision appears to have been made in response to criticism of this handling.

At WWDC in June, protest participants called on Apple to “remove Grok, X, and all nudify technology from the App Store.” In July, the San Francisco City Attorney ordered Apple to remove 13 nudify apps, and Apple said it complied. This sequence shows the growing social pressure on companies that operate distribution platforms.

Moderation Obligations Imposed on Developers

In this revision, Apple also clarified rules prohibiting apps that add or change functions after passing review. This covers “bait-and-switch” apps that add “nudification” features after approval. It can be seen as an attempt to close off a route by which apps that appear harmless at review time later incorporate problematic features.

Apple’s rules also clarified its stance on apps that “facilitate human trafficking or child exploitation.” Such apps will be removed from the App Store and “blocked from alternative distribution,” it said. By explicitly excluding them not only from its own store but also from alternative distribution channels being developed in Europe and elsewhere, the move appears aimed at increasing the effectiveness of regulation.

For developers, implementing preventive measures becomes a precondition for passing review. Apps with image generation functions will need to build moderation system design into the planning stage. Clarifying the rules has the effect of encouraging such advance measures.

Treatment of Feature Additions After App Review

A system regulating feature additions after review places an operational burden on developers. When adding AI functions after release, prior confirmation and moderation systems are required. Because App Store review in principle targets the state at the time of application, the question is how thoroughly Apple can conduct continuous monitoring after approval.

Apple is incorporating generative AI functions into its own services. As the platform becomes more AI-driven, as seen in the Siri overhaul in iOS 27 (Apple Intelligence Begins in Earnest, Siri AI Overhaul Coming in iOS 27), managing AI-generated content has become an unavoidable issue. Internal technologies continue to be updated for developers as well, including a shift to Swift (Apple Migrates TrueType Hinting to Swift, 13% Faster). Apple’s dual position—providing its own AI and reviewing other companies’ AI apps—makes its response difficult.

It is also worth noting that the rules are limited to the “nudify” use case. As long as general-purpose image generation tools can perform the same function, a ban that names individual apps will still have limits in coverage. The extent to which Apple builds detection technology and user-reporting mechanisms will determine its effectiveness.

Industry Moves on Nonconsensual Images

Nonconsensual sexual images generated by AI have become a problem faced in common by platform companies. As the capabilities of the models themselves improve, images can be generated easily from text prompts, making detection and removal more difficult.

As generative AI models continue to improve (OpenAI Announces GPT-5.6: Three Models, Sol, Terra, and Luna), the risk of nonconsensual image generation only rises. Writing rules into the guidelines is only the first step; actual detection and removal operations will be tested. Both developers and distribution platforms increasingly need to incorporate countermeasures from the design stage of generative functions.

The Future of Platform Regulation

Apple’s decision not to remove Grok shows a gap between stricter rules and actual enforcement. Even if something is prohibited under the rules, applying them to large-scale services involves commercial and political considerations. The rule update can be seen as making explicit the basis for such decisions.

The next focus will be whether this revision spreads to other platforms and app distribution platforms. In particular, how much responsibility distribution operators should bear for managing AI-generated content is an issue linked to regulatory trends in various regions. Deciding to suspend large-scale services that generate substantial advertising revenue has a major business impact, making uniform enforcement difficult.

Editorial Opinion

Following the rule revision, developers working on AI image generation will be forced to review post-review feature additions and moderation systems. If changes after approval are deemed bait-and-switch, they may become subject to removal, potentially affecting release plans. We expect that within a few months, more companies will shift to development processes premised on prior review.

In the long term, the trend toward platform operators bearing responsibility for managing AI-generated content will strengthen. Writing rules alone has limits in effectiveness, and the focus will shift to detection technology and the introduction of third-party audits. Whether rules can be applied to large-scale services will be at the heart of future debate.

A gap remains between putting rules into writing and actual removal decisions. How should Apple’s decision not to remove Grok be assessed? Both developers and regulators are being asked how far the prevention of nonconsensual images should be mandated technologically.

References

• “Apple’s updated App Store rules go after ‘nudify’ AI apps”, by Jay Peters — The Verge, 2026-10-16T22:51:22.000Z (ARR)
• Source URL: https://www.theverge.com/tech/1013314/apple-app-store-nudify-ai-apps-harassment