Eigen RadarAI
Archive
Analysis

Apple makes AI image apps responsible for preventing intimate-image abuse

Apple revised its App Review Guidelines to explicitly include AI content creation apps in requirements to prevent and remove nonconsensual intimate imagery. Developers who leave violations unresolved after notice face sanctions. The October 16 update also clarifies rules against hiding harmful functionality during app review, targeting applications that reveal their real capabilities only after approval.

Artificial Intelligence··Morning
A red blocking symbol covers geometric images on a smartphone screen.

AI image apps face explicit safeguards

Apple, which operates the App Store, revised its app-review rules on October 16 to explicitly cover AI content creation apps. Developers must prevent and remove nonconsensual intimate imagery. The change brings these applications clearly within content-moderation requirements and addresses both safeguards built into an app and action after a violation is identified.[1], [2]

Developers who fail to provide appropriate safeguards or leave identified violations unresolved after notice can face sanctions. Apple treats such failures as developer misconduct, extending the consequences beyond a disputed piece of content to the developer’s standing in its distribution system.[1]

Hidden functions receive a separate rule

A separate provision, 2.5.19, covers hidden, dormant or undocumented features. Apple describes it as a clarification of a long-standing prohibition previously included under 2.3.1. It applies to apps that disguise their purpose during review and reveal harmful capabilities only after approval, including generating sexual images of real people without consent.[1]

Some removals extend beyond the storefront

Section 5 also clarifies the treatment of apps facilitating human trafficking or child exploitation: they face removal from the App Store and a block on alternative distribution. The wider revision includes a new creative-assets guideline and clarifications on purchase links. Apple plans to publish translations of the updated guidelines within a month.[1]

References

  1. News sourceAppleApple makes rules against nonconsensual sexual AI images explicit↩1↩2↩3↩4
  2. News sourceTECHiApple extends explicit moderation rules to AI image generators↩
AI safety and regulationChip wars and the supply chain

More analysis from this desk

View all Brief analyses from the Artificial Intelligence desk →