Apple is set to introduce a new option in the latest iOS, macOS, and iPadOS versions that allows users to scan images in chat apps. However, users will need to enable this option themselves, which also requires app developers’ cooperation. The Sensitive Content Analysis framework will analyze images for sensitive content.
According to Apple, this feature will help detect nudity in images and videos before displaying them on the user’s screen. The company explains that this is aimed at protecting users from such content. App developers who wish to support this feature in their chat apps must make the necessary adjustments to integrate with the framework.
Apple emphasizes that the framework is solely intended to prevent users from encountering unwanted content and should not be used as a means for an app to report user behavior. To safeguard user privacy, the app prohibits transmitting any information indicating whether the framework has detected explicit images or videos. The feature will be added to iOS 17, iPadOS 17, macOS Sonoma, and watchOS 10 and will be available to users who have enabled Communication Safety or Sensitive Content Warning.
