Apple Announces On-Device Child Safety Tools for Messages and iCloud Photos
Apple introduces new child safety features for its platforms, including warnings for explicit photos in Messages and on-device scanning of iCloud Photos for known abuse material.
Apple previews new child safety features arriving later this year to protect minors using its devices. Available initially in the United States, these tools include a Communication Safety feature in the Messages app that warns children when they send or receive sexually explicit photos. The system uses on-device machine learning to blur sensitive images and alert the child, while still maintaining end-to-end encryption for all iMessage conversations.
Another major component of this initiative targets Child Sexual Abuse Material (CSAM) stored in iCloud Photos. Instead of scanning images in the cloud, Apple performs on-device matching using an unreadable database of known CSAM image hashes provided by the National Center for Missing and Exploited Children. This hashing technology, known as NeuralHash, converts images into unique numerical signatures to identify illegal content without compromising user privacy.
When a user's device accumulates a threshold number of matching CSAM hashes, Apple manually reviews the flagged content to confirm a violation. If the material is verified as illegal, Apple reports the account to the National Center for Missing and Exploited Children so the organization can work with law enforcement agencies. Apple emphasizes that this entire system is designed to prioritize child safety while strictly limiting Apple's access to innocent users' personal photo libraries.