Apple Introduces People Detection Feature to Help Blind iPhone Users
Apple's latest iOS beta includes a new accessibility tool that uses lidar technology to tell blind users the exact location and distance of people nearby. The feature provides audio, haptic, and visual feedback to assist with everyday navigation and social distancing.
Apple introduces a groundbreaking accessibility feature in the latest iOS beta that uses the iPhone's camera and lidar sensor to detect people and measure their exact distance. Originally developed for augmented reality, this "people occlusion" technology now helps blind and visually impaired users understand their surroundings by announcing whether someone is in view and precisely how far away they are in feet or meters.
The system provides real-time feedback through multiple channels to suit different user needs. Blind users receive stereo audio cues that correspond to the direction of the detected person, along with customizable tones that change when someone crosses a set distance threshold. For individuals with both visual and hearing impairments, a haptic pulse vibrates faster as a person gets closer, offering a completely tactile way to gauge proximity.
While the feature naturally helps users maintain a safe social distance during the pandemic, it also assists with basic daily tasks like navigating store lines or deciding when to cross the street. Currently restricted to the iPhone 12 Pro and Pro Max due to their required lidar hardware, the tool integrates directly into the existing Magnifier app and even includes an on-screen arrow for users who have partial vision but still need help locating others nearby.