Microsoft Seeing AI App Adds Touch-Based Photo Exploration for Blind Users
Microsoft updates its Seeing AI app to allow blind and low-vision users to explore photos by touch, hearing descriptions of objects and people wherever they tap. The update also brings native iPad support and interface customization options.
Microsoft's Seeing AI app introduces a groundbreaking touch-based feature that allows blind and low-vision users to explore photos through audio feedback. By tapping anywhere on a photo, users hear a description of the objects and people located at that specific spot, along with the spatial relationships between them.
The tool uses machine learning and facial recognition to identify not just objects, but also the physical appearance and predicted moods of people in the frame. This allows users to tap around an image to discover fine details, such as background posters or foreground flowers, that a general overall description might miss entirely.
Beyond the new touch exploration capabilities, the updated app now offers native support for the iPad to better accommodate tablet users. Additionally, Microsoft includes interface improvements that allow users to customize and order the app's features according to their personal preferences.