Microsoft Interns Build Camera-Based App to Teach Adult English Literacy
A team of Microsoft interns creates Read My World, an app that uses smartphone cameras and computer vision to help adults learn English vocabulary from everyday objects. The tool focuses on practical, day-to-day words rather than formal lesson plans.
A team of eight Microsoft interns develops a new language learning app called Read My World, which uses a smartphone camera to help adults improve their English literacy. Instead of traditional lesson plans, the app encourages users to snap photos of everyday objects and text to learn vocabulary in real-world contexts. This approach serves as a practical supplement to formal classroom training or provides an accessible alternative for those who lack the time or funds for traditional classes.
The application leverages Microsoft Cognitive Services and Computer Vision APIs to identify objects within the camera's frame. Once an item is recognized, the app displays the spelling and speaks the phonetic pronunciation of the corresponding English word. Users also have the option to save these photos to a personal dictionary within the app for future study and reference.
Read My World features a focused library of 1,500 words, a number that aligns closely with the practical vocabulary many learners acquire through years of traditional study. To reinforce learning, the app includes three built-in vocabulary games for users to practice their newly discovered words. Additionally, based on early feedback from teachers and students, the developers add a feature that detects and highlights readable words in documents so users can hear their proper pronunciation.