Microsoft’s Seeing AI Mobile App Can Help Visually Impaired Users

At Microsoft’s Ability Summit 2024, the companyreleasedthe Seeing AI mobile app, powered by AI, on Android and iOS. The app is an effort by Microsoft to bring the latest AI advances to persons with disabilities. This app, in particular, can help visually impaired and blind users to see and understand the world using AI. Itreads aloud everythingaround you so low-vision people can identify products, hear descriptions of photos, and much more.

The app is currently available in 33 languages, and Microsoft is planning to roll out the app in 36 languages by the end of 2024. I installed the Seeing AI app (Android/iOS— Free) on my Android smartphone. It offers several options including product discovery using barcodes, currency identification,people recognition, document reading, etc.

What I like about this app is that you can scan photos of your friends and family and you can name each person. When you scan that person with the app, itidentifies the faceand reads aloud the person’s name. This is an incredibly helpful feature for blind people, assisted by AI. I also installed Google’s Lookout app (Free) but it doesn’t have an option for people identification.

In addition, you need to download country-specific data each time you want to use one of its features. That is not the case with Microsoft’s Seeing AI app. Besides that, you can identify colors,read handwritten text,and share images to let the app describe them. In my testing for handwritten text, it worked well with some minor issues.

The good part is that the Seeing AI appworks in the offline mode too, except for scene detection and document reading. Overall, Microsoft’s effort to make AI a helpful tool for low-vision users is commendable. Besides AI chatbots and other applications, accessibility is an area where AI can be of tremendous help.

Arjun Sha

Passionate about Windows, ChromeOS, Android, security and privacy issues. Have a penchant to solve everyday computing problems.

Add new comment

Name

Email ID

Δ

01

02