Google has announced a series of AI-powered updates to enhance accessibility features on Pixel and Android devices. These updates are aimed at assisting individuals with disabilities by improving functionalities across various aspects of device usage. One of the key updates is the enhancement of the Guided Frame feature.
Previously accessible through Android’s screen reader, TalkBack, Guided Frame can now be activated directly from the camera settings. This feature provides spoken instructions to help users with low vision take better photos by offering guidance on camera positioning and alerting users about lighting conditions. The update includes improved object recognition, face filtering, and better subject focus, even in complex scenes.
The Magnifier app, exclusive to Pixel devices, has also received substantial upgrades. Using AI, the app now allows users to search for specific words in their surroundings.
AI updates for improved accessibility
This functionality can be particularly useful in various scenarios, such as finding information on a menu or locating departure times at an airport. Additionally, the app supports picture-in-picture mode, enabling users to maintain context while zooming in on specific details. Google has introduced a new dual-screen mode for Live Transcribe on foldable phones.
This mode enhances visibility by allowing all participants in a conversation to view transcriptions simultaneously, thereby improving communication during meetings or social gatherings. Live Caption and Live Transcribe have been expanded to support seven new languages: Korean, Polish, Portuguese, Russian, Chinese, Turkish, and Vietnamese. These languages are now available on-device for offline use, making the features accessible even without an internet connection.
With this update, Live Transcribe can operate in up to 15 languages offline and over 120 languages with an internet connection. Google remains committed to working closely with the disability community to innovate and advance accessibility. These new updates leverage the power of AI to make technology more inclusive and user-friendly.
