Google Announces Guided Vision Feature for Android Devices
Integrated with Gemini Live, the new feature provides real-time audio descriptions for surroundings, text, and objects using the phone's camera.
Google has announced the rollout of the Guided Vision feature within Gemini Live for compatible Android devices; this new tool uses artificial intelligence support to audibly describe objects and small text seen by the phone's camera.
Gemini Live and Camera Integration
The Guided Vision feature helps users understand details in their surroundings by sharing the camera within Gemini Live. Users can have the objects they point their phones at explained, small text read out, or surrounding items identified.
Accessibility and Device Compatibility
Developed similarly to Apple's VoiceOver Live Recognition feature, the system targets individuals who are blind, have low vision, or need additional support in certain situations. The feature is accessible via the Gemini app as well as Google TalkBack.
Usage Details and Warnings
An accessibility shortcut can be assigned from the Settings app on Android 9 and newer versions, and users can ask follow-up questions about the objects they see. Google notes that the system should not be used as a replacement for a cane or mobility aid for guidance or travel safety.