Eigen RadarAI
Analysis

Google opens Gemini Live’s camera descriptions to blind users

Google launched Guided Vision in Gemini Live for blind and low-vision users. The feature describes a phone camera’s view, answers questions and gives spoken prompts to adjust its framing. It supports everyday tasks such as reading labels or finding objects. Access requires Android 9 or later where Gemini Live is available; Google warns that the system can make mistakes and is not intended for navigation.

Artificial Intelligence··Night
A phone camera points toward a dropped earbud on a bright kitchen floor.

Gemini Live describes the camera view

Google opened Guided Vision in Gemini Live on 1 October for blind and low-vision users. The feature provides spoken descriptions of a phone’s shared camera view, with access on Android 9 or later in supported regions and languages.[1], [2]

During a conversation, users can ask detailed questions about objects and their surroundings. Google describes uses including reading small food labels, appliance controls and restaurant menus, finding a dropped earbud, or identifying an item in a crowded spice cabinet. Colors, patterns, shapes and room layouts can also be described.[1]

Spoken prompts help reframe the camera

If the camera is pointed too high, too close or off to one side, the system gives verbal cues to adjust it. Examples include moving slowly to the right, tilting downward or stepping back. Google says development included visual-interpretation work and testing in daily routines, with feedback from user communities in India, Brazil, Singapore, Indonesia and Japan.[1]

Accessibility shortcuts open the feature

Guided Vision can be started through Gemini settings, Android accessibility shortcuts or the TalkBack menu. Google gives pressing both volume keys and a two-finger swipe as configurable shortcut examples. The company warns that the generative system can make mistakes. It is not intended for navigation, obstacle detection or safe-travel guidance, and does not replace a white cane or other mobility aid.[1]

References

  1. News sourceGoogleGoogle launches live visual assistance for blind users in Gemini Live↩1↩2↩3↩4
  2. News sourceUnite.AIGoogle opens Gemini Live’s camera descriptions to blind users↩