Gemini Guided Vision Adds Spoken Camera Cues

Google says its Guided Vision feature in Gemini Live can describe camera views and offer spoken prompts to adjust framing—potentially useful for everyday visual checks, but not for safe travel or navigation. The feature is available on Android 9 and above in regions and languages where Gemini Live is supported, according to Google’s announcement.

What Guided Vision can do

When you share your camera during a Gemini Live session with Guided Vision on, Google says you can ask follow-up questions and hear descriptions of your surroundings. If the camera points too high, too close or off to the side, Gemini may prompt you to tilt, step back or pan to get a clearer view.

Google lists everyday examples such as reading appliance dials, finding a dropped earbud, checking clothing colors and exploring a room. Those are uses described by the company, not independently verified results.

Google says it developed the feature with the accessibility community and partnered with Aira to visually interpret tens of thousands of hours of data. According to the announcement, more than 1,000 members of Aira’s Trusted Tester network helped stress-test and refine the model; Aira specialists also worked with Google on safety guardrails. That development process does not guarantee that any particular description will be correct.

Try it for a low-stakes visual check

To get started, update the Gemini app and Android system software. In the Gemini mobile app, open profile settings and turn on Use Guided Vision in Live; then open Gemini Live and share your camera. Google also describes ways to launch it through Android accessibility shortcuts or the TalkBack menu.

A practical first test could be asking about a familiar item’s color or pattern, then asking a follow-up question. Notice whether the spoken camera prompts help you bring the item into view, and treat the response as assistance rather than certainty.

Keep mobility aids and safe-travel practices

Google warns that Guided Vision can make mistakes. It is not a medical device or mobility aid, does not replace a white cane, and is not intended for navigation, safe-travel guidance or obstacle detection. Continue relying on established mobility aids and safe-travel practices in physical environments.

A room description is not a safety check. Guided Vision may help with specific visual questions, but Google’s stated limits matter when deciding what tasks to use it for.

If you try the feature, which everyday visual check would you want it to help with—and what would you need to know before relying on its answer?

Source image: Google.