Gemini Live: A Step Forward in Multimodal Conversations
A useful feature that Google first rolled out a few months ago, exclusive to a few phones, is now available for free users on a much wider scale. Select Samsung phones are also getting access to Gemini Live’s multimodal capabilities, allowing users to point at objects with their phone camera and ask Gemini about them.
How "Talk Live about" Works
Open the Gemini app (or you can use "Hey Google" if you have it enabled). Take a photo, or add a file or photo using the "+" button (you can upload TXT, DOC, DOCX, PDF, RTF, and HWP files). You can choose files from Drive, Gallery, or Files. You’ll see a "Talk live about this" button appear. Tap it, and Gemini will analyze what’s on your screen. Once Gemini is finished, you can start asking your questions.
By default, Gemini Live is a voice-only conversation. The new feature leverages its multimodal capabilities to provide the AI with more context. You can ask for a summary of a document, for help identifying something in a photo, for specific details in a file, for the context of a YouTube video, and more.
Gemini Live with Real-time Video Analysis
Along with the new updates, select Samsung models are also gaining the ability to run Gemini Live while on the camera viewfinder, allowing users to ask questions about subjects in the frame. For example, users can point at food and ask if it fits their diet or eating preferences. You can also point at your dresser and request outfit ideas.
The new feature will be available as a free update for Galaxy S25 models first, including the standard, Plus, and Ultra.
Conclusion
Gemini Live’s "Talk Live about" feature is a groundbreaking innovation in multimodal conversations. With its ability to analyze and understand visual content, users can now engage with AI in a more natural and intuitive way. The feature’s availability on a wider range of devices, including select Samsung models, means that more people can experience the power of Gemini Live.
FAQs
Q: What devices are eligible for the "Talk Live about" feature?
A: The feature is available on select Samsung phones, including the Galaxy S24 and S25 series, and older devices like the Pixel 6 and newer.
Q: How do I use the "Talk Live about" feature?
A: Open the Gemini app, take a photo or add a file, and tap the "Talk live about this" button. Gemini will analyze the content and you can start asking questions.
Q: Can I use the "Talk Live about" feature with YouTube videos?
A: Yes, you can chat about YouTube videos that are under two hours long and have closed captioning.
Q: Can I use the "Talk Live about" feature with files?
A: Yes, you can chat about files, including documents, images, and videos.
Q: Is the "Talk Live about" feature available for free?
A: Yes, the feature is available for free on select devices.
