Google’s Gemini Live Now Rolling Out Real-Time AI Features: Live Screen & Camera Interpretation Goes Live for Select Users:

At this month’s MWC, Google announced the possible launching of Gemini Live and now they have supposedly begun adding real-time AI features to it. Users can screen or point their smartphone cameras towards objects and answer questions about them in real time. These capabilities are built with live multimodal data fusion and allows for new forms of user interactions with Gemini to be developed. Designed by Google DeepMind under Project Astra, these features enable users Gemini engagement unlike any other previously available.

New features included in Google’s Gemini Project Astra: Here’s how it operates

Google AI intereprets feeds from smartphone cameras and screens in real time. As per Google’s spokesperson Alex Joseph in a statement given to The Verge, these real time features have now been enabled for limited users, specifically some Google One AI Premium subscribers. Furthermore, it was built on Google’s other project named Project Astra which was first presented nearly one year back at the Google I/O 2024.

Elsewhere, Kien_PS, a Reddit user also claimed to have seen this implementation on his Xiaomi device not long ago according to 9to5Googles. Eventually they shared a video showcasing Gemini’s recently developed capability of reading content that is displayed on a screen. Another key feature being rolled out is interpreted relayed video. With this, Gemini is capable of analyzing the camera feed of a smartphone in real-time and giving useful information based on what the device is pointing towards.

In alignment with the Google One AI Premium plan to be released on Android devices later this month, Google plans to implement new screen-sharing and live video capabilities for Gemini Advanced subscribers. Additionally, earlier this year, Google said that users of the Pixel and Galaxy S25 series will be able to take advantage of these capabilities first. Nonetheless, these features are still in a phased rollout and will only be available to Android users for the time being.