Google Gemini Live Unveils Screen Sharing and Real-Time Video Features

At the recent Mobile World Congress (MWC), Google announced significant updates to its Gemini Live platform, integrating Project Astra to introduce screen sharing and real-time video interaction features. These enhancements aim to elevate the user experience of AI assistants by enabling more dynamic and interactive functionalities.

Google spokesperson Alex Joseph confirmed the rollout of these features via email. A new button labeled "Share screen with Live" allows users to effortlessly share their phone screens. In a demonstration shared by a Reddit user, Gemini accurately answered questions such as the current date and temperature based on the shared screen information.

Beyond screen sharing, Gemini Live now supports real-time video interpretation. Users can open their phone's camera, and Gemini will analyze the captured image to provide relevant answers. In a Google demonstration, a user inquired about the best paint for glazing pottery. With minimal delay, Gemini offered detailed recommendations, showcasing its advanced real-time processing capabilities.

These updates are part of Project Astra, Google's AI agent initiative launched last year. The project focuses on enabling real-time visual and voice interactions with large language models. Key features include low-latency audio and video conversations, multi-language support, memory of past conversation details, and integration with tools like Google Search and Maps. Notably, Project Astra is designed for cross-device compatibility, allowing users to access these features on Android phones or specialized glasses.

In contrast to Google's rapid advancements, Apple's Siri upgrades have reportedly stalled. According to Bloomberg, Apple executives acknowledged in internal meetings that Siri's AI improvements have fallen short of expectations, with the promised Apple Intelligence still not realized. This slow progress has placed Apple at a disadvantage in the competitive AI landscape.

Google's latest features underscore its leadership in the AI assistant domain while generating excitement for the future of AI-driven interactions. As competition intensifies, users can expect continued innovation and improvements in this rapidly evolving field.

Key Points

1. Google Gemini Live now supports screen sharing and real-time video interaction.
2. The updates integrate Project Astra for enhanced AI capabilities.
3. Users can share their phone screens or use their camera for real-time analysis.
4. Project Astra offers low-latency conversations and cross-device compatibility.
5. Apple's Siri upgrades lag behind Google's advancements in AI technology.