Now you can talk to Gmail, Google Docs and Keep – Gemini has learned to understand voice commands

Google roll out The Gemini AI assistant’s voice control feature in the Workspace family of apps (including Gmail, Keep, and Docs) eliminates the need for manual input.

Image source: blog.google

Gemini Audio models do more than just transcribe text; their job is to interpret the user’s intent and extract the necessary information from their voice commands. For example, the Gmail Live feature lets you ask an AI where to board a flight or what happened at your child’s school in the past week. The model independently finds the necessary information without requiring the user to point out the required letters.

The Docs Live feature lets you create new documents based on queries submitted by users in natural language. For example, it sends brainstorming materials to Gemini, and the AI ​​assistant organizes the ideas into a structured draft. Other sources of data may include other Workspace applications, including Google Drive, Gmail, and web search results. Keep Live works similarly – the user’s voice is converted into formatted notes, rather than being transcribed verbatim.

Paid Google AI Plus, Pro and Ultra subscribers now have priority access to Gmail Live and Keep Live; Docs Live is only available to Pro and Ultra members. “Whether you’re looking for something in your inbox, organizing ideas, or brainstorming ideas, new features in Gmail, Docs, and Keep let you do it all in a conversational way.”– Google explains.