--- schema: 1 type: video title: >- Can Your Agent Hear You Now? Building Live Voice Agents with Gemini — Thor Schaeff description: >- An agent that hears you, sees you, and answers in your language, in real time. Here's how to build one with Gemini. Thor Schaeff, who works on developer experience at Google DeepMind, runs a set of live demos of Gemini's real-time and media models. He builds an illustrated story with Gemini Live and a fast Nano Banana image model, using the stateful Interactions API to keep characters and style consistent between images. He has the audience scan a QR code to hear the talk in their own language with Gemini 3.5 Live Translate, then calls up an AI radio DJ that uses Lyria 3 to generate a reggaeton track on request. He explains how the Live API works: a stateful WebSocket session that takes in text, audio and video and streams back audio plus a transcript, using a native audio model rather than a speech-to-text and text-to-speech pipeline. It supports 90 languages, interruptions, tool calls and Google Search grounding. He ends with a voice and vision demo in Google AI Studio. In this talk: • Chaining image generations with the stateful Interactions API • Near real-time speech translation with Gemini 3.5 Live Translate • A voice agent that calls tools, like Lyria 3 for music • How the Live API works: native audio, barge-in, tools and 90 languages SPEAKER Thor Schaeff, Developer Experience, Google DeepMind LinkedIn: https://www.linkedin.com/in/thorwebdev/ X: https://x.com/thorwebdev GitHub: https://github.com/thorwebdev LINKS Gemini Live API docs: https://ai.google.dev/gemini-api/docs/live Interactions API docs: https://ai.google.dev/gemini-api/docs/interactions-overview Gemini 3.5 Live Translate: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-live-3-5-translate/ Lyria 3 for developers: https://blog.google/innovation-and-ai/technology/developers-tools/lyria-3-developers/ Google AI Studio: https://aistudio.google.com CHAPTERS 0:00 Intro 0:56 Guess the model: Gemini TTS 2:01 Meet Thor 3:15 What shipped today 3:45 Demo: an illustrated story canvas 5:42 The Interactions API 7:07 Demo: Gemini Live Translate 10:21 Gemini 3.1 Flash Live 10:56 Demo: an AI radio DJ with Lyria 3 14:13 How the Live API works 15:07 Native audio, not a pipeline 16:06 Partners: LiveKit and Pipecat 16:31 Try it in AI Studio 17:55 Demo: voice, vision and Mandarin 19:42 Wrap-up Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building with AI. AI Engineer: https://ai.engineer YouTube: https://www.youtube.com/@aiDotEngineer X: https://x.com/aiDotEngineer LinkedIn: https://www.linkedin.com/company/aidotengineer/ #Gemini #VoiceAI #AIEngineer canonical: >- https://liquidgold.cc/channel/aidotengineer/explore/video/can-your-agent-hear-you-now-building-live-voice-age-458b3b3b1a31 markdown: >- https://liquidgold.cc/channel/aidotengineer/video/can-your-agent-hear-you-now-building-live-voice-age-458b3b3b1a31.md llms: null parent: 'https://liquidgold.cc/channel/aidotengineer.md' channel: aidotengineer updated: '2026-10-23T22:19:16.223Z' language: null children: [] videoId: xfPVBzDYjH4 durationSeconds: 1214 publishedAt: '2026-10-11T15:00:22.000Z' searchChunks: - ordinal: 0 text: null startSeconds: 77 endSeconds: 123 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=77' heldReason: rights - ordinal: 1 text: null startSeconds: 201 endSeconds: 211 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=201' heldReason: rights - ordinal: 2 text: null startSeconds: 244 endSeconds: 353 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=244' heldReason: rights - ordinal: 3 text: null startSeconds: 363 endSeconds: 435 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=363' heldReason: rights - ordinal: 4 text: null startSeconds: 445 endSeconds: 622 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=445' heldReason: rights - ordinal: 5 text: null startSeconds: 669 endSeconds: 860 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=669' heldReason: rights - ordinal: 6 text: null startSeconds: 860 endSeconds: 871 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=860' heldReason: rights - ordinal: 7 text: null startSeconds: 907 endSeconds: 918 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=907' heldReason: rights - ordinal: 8 text: null startSeconds: 918 endSeconds: 974 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=918' heldReason: rights - ordinal: 9 text: null startSeconds: 974 endSeconds: 985 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=974' heldReason: rights - ordinal: 10 text: null startSeconds: 1008 endSeconds: 1078 watch: 'https://liquidgold.cc/watch/xfPVBzDYjH4?t=1008' heldReason: rights --- # Can Your Agent Hear You Now? Building Live Voice Agents with Gemini — Thor Schaeff An agent that hears you, sees you, and answers in your language, in real time. Here's how to build one with Gemini. Thor Schaeff, who works on developer experience at Google DeepMind, runs a set of live demos of Gemini's real-time and media models. He builds an illustrated story with Gemini Live and a fast Nano Banana image model, using the stateful Interactions API to keep characters and style consistent between images. He has the audience scan a QR code to hear the talk in their own language with Gemini 3.5 Live Translate, then calls up an AI radio DJ that uses Lyria 3 to generate a reggaeton track on request. He explains how the Live API works: a stateful WebSocket session that takes in text, audio and video and streams back audio plus a transcript, using a native audio model rather than a speech-to-text and text-to-speech pipeline. It supports 90 languages, interruptions, tool calls and Google Search grounding. He ends with a voice and vision demo in Google AI Studio. In this talk: • Chaining image generations with the stateful Interactions API • Near real-time speech translation with Gemini 3.5 Live Translate • A voice agent that calls tools, like Lyria 3 for music • How the Live API works: native audio, barge-in, tools and 90 languages SPEAKER Thor Schaeff, Developer Experience, Google DeepMind LinkedIn: https://www.linkedin.com/in/thorwebdev/ X: https://x.com/thorwebdev GitHub: https://github.com/thorwebdev LINKS Gemini Live API docs: https://ai.google.dev/gemini-api/docs/live Interactions API docs: https://ai.google.dev/gemini-api/docs/interactions-overview Gemini 3.5 Live Translate: https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-live-3-5-translate/ Lyria 3 for developers: https://blog.google/innovation-and-ai/technology/developers-tools/lyria-3-developers/ Google AI Studio: https://aistudio.google.com CHAPTERS 0:00 Intro 0:56 Guess the model: Gemini TTS 2:01 Meet Thor 3:15 What shipped today 3:45 Demo: an illustrated story canvas 5:42 The Interactions API 7:07 Demo: Gemini Live Translate 10:21 Gemini 3.1 Flash Live 10:56 Demo: an AI radio DJ with Lyria 3 14:13 How the Live API works 15:07 Native audio, not a pipeline 16:06 Partners: LiveKit and Pipecat 16:31 Try it in AI Studio 17:55 Demo: voice, vision and Mandarin 19:42 Wrap-up Recorded at the AI Engineer World's Fair 2026 in San Francisco. Subscribe for more talks from the engineers building with AI. AI Engineer: https://ai.engineer YouTube: https://www.youtube.com/@aiDotEngineer X: https://x.com/aiDotEngineer LinkedIn: https://www.linkedin.com/company/aidotengineer/ #Gemini #VoiceAI #AIEngineer Canonical: https://liquidgold.cc/channel/aidotengineer/explore/video/can-your-agent-hear-you-now-building-live-voice-age-458b3b3b1a31 · Channel: [AI Engineer](https://liquidgold.cc/channel/aidotengineer.md) > Search chunk text is held until public-source provenance is verified. ## Document chunks > Missing: no stored document chunks are available.