Why TTS Models Now Look Like LLMs — Samuel Humeau, Mistral
Talk by Samuel Humeau (Mistral) on why modern text-to-speech models have converged on an LLM-style architecture: an autoregressive transformer generating audio tokens frame by frame. Covers neural audio codecs as a solution to audio's high information density (~200kbps vs. text bit rates), the codec-to-backbone-to-decoder pipeline, latency considerations for AI voice agents, and open problems such as streaming text input from an LLM in real time. Includes live demos of voice cloning from a few seconds of reference audio and a voice agent answering conference schedule questions, plus a Q&A on simultaneous text/audio generation, voice cloning availability, and speech interfaces.
# Video Identity Observation Document
## Video Overview
Conference talk by **Samuel Humeau**, introduced as an AI scientist at Mistral, on text-to-speech (TTS) architecture trends and Mistral's newly released open-source TTS model.
## Explicit Self-Description
- **Speaker affiliation and role**: > "I'm Sam... I work at Mistral as AI scientist. Before I was at Facebook fair when it was called Facebook."
- **Company self-description (Mistral)**: > "we are a frontier lab... founded uh a couple of years ago. Uh we produce frontier model uh but we're also a B2B business. We... help organization uh in their AI transformation... by providing them tools, product and uh dedicated people."
- **Product claim**: > "we released last week our first text-to-speech model and it's open source... It's an extremely strong text-to-speech model. We are very proud of it."
- **Presentation intent**: > "this talk is slightly academic and addressed to people who wants to know a bit more about how you uh do text to speech."
## Intended Audience
- **Technically oriented practitioners/researchers**: stated "slightly academic" framing; the content walks through codec design, token bitrates, autoregressive decoder backbones, and diffusion/flow-matching details.
- **Conference attendees in voice AI**: speaker references "as everybody in this conf will tell you the latency is key," and demos an agent answering questions about session titles — a talk given *at* the conference.
- **Potential users of the model**: repeated calls to action — > "check our uh open source model please uh read the the technical paper."
## Claimed Scope Demonstrated in Material
- **TTS/speech generation** as the core technical topic: history of TTS systems, audio tokenization, conditioning approaches, streaming patterns.
- **Product/engineering specifics disclosed**: 4-billion-parameter backbone; 80ms frames producing 37 tokens (~500 tokens/sec); 17ms latency to first audio on a single GPU; voice cloning from a few seconds of audio; diffusion/flow-matching frame generation differing from the "vanilla" pattern.
- **Open vs. proprietary boundaries explicitly drawn**: model weights are open, but > "we didn't release this part like the encoder part... it's a feature that we only serve in a proprietary fashion for now... we just didn't want to give everybody the ability to clone any voice."
## Observable Presentation Patterns
- **Hands-on demonstration style**: a "vibe coded" demo app, live voice-cloning examples (Paul, a French voice, the speaker's own voice), and a live agent Q&A.
- **Transparency about limitations and unknowns**: > "there is not a clear winner" for streaming-text input architectures; > "it's unclear which architecture is best at least to us."
- **Promotional framing interwoven with education**: open-source release announcements, technical-report references, and Mistral company positioning appear throughout alongside the academic content.
- **Humor/casual tone**: > "in my time of delusion and at the peak of my ego, I can discuss with myself"; > "we have a few years before the machines do all the science for us."
## Claim vs. Demonstration Distinction
- **Creator claims**: "extremely strong" model quality; "it works pretty well" on cloning — these are self-assessments, not independently verified in the material.
- **Demonstrated**: live playback of cloned voices (transcript records the demo audio), live agent latency behavior, and concrete architectural numbers stated by the speaker.
- **No curated metadata was supplied**, so all observations derive from title and transcript.
# Delivery Observations — Samuel Humeau, Mistral
## Verbal Fillers ("uh" / "um") as a pervasive feature
The single most observable delivery pattern is extremely frequent use of **"uh" and "um"**, often multiple times per sentence:
- > "So I'm I'm from ML AI uh and we are going to talk about uh speech generation and text to speech."
- > "Uh there is an occasion uh we released last week our first texttospech model"
This is stable throughout the talk, including in Q&A:
- > "Uh, there is a small asteris here."
## Self-corrections and restarts
The speaker frequently repeats or restarts words mid-sentence:
- > "So I'm I'm from ML AI"
- > "you you you start to um to voice them out"
- > "to to to beat that"
- > "I I I didn't say that our next step would be this"
## Conversational, casual register
- **Self-deprecating humor**: > "this app that I vip coded for the occasion"
- **Playful framing**: > "in my time of delusion and at the peak of my ego, I can discuss with myself"
- **Joking aside on AI**: > "we have a few years before the machines do all the science for us. So we might enjoy it."
## Recurring rhetorical phrases
- **"humanity is extremely good at modeling sequences of token"** — repeated nearly verbatim as a justification motif:
- > "because humanity is extremely good at modeling sequences of token."
- > "because humanity is very good at uh modeling sequences of token"
- **Recurring "I'm not going to dig too much"** as a scope-limiting phrase:
- > "I'm not uh going to dig too much uh on how we do train these codecs"
- > "I'm not going to dig too much on it, but just so you know"
- **Hedged generalizations with "typically" and "most people"**:
- > "what most people do then uh is uh having one step of the backbone per frame"
- > "Typically the first category will tend to provide all the context at the beginning"
## Teaching habits
- **Demo-driven explanation**: opens with a live app demo ("this app that I vip coded for the occasion"), live voice clones (Paul, a French voice, his own voice), and an interactive agent conversation.
- **Quantitative anchoring**: grounds abstract concepts in concrete numbers — 200 kilobits/sec MP3, "barely 15 bits per second" of speech information, "17 milliseconds" latency, "37 tokens" per frame, "500 tokens per second."
- **Signposting structure**: > "We're going to focus a bit on the right side today", > "I want to make a one degration" (digression), > "back to how we do it uh in general."
- **Interactive bit-rate aside to audience**: > "you you can try to uh to to to beat that" — a rare direct audience challenge.
## Time awareness
The speaker checks the clock and hands agency to the audience:
- > "How am I doing on time? That's there's two minutes remaining. Thank you."
- > "WE DO HAVE two minutes. Uh how you spend them is up to you."
## Q&A delivery style
- **Restates questions before answering** (audience-facing habit):
- > "so the question was like hey on the demo it looks like we are generating the text and the audio at the same time. Um, no."
- **Direct, unapologetic corrections**:
- > "No." / > "so so I I I didn't say that our next step would be this right"
- **Comfortable admitting uncertainty**:
- > "it's unclear which architecture is best at least to to us at least to me."
- **Willingness to demo on the spot**: answers a质疑 with a live "Hello Paul, it's me again" demo.
## Promotion of the released model
A recurring promotional thread, framed as encouragement rather than claims:
- > "I really encourage you to uh check it out. It's an extremely strong textto-spech model."
- > "check our uh open source model please uh read the the technical paper"
- Honest scoping when pressed: > "we we didn't release this part like the the encoder part."
## Uncertainty notes
- Transcript quality is uneven (e.g., "degration" for "digression", "interled" for "interleaved"), so word-level precision beyond quoted fragments is limited.
- Filler frequency appears genuinely high, but exact per-minute counts cannot be derived without timestamps beyond the bracketed ones.
- Whether the humor and hedging reflect personality traits is **not** assessed here; only observable delivery is reported.
# Observation Record: Why TTS Models Now Look Like LLMs — Samuel Humeau, Mistral
## Speaker
**Samuel Humeau** — AI scientist at Mistral; previously at Facebook FAIR.
## Context and Framing
- Mistral released its **first open-source text-to-speech model** "last week," which Humeau describes as "an extremely strong" model they are "very proud of."
- Purpose of talk: review recent trends in TTS architecture, noting a **dominant trend emerging** that "can change like, very quickly."
- Mistral described as a **frontier lab** and a **B2B business** helping organizations with AI transformation.
## Positions and Claims
### Use Cases and Latency
- The "king use case" for TTS is **interfacing with chat agents** — a pipeline of speech-to-text → central chat LLM → text-to-speech.
- **Latency is key** (attributed to consensus: "as everybody in this conf will tell you").
- Streaming audio packets as soon as they're available reduces **perceived latency**, even if full audio computation completes seconds later.
- The ultimate goal: **real-time streaming TTS** where the machine starts speaking with the first LLM token.
### Voice Cloning Demo
- The model clones a voice from **a few seconds** of audio; demos included cloning "Paul," a French voice (retaining a French accent in English), and Humeau's own voice.
- Claim: ease of impersonation will make **"vocal identity"** a mainstream branding concept, analogous to visual brand identity for websites.
### Architectural Trend Claims
- Audio generation historically evolved: **word stitching** (e.g., SNCF), **sample-by-sample generation**, then **whole-audio generation**.
- Most labs have **converged on LLM-inspired patterns**: treat TTS as a **language modeling problem** using an **autoregressive decoder backbone**, generating patches of audio sequentially — because "humanity is extremely good at modeling sequences of token."
- **Codec bottleneck**: audio needs compression to token sequences; contrast with text captioning (~15 bits/sec of semantic info, measured on himself) vs. MP3 at ~200 kbit/s. Codecs typically reduce audio to a few thousand bits/sec.
- Mistral's specifics: 80 ms frames (12/sec), **37 tokens per frame**, ~500 tokens/sec; backbone is a **4-billion-parameter** transformer; codecs trained with **reconstruction + adversarial losses**, some tokens constrained to carry text information.
- Common pattern: one backbone step per frame with a **smaller model** (typically a "dev transformer") computing all tokens of a frame.
### Explicit Deviation from the Dominant Pattern
- Mistral's released model **does not follow** the small-model-per-frame pattern; it generates all 37 tokens of a frame at once with a **diffusion model** (a "pretty cool use case of flow matching").
### Conditioning
- Two categories of conditioning across labs: those conditioning on **complete text upfront** vs. **streaming text input** with incremental context. Mistral's model is the first category: context = a few seconds of cloned voice + text.
- **Latency claim**: 17 ms from text input to first playable audio (single GPU, no network).
### Open Questions Acknowledged
- For **real-time text streaming input**, "there is not a clear winner": interleaved audio/text vs. **dual-stream architectures**; naive independent generation has continuity problems.
## Q&A Positions
- **Clarification**: the voice agent demo does not generate text and audio simultaneously — text is produced in one go by a fast small LLM, then audio.
- **Openness qualification**: model weights are open, but the **voice-cloning encoder is not released** — served only "in a proprietary fashion"; rationale: "we just didn't want to give everybody the ability to clone any voice." Open voices are provided.
- On speech-interfaced architectures: consumers perceive a single system; speech as a universal interface to capable LLM agents "can go very far."
- **Correction of audience inference**: he did not commit to a next-step architecture for streaming text input — "it's unclear which architecture is best at least to us, at least to me." Benefit of streaming: lower latency (start voicing before text generation completes).
## Preserved Qualifications / Tensions
- Trend dominance is provisional: "this can change like, very quickly."
- Mistral's model deviates from the "main pattern" it describes.
- Architectural choice for streamed conditioning is explicitly **unresolved** for the speaker.
# Speaker Attribution Record — Video 01a15ca9-74bf-79b5-b3e5-0084f8590800
## Video
**Title:** Why TTS Models Now Look Like LLMs — Samuel Humeau, Mistral
## Speakers & Roles
- **Samuel Humeau ("Sam")** — **Primary speaker / presenter**
- Self-identified: "I'm Sam. I work at Mistral as AI scientist. Before I was at Facebook FAIR when it was called Facebook."
- Delivers the full talk on text-to-speech architecture and demonstrates the TTS model.
- **Audience / Q&A participants** — **Unidentified questioners**
- Ask questions in the post-talk Q&A (voice cloning availability, single vs. dual architecture, real-time streaming text input).
- Identities not stated in transcript or metadata.
- **"Paul"** — **Demo voice (synthesized), not a human participant**
- Human recordings of Paul's voice played during the demo, plus TTS-cloned outputs generated live.
- Also a French female voice and the speaker's own cloned voice used in demos.
## Referenced Sources & Claims
- **Mistral's first TTS model** — released "last week," described as open source, "extremely strong." Promotional framing by presenter.
- **Mistral technical report** — referenced as containing model details; presenter encourages reading it.
- **Mistral company background** — presenter describes it as a "frontier lab" and B2B business.
- **Prior affiliation:** Facebook FAIR (self-stated).
- **Third-party references:** SNCF (French train system) mentioned as historical TTS example.
- **Demo app** — presenter states he "vibe coded" it for the occasion.
- **Technical claims by presenter (not independently verified):** 17 ms latency to first audio on single GPU; 4B-parameter backbone; 37 tokens per 80 ms frame; ~500 tokens/sec; diffusion/flow-matching for frame generation; ~15 bits/sec human speech information rate.
## Promotional Segments — Flagged
- Repeated encouragement to "check out" / download the **open source TTS model** and read the **technical report** ("check our open source model please, read the technical paper").
- Extended demo showcasing voice cloning, multilingual cloning, and the voice agent — product-forward presentation.
- Note: The **voice cloning encoder was NOT released**; presenter states it is served only "in a proprietary fashion," with open voices provided instead.
## Availability & Limitations
- **Comments availability:** Not stated in transcript; no curated metadata supplied.
- **Provenance gaps:** Q&A questioners unidentified; exact session/conference name not stated (session titles by Andres Marafiot and Herve Breden are read aloud in demo but the event itself is unnamed).
So I'm I'm from ML AI uh and we are going to talk about uh speech generation and text to speech. Uh there is an occasion uh we released last week our
first texttospech model and it's open source so I really encourage you to uh check it out. It's an extremely strong textto-spech model. We are very proud of it. Um, and for this occasion, uh, I thought we could review some of the recent trend in text to speed architecture since there is a dominant uh, trend uh, emerging these days although this can change like uh, very quickly. Um and uh so this talk is slightly academic and addressed to people who wants to know a bit more about how you uh do text to speech. Uh this being said, we have a few years before the machines do all the science for us. So we might enjoy it. Uh today um I'm Sam. Uh yeah, I work at Mistral as AI scientist. Before I was at Facebook fair when it was called Facebook. Uh and Mistral a few words about the company. It we are a frontier lab. We have we've been founded uh a couple of years ago. Uh we produce frontier model uh but we're also a B2B business. We we help organization uh in their AI transformation which is kind of a buzz word but literally every company is transforming with AI. We help them by providing them tools, product and uh dedicated people to help them in their custom needs. Um back to the text to speech. So there are a few offline use case of uh speech generation like the the famous listen to the blog or listen to the article. But nowadays the the king use case for text to speech is uh its usage within agents
and in particular it's used to interface uh with a chat agent. typically in a pipe like this uh where you have a central chat agent that does text to
text but does it extremely well and you want to talk to it so you add a speech to text and you want it to speak to you so you add a text to speech u as everybody in this conf will tell you the latency is key here uh so you can reduce the latency on the left by having the speech to text done in real time so that when you detect the end of turn you already have the transcript it's already done. Uh, and we're going to focus a bit on the right side today. Uh, it's also very important that as soon as you have the first audio packets, you you you start to um to voice them out. This way, the perceived latency is lower. In fact, since your LLM can stream uh some text to you, uh actually what you ultimately want is something like this. If you're going to interface a chat assistant uh which is a real time text input text to speech where uh as soon as you have the first token of the LLM uh the the machine starts to speak. We're going to talk uh about it in the in the end of the talk. I want to focus a bit uh at the beginning at the output side uh and what it what it means to stream audio. So to illustrate this, I have uh
this app that I vip coded for the occasion. Um and so we're we're going to uh to use this texttospech model that we
released that I mentioned and we are going to hear Paul. So Paul is an actual human being that sounds like this. \>\> The persistent anxiety that fills the rest of my life is calmed for as long as I have the flavor of something good in my mouth. Um, so this is uh like some actual recording on some uh actual person named Paul and we're copying his voice. Uh, \>\> so with the sunshine and the great bursts of leaves growing on the trees just as things grow in fast movies, I had that familiar conviction that life was beginning over again with the summer. \>\> Um, so let's focus first on what's happening here. Uh as you can see with the copying the voice and the the first audio pocket \>\> happens first and we can start to emit audio which greatly reduce the perceive latency even though the full computation of the the audio happens a few seconds later. So in if you use it in an agent. So here I crafted a small agent using a speechtoext uh one of our uh LLM and uh this very text to speech so we we can speak to Paul um and hey Paul uh can you tell me what's the title of the session at 12:20 please? The session at 12:20 p.m. is titled Reichi Mini, Giving a Body to AI by Andres Marafiot. \>\> And what was the session at 11:15, please? \>\> The session at 11:15 a.m. is Beyond Transcription: Building Voice AI that actually understands conversations by Herve Breden. \>\> Did you enjoy it as much as I did? Thanks. \>\> I don't have personal experiences or emotions, but I'm glad you enjoyed it. \>\> That's all I can do. Um, so the important thing here is that since the audio packet arrives first, you still have a a decent latency and you can enjoy the conversation with the agent uh despite the fact that the audio is still uh not generated fully. And so we're going to dig Oh yeah, sorry. Uh I want to make a one degration. So I mentioned the the voice cloning here. Uh this
model can like only need a few second to clone the voice of someone. Uh so again this is how sounded and this is how we
generate text. \>\> So with the sunshine and the great bursts of leaves growing on each \>\> it really sounds alike. It's also very good at inferring how a person would speak in in another language. So for example, this is a voice, a French voice maybe \>\> and if we generate \>\> and so with the sunshine and the great burst of leaves growing on the trees just as things grow in fast movie. \>\> Yeah. So we can clearly recognize her and we can clearly recognize a very strong French accent which as a French myself I do enjoy. Um, I can I can even clone my own voice. So, this is how I sounded during the recording. \>\> Hi, this is Sam. \>\> And uh this is how I \>\> and so with the sunshine and the great burst of leaves growing on the trees, \>\> it works pretty well. So, this way in my time of delusion and at the peak of my ego, I can discuss with myself uh on on a complicated problem, which is nice. Um and so it's becoming so easy to uh impersonate a voice that it's it's becoming very easy to to configure. Um so it's a small degression but currently actually a lot of large company they do have a concept of vocal identity and they do care in their branding about how they sound uh in their advertisement in particular. But I think this uh concept will becoming more mainstream and just as like a lot of company uh define how their website appear as their brand identity, it would be the same for the voice identity. Um oops sorry uh back to how we do it uh in general. So uh all right this is this is an audio
uh physically it's the pressure of the microphone that we measure from time to time like uh several thousand of times per second. So it looks like this. And historically to generate the audio uh
there have been a lot of uh attempts a lot of systems like in the prehistoric time you have like stitching of uh words that were spoken like uh in the French train system SNF for for those who knows. Um and then a new generation arrived. Uh at some point the trend was to generate each sample one after the other. Then another era was generating the whole audio at once. But as we can as we saw it, it's very interesting to have the beginning of the audio generated first so that we can start to play it out. So it seems that most labs have converged to some common patterns and obviously the the first one is inspired by large language model. We're trying to uh transform the problem as a
language modeling problem because humanity is extremely good at modeling sequences of token. So pretty much uh everybody is using an auto reggressive
decoder backbone and uh generate audio one piece after the other. Now um as I said we really don't want to generate one sample after the other. So what we want to do is generate like patches of audio one after the other. Um, so the expected system looks like this where you you have an encoder that transform like a frame of audio something like 80 millisecond into something that ideally is a token because humanity is very good at uh modeling sequences of token and then you have a decoder that does the opposite. Uh now for text it's pretty easy because transforming the text into tokens well it's easy right? you can take like words as token and it it works pretty well even though we we do much better. Um, for audio it's much harder because one token doesn't have a lot of information. Like one token of a vocabulary of a
thousand, it's 10 bits of information and the audio requires much much more uh like a much larger bit rates. For example, a standard quality MP3 that's 200 kilobits per second.
And so in order to transform this into a sequence of token like and not have thousands and thousands of tokens, uh we need to somehow compress it and reduce the size of it. Maybe drop what's not needed. Uh an interesting point of comparison is tech text captioning. Uh because if you drop all the acoustic information and you you just focus on the text like with a subtitle track, uh you actually drop most of the information. It's a massive reduction and and you only have uh a few bits per second uh remaining. So here in
this in in this demo I use uh our realtime speech text to measure my bit rate in terms of uh tokens per second of text and um I'm a very competitive
person and very I'm very good at speaking. Uh yet I I'm barely 15 bits per second of uh actual information. you you can try to uh to to to beat that, but like in the grand scheme of things compared to 200,000 uh bits of information per second, that's not a lot. Uh obviously uh we want to use something that allows to recover like acoustic uh features like the voice and uh and other aspects and not just the the semantic information as in the text. So the codec that are used uh typically reduce the audio to about a few thousand bits uh per second.
Um in our case for instance uh we treat the problem with uh sorry we cut the audio as uh with pieces of 80 milliseconds so 12 frame per second and
we transform each frame into several tokens like 37 in our case. So we reduce the problem to about 500 tokens per second. I'm not uh going to dig too much uh on how we do train these codecs but obviously first we train them uh we train them by reconstructing a very large set of audio and using a bottleneck here uh the the training procedure constrained uh the reconstruction to go through a step where each frame is u decomposed into several tokens. uh to do this typically it's guided so that the model drops the information that is useless and only retain the one that is uh useful and so we guided via some losses uh reconstruction losses uh adversarial losses and uh particularly like for for the for some of the tokens we try to make sure that they contains the text information so you can reconstruct the text from it.
Still 500 tokens per second is a lot of tokens. Uh and you you could put them one by one aligned as a sequence like this. Uh but it would make a lot of step
of the main transformer that is uh at the core of the system which is you it's huge. Um in our case it's 4 billion parameter sorry which is which is still a lot even though it's not like extremely big now. Um what most people do then uh is uh have having one step of the backbone per frame and a smaller model here uh typically a dev transformer that um recomputes all the the tokens of one frame. uh at at each step. So this way you still have a lot of tokens, you still carry a lot of information but the computation is much faster. So this is the the main uh pattern that we see. Uh even though for that last bit like the model we release does not follow this pattern, we actually uh defer on that part. I'm not going to dig too much on it, but just so you know, each frame which is represented by 37 tokens in our case, we do generate these 37 tokens at once using a diffusion model. So it's slightly different from the the vanilla text to speech nowadays. I encourage you by the way to read our technical report which contains all this information. Uh also it's a pretty cool uh use case of flow matching uh models which is similar to diffusion model. Uh now the the main part is conditioning actually uh because so far we're just generating audio but we are not conditioning it on text. So it's not really a text to speech it's just speech
um and to conditioning there for conditioning there is way more variance across labs and papers and implementations. Um you have typically two categories. uh
there are the the people who focus on uh producing the audio once you have the the text and some of who focus on having a stream of text. Typically the first category will tend to provide all the context at the beginning and then produce the audio as we saw. Um and typically the second category will also add some context as the audio is is produced. uh the model we release is in the first category. So what we do is we provide the audio of the voice we want to clone. So a few seconds then the text to pronounce uh and that's our context in our case. Um yeah, regarding the latency, so it it's pretty fast. Uh if you remove the network and with a single GPU, you have 17 milliseconds between the moment where
you input your text and the moment where you have the first audio you can play. Uh regarding realtime text input stream, uh which uh is our next step for us. uh
there is no uh real there is no clear there is not a clear winner first uh it's still possible you know like to to generate independently the text and and
stitch them out but obviously you will have a lot of continuity problem um and there are several patterns the two main ones are people who interle audio and text so as soon as there is a new text they they put the text in the same uh layer uh and some other who have a dual stream architecture where you have a stream of audio and a stream of text uh and you kind of blend them together during the um the inference. Um how am I doing on time? That's there's two minutes remaining. Thank you. Uh the takeaway is uh check our uh open source model please uh read the the technical paper and I hope you learned a few things today. WE DO HAVE two minutes. Uh how you spend them is up to you. Yeah.
\>\> Um you said that your model first takes hold of the text and then produce the audio. But on the example that you showed of the voice agent, it seemed like it was generating the text and the audio at the same time.
\>\> No. Um so the question was like hey on the demo it looks like we are generating the text and the audio at the same time. Um, no. For the for the voice agent. Hello Paul, it's me again. Can you say anything like I don't know a poem? \>\> I'm afraid I can't recite poems. \>\> It's just so the text is produced in one go. It's just that I'm using a small LLM that is very fast. So it it's nearly immediate and then the audio is uh is produced later. \>\> Yeah. Yeah, \>\> thanks for model by the way. I know that the weights are open. Is the voice cloning also open?
\>\> Yeah, there is a small asteris here. Um, we we didn't release this part like the the encoder part. Uh,
which means it's the only thing that is missing for you to clone your own voice. uh it's a feature that we only serve like uh in a proprietary fashion for now. So what you can do is use the texttospech model, use one of the open voices that we provide. Um we may provide more uh in in the future. Uh yeah, so far we just didn't want to give everybody the ability to clone any voice. \>\> Yeah.
architecture like what's your take on \>\> what's my take um so on the consumer
side you will always have the impression to speak to a single system that hear what you say and output something right so it's purely an architectural uh model here. Um my take on this is that we can go very very far by just using speech as an interface. Uh especially because these central LLM they are extremely capable but they also do a lot of things. Uh so just for the sake of being able to use any agent that has been released uh with the same interface it has an advantage uh you know to uh to interface. So you can you can go very far with just interface especially if you are uh doing this kind of thing where you stream the uh the text token that's are output by the LLM. \>\> Yeah. Last question because I'm out of time. Sorry.
\>\> Yeah. So the next steps on the inter function which accepts both audio and text sounds that real time what do you see is the
possibilities with that feature. \>\> Um no so so I I I didn't say that our next step would be this right I I just said that there are several patterns to handle a stream of text as input as opposed to like a finite amount of text. uh we actually don't know which one we'll we'll choose. So whether it's interled or another solution like uh delayed uh sequence modeling for instance so it's unclear which architecture is best at least to to us at least to me. Uh what it what it allows is lower latency because as soon as you have the first bit of text that are produced by the LLM you can start voicing them out. So you you it in this agent that was not clear because the the utterance were very short. But imagine I ask Paul to generate a full page of text. Um it it would be nice if I don't have to wait the end of the text generation to voice it out. \>\> So it also kind of \>\> Yeah, absolutely. Yeah. \>\> Thank you.
