Hey Filippo, I was attempting to summarise DavidZhao’s response in the issue I linked, generate_reply times out on first dialogue with gemini-3.1-flash-live-preview — works fine with gemini-2.5-flash- · Issue #5260 · livekit/agents · GitHub (David is our CTO)
confirmed with gemini team that this is a temporary limitation with the model. they are working on improving the behavior on their side. in the next version we’ll raise an explicit error in
generate_replyto make the issue more clear
Since my last reply, the docs team have added an additional section to the Gemini Realtime docs with additional detail about the limitations and a migration guide: Gemini Live API plugin | LiveKit Documentation
I wanted to find something I could share with you to show progress for ‘they are working on…’ but I can’t find anything I’m afraid.
The model comparison at https://ai.google.dev/gemini-api/docs/live-api/capabilities#model-comparison shows what changed between the two to cause this.