We upgraded to gemini-3.1-flash-live-preview with livekit-agents and livekit-plugins-google v1.5.1. Two main issues:
generate_reply() crashes with 1007 WebSocket error — Gemini 3.1 rejects send_client_content which the plugin uses internally. It should use send_realtime_input instead.
update_instructions() also fails with 1007 — same root cause.
Basically anything that uses send_client_content breaks on Gemini 3.1 since Google changed the API contract — only send_realtime_input works now (except for initial history seeding).
We see PRs #5233, #5251, #5262 addressing this — any ETA on a release that includes these fixes?
Hey Darryn, just a question, what do you mean by depends on changes to the model? Do we need to wait for google to release an update so it works on livekit? I just want to understand so I can see if we are going to deploy it to production soon or not.
confirmed with gemini team that this is a temporary limitation with the model. they are working on improving the behavior on their side. in the next version we’ll raise an explicit error in generate_reply to make the issue more clear
Since my last reply, the docs team have added an additional section to the Gemini Realtime docs with additional detail about the limitations and a migration guide: Gemini Live API plugin | LiveKit Documentation
I wanted to find something I could share with you to show progress for ‘they are working on…’ but I can’t find anything I’m afraid.
and looks to be the most active / likely to receive updates if things change.