Gemini 3.1 flash live

Getting Started
1

Will this work out of the box or need to wait for an update to livekit google plugin?

I also saw this comment on slack:
gemini 3.1 flash live is out and i tested, it really bad at vad and interruptions, maybe lk team can help here.

2

It should be working for you now.

3

Be sure to use Agents 1.5.1. There is another thread about a potential issue with generate_reply, Trying gemini 3.1 flash live and I can't seem to make it start talking? but other than that it should work well.

4

I just upgraded to 1.5.1, but it seems gemini 3.1 flash live is not in there. Has it actually been included in the upgrade?

1 Like
5

ETA on PR #5238? (Gemini 3.1 Flash Live generate_reply 1007 error)

Hey LiveKit team! :waving_hand: We are super excited to upgrade our language learning app to the new gemini-3.1-flash-live-preview model, but we are currently blocked by a WebSocket payload
incompatibility.

Right now, when our agent joins the room and tries to speak its initial greeting using session.generate_reply(), it triggers an immediate fatal WebSocket error:
1007 (invalid frame payload data) Request contains an invalid argument

I saw that PR #5238 (fix(google realtime): support gemini-3.1-flash-live-preview A2A model) perfectly addresses this by dropping send_client_content (the . hack) and routing text
through send_realtime_input(text=…) to satisfy the new A2A model restrictions.

However, because the currently published PyPI packages (livekit-plugins-google==1.4.5 / livekit-agents==1.5.1) still send the old payload formats, the agent just stares silently and
the connection drops. We had to roll our production app back to Gemini 2.5 Flash Native.

Question: Is there an ETA on when PR #5238 will be merged and published to PyPI as a new release? We’d love to test out the 3.1 improvements as soon as it drops! Thanks for all the
hard work on the Google integration. :rocket:

1 Like
6

Actually, this is probably a better PR to follow, it was raised internally: fix(google realtime): support gemini-3.1-flash-live-preview by Hormold · Pull Request #5251 · livekit/agents · GitHub

7

i worked on that , can you please review my pr that i raised to solve this issue , along with the support for update_chat_ctx and update_instructions also https://github.com/livekit/agents/pull/5262

8

Anyone else still struggling ?