I am trying to connect a WHIP ingress to Gemini. Following this: Gemini Realtime Agent with Live Vision | LiveKit Documentation My video source is RTSP that streams H264. I couldn’t connect H264 to the Gemini. I had to transcode the video locally to VP8 before sending it to the ingress. Is there a…

Hi, I believe this is addressed by this line in the docs: Transcoding configuration | LiveKit Documentation The Ingress service can transcode the media being received. This is the only supported behavior for RTMP and URL inputs. WHIP ingresses are not transcoded by default, but transcoding can be …

But this is about transcoding which I actually tried with below ingress.json. But why do I even need to transcode? { "input_type": 1, "name": "gst-whip-test", "room_name": "test-room", "participant_identity": "camera-1", "participant_name": "Camera 1", …

Gemini Live vision itself is not limited to a specific WebRTC codec like H264 or VP8. It receives video frames from the LiveKit room when video_input is enabled, as described in the Vision guide . The issue you’re hitting is with WHIP ingress behavior. By default, WHIP forwards media unmodified, so …

Correct. The codec mime type is video/h264. I can verify this by a participant that processes the stream. My gstream pipeline is this gst-launch-1.0 \ rtspsrc location="rtsp://root:pass@192.168.103.139/axis-media/media.amp?audio=0&resolution=1280x720" protocols=tcp latency=200 name=src \ sr…

I am not sure what the exact issue is here. But the way I usually go about debugging issues like this one is to remove agent from the equation and I just join the room manually so I can see exactly what the agent would see or hear. Thing usually get pretty clear from that point. Once you have clien…

Thanks for the tip. I can join a room (js based application) and see myself as well as the ingress. I can have a egress client joining the room and capturing everyone’s media. The room logs are like this: Subscribing to participant camera-1 trackPublished from camera-1 { "trackSid": "TR_VCkKL8uV…

Can you check my logs please? INFO:gemini-live-vision:connected to room: test-room INFO:gemini-live-vision:existing_participant publication: participant=camera-1 sid=TR_VCxkRs2q7qC4hc name=synthesized-camera kind=KIND_VIDEO source=SOURCE_CAMERA mime=video/H264 size=1280x720 subscribed=False muted=…

I have created this. If my gstreamer transcodes H264 to VP8, I see starting video frame monitor, first video frame received and video frames received. If the gstreamer streams H264 I only see starting video frame monitor and nothing else. Seems like a bug in between my application and Gemini. …

Hi again, can you guys please confirm if the issue has been reported to the right repository please?

Does Gemini Vision work with H264?

Agents

Lindskog_Work (Lindskog Work) March 27, 2026, 8:19am 10

I opened this - H264-specific issue when subscribing to a WHIP ingress video track from Python. · Issue #592 · livekit/python-sdks · GitHub Hope it is the right repository.

Topic		Replies	Views
Gemini 3.1 flash live Getting Started	9	444	April 8, 2026
GPT‑Realtime‑2 support Agents realtime , openai	1	77	May 7, 2026
Livekit gemini Plugin , Gemini 3.1 flash live preview is not supported on 1.5.2 Agents agent-development , python , plugin , google	1	56	April 13, 2026
Gemini 3.1 Flash Live not working with LiveKit Agents 1.5.1 Getting Started	3	146	April 8, 2026
Livekit realtime using gemini-live-2.5-flash-native-audio Getting Started	1	33	April 27, 2026

Does Gemini Vision work with H264?

Related topics