LiveKit Inference timeouts happening since past 2 weeks

[darryncampbell (Darryn)]

Thanks, I see this thread got flagged internally so @Neil_Dwyer may have additional feedback.

@Kaushal_Shah

To add on, it happens with recent released gemma4 model too, so i doubt its something with livekit inference, region we used was eu-central

I should have picked up on this with my earlier answer, but since we only serve the gemma model from from US, I’m sure that will be a factor in the latency (and explain why your dashboard doesn’t match the numbers I’m seeing internally). Please see the thread below that clarifies our plans to bring the model to the EU soon:

Is Gemma 4 31B on LiveKit Inference available in EU?

Love the new LLM inference offering and we can’t wait to move our workloads to it. We have Livekit Cloud agents deployed in both EU and US; can you confirm whether this managed LLM inference is available in both locations? If so do we need to specify which region we’re targeting or is it auto-routing?