Does TTS/STT latency include round-trip to external providers?

Agents
1

This question originally came up in our Slack community and the thread has been consolidated here for long-term reference.

Is LiveKit’s TTS/STT inference present locally at every deployed location?

If I use plugins like Google or Azure, does the TTFT/TTFB include the round-trip time between LiveKit Cloud’s location and Google/Azure’s location?

2

Yes, when using external provider plugins (Google, Azure, etc.), the TTFT/TTFB includes the round-trip time between your agent’s location and the provider’s location.

For self-hosted agents, latency is measured from your deployment location to the provider.