Agent stuck - Speech not triggering any traces for user turn

Hello,

We are seeing some issues with some users in production. Sometimes, the agent stops recognizing anything the users say, and they get stuck. This becomes frustrating as they need to repeat themselves a few times and nothing happens, until they need to close the session.

This has happened to us when testing a few times, but there is no clear path to reproducing it.

Here is an example of a session (RM_7h59svG9ZuA6) where this happened:

We use Deepgram as STT, but I cannot see any error logs on their end indicating any issue.

Same for our logs monitoring system, nothing weird being logged, the user at some point disconnects annoyed that it does not work for them.

We use Android and iOS Livekit native clients.

Any ideas of what might be going wrong?

Thanks.

1 Like

How have you configured turn detection? With Deepgram flux supports turn detection, Deepgram STT | LiveKit Documentation , or you can use our default turn detection model, Turns overview | LiveKit Documentation. To me, this looks agent-side rather than client-side since you can see user audio

FWIW we have started seeing this same behavior this morning; had not seen it up to this point. Not sure if there’s an underlying issue in Deepgram or the Livekit cloud.

1 Like

We use the STT turn detection:

turn_detection="stt"

We had a couple of reports around the same time @Reveri but we couldn’t find a root cause - the suspicion was some kind of temporary unreported downtime with Deepgram as that is the common thread but nothing was reported on their status page.