Hi Darryn, you’re right it’s STS.
A few questions to make sure I understand what’s going on:
Doesn’t assigning STT in the AgentSession in addition to the realtime model add another hop and additional latency to each conversation turn? Does the realtime model ignore it entirely? Does it simply run in parallel with the realtime model and get used for transcription without blocking it?
Is the inputAudioTranscription I originally passed to the realtime model basically used for transcription separately from the realtime model itself? Is that equivalent to setting AgentSessionOptions.stt to gpt-4o-mini-transcribe?
Also, probably need to resolve this issue before I can give Hebrew STT a proper try: