Hi Everyone, new to livekit. Is it possible to scale livekit server using ECS Fargate. Deploying livekit agent to ECS fargate works to some extent. Will it work for the livekit server. Working on a POC.
We do not recommend ECS Fargate since agents are long running processes and can take a long time to drain. ECS EC2 is much better suited for this sort of workload.
See:
When picking your instance type this can be helpful to keep in mind too:
I am working on a POC to demonstrate the feasibility or un-feasibility, so I have to experiment. Is it atleast possible for livekit server?
I suppose it is “possible” to run it in ECS Fargate. I’m not sure I would run production that way. Why would you not use kubernetes?
Yeah not fit for prod. I will just experiment it for the POC. And then propose to client for considering kubernetes. Point is my client wanted to use AWS Nova sonic for voice to voice, so I chose livekit because it’s integrating so nicely and latency really really good. But they want to do it in some kind of serverless way because of Infra costs. Most of the time the product will be idle because no users, but sometimes there will be peaks. So I am looking if I could do livekit in some serverless way or atleast semi-serverless may be. I need to reduce cost. Do you have any better suggestion for AWS nova sonic integration?
Thanks so much for your replies.
As I think you are already aware, voice AI is not generally like a web app. It is a stateful process.