This question originally came up in our Slack community and the thread has been consolidated here for long-term reference.
How do I delete/remove an agent from a room?
You can use the Server API to remove a participant (including the agent), or delete the entire room to remove everyone.
See: