I can make them join a multiplayer race but can't find how to make them leave without quitting the server, is there a command?

/spec AI 1

Cheers.

The spec command does take nicknames too, rather than just lfs-usernames. In case you're using custom nicknames for your AI drivers.