A weighted system would be better, votes count in descending order: more value to the vote of the leader, then all the others have decreasing value. A system to prevent restarts from people who just entered and think their time is much more valuable then the time of the people who started minutes before them would be appreciated, too.
But in the end I'll have to agree that most of these issues would be useless if people were just a bit more polite. Spending most of my time on demo servers I should say that this is nothing strange, but it happens that some member of some valued team, from time to time, only relies upon technical possibilities of the server: if you can do it, it's nice (or fair) to do it, so why not restart, even when it's unfair to people who are racing? If the vote goes well, it's democracy, man...
Democracy really sucks sometimes, especially when the minorities are not adequately protected.