Some people just have no manners.
It's a shame because the regulars I see on the server are all good company and I trust them to come and go as they please, I know they're not going to start moving blocks or rifling through my chests. I don't know how many others are on the white list who I haven't met though, so I don't know if I can trust them.
Sounds like the answer is no.