VR user (Oculus DK2) here. Not being able to see your keyboard with the headset on is a bit inconvenient. When restarting / pitting / spectating you have to find your keyboard blind and guess where the keys are, or remove the headset itself.
However, during racing a VR headset is way beter in terms of immersion and the ability to look around to see where the other cars are. It really doesn't compare to Track IR, so in my opinion the trade-off is more than worth it.