In my opinion reality is simulated well as it is now (you have to press a look button). If you look into your far side mirror irl, you have to move your eyes and are not able to focus what happens on the track ahead even though you see something there from the corner of your eye.