When you are using follow camera, press Shift-O, and then click the 'View' tab, then change 'Fixed to forward axis' to 'no'