That's usually an issue with one of the following:
a) dust building up and being collected right in front of the optical sensors of the mouse ('cause often these are installed in little moulds which are perfectly suited as to substitute for "vacuum cleaners")
b) You have a non-optimal mouse-driver setup. Try to disable ALL "acceleration" options for the movement of the mouse. This has to be done in the windows-settings for each and every system-user sperately!!
After doing that,
I doubt you will have any greater issues other than the dust-problem. Have been using a rather old cable-mouse ( Logitech mouseman dual-optical) for years and actually without the mouse-steering facilitated in LFS I would never ever have gone down the road to buy myself a S2-license plus a wheel (or in fact, 3 wheels consequutively by now).
But of course, there is always the possibility of your mouse being plain rubbish or the underlying pad / or desk surface-material not matching the mouse's optical system so brillantly.