I think it needs to a hardware filter, or physical filter as you said. As I said before, I just used the end of an exposed bit of film. Had to dig through the old photos seem evrything is digital these days.

And remember that this setup works best with infra red led's, not just red ones. Mice and remotes use the infra red spectrum.