Well, a day or two off to play on a track seems like a reasonable use of time. If, say, you wanted to play on the Hethel track or Snetterton then I'm sure one of us East Anglian boys (Fordie, Danowat, myself etc) would gladly put you up for the night to save travelling. And I'm sure you'd find a lot of other welcome homes around the country, depending on when/where the trackday took place.
Or you could go home the same day.
Have you thought about using polystyrene to insulate Leo's "area", or your working room somehow. Ear Muffs? Can you program a noise-cancellation program to take Leo's noise, invert the waveform, and play it to cancel out Leo as much as possible? You could call it Live for Peace and Quiet