sounds to me like a problem of too much weight transfer for your driving style. during trail braking, the weight shifts to the front of the car, but the front tires are doing double duty, both braking and turning, so they can't turn in very hard. as soon as you lift off the brake, the front will have more turning grip available, and will turn in quite hard, causing the rear end to whip around. this can be very handy in some situations. for example, it can save you from plowing off the track when you brake too late.
as suggested, being a little smoother coming off the brake might help, but if you'd rather not change your driving style, try increasing the front bump and/or increasing the rear rebound. this should reduce the weight transfer to the front and give you more predictable steering. but don't use too much or you'll end up with understeer.