It's from the phrase 'handbags at dawn' describing the aftermath of a silly argument - the mental image of two people for a duel involving slapping each other with handbags. This is generally shortened to a sarcastic 'Wooooo, handbags...'
This is a phrase from the nation that brought the world Monty Python, remember