I'm 'larger', and I exercise. I gotta think that using someone else's insulting attitude as a reason/excuse for NOT exercising would be nearly as lame as the insult, itself.

Last time someone made a comment about me in spandex, my riding budy said, "Watch it, kid - you're slow, he's not, and he's eaten sandwiches bigger than you."