Not just ouch, but AAAAAHHHHHHHGGGGGGGGHHHH!

But seriously, one easy, non-messy thing you might try (once you clear up the current problem) is a little bit of Body Glide around the thigh band of your shorts (I assume you wear briefs, not cycling shorts). I use it to keep my wetsuit from chafing my shoulders and it works.