I usually have good results with 1% hydrocortisone cream right after a shower until the problem goes away.
And, might be obvious but I'll mention it anyway, make sure your shorts are clean. The only time I've gotten a rash around my bits was when I forgot to do laundry and put on a used pair. Also make sure that all soap is completely rinsed out.