Let 'em dry inside out while you're at work. I think chafing is more likely to occur if your shorts are really damp when you put them back on -- something clammy rubbing against dry skin doesn't sound nice.

Otherwise, I don't think it's a big problem wearing the same shorts unless they are so hideously sweaty and gross. Then maybe carry with you a "going home pair".