I was the same way, but then got some lycra stuff and was like OMG it's so much better! Especially in the summer months. Nobody can really tell anything on your shorts if you wear solid black ones.

Sometimes for shorter rides I'll wear lycra boxer briefs and slim-fit cargo shorts. But for commuting 31 miles round trip it's almost always bike shorts, and high-vis jerseys.