I always wear regular shorts over my bike shorts when I wear them. I don't go on many rides long enough to bother with the bike shorts. I usually stop after work for an hour or so and just wear the same shorts I have on at work. I do change out into a wicking t-shirt though.
I want the pockets of the shorts. I carry my phone, my keys, my wallet, pack of gum, and such. I didn't realize how small the under saddle bag that I bought in medium size was going to be. I can't fit anything else in there with a spare tube and plastic tire levers, or at least anything else other than my keys stuffed in the very front at the zipper and hurry up an zipper it up before the keys fall out.