I have never bothered to wear anything during the day in town other than my normal bike clothes unless maybe I was done riding for the day. I would just as soon be instantly recognized as a touring cyclist. I figure that most places they cut me more slack than they would if they saw me as a dirty stinky sweaty guy in basketball shorts. In the evening I slip into either running shorts, running shorts over tights, or zip off leg pants.