I stopped by work once on a day off, and got called into an emergency meeting. It was summer, I was wearing bike shorts and an alertshirt.
I wouldn't have any problem wearing bike kit around work, really. I'd rather not but I'm not riding an hour and a half home and back again. Actually I'd be more likely to ride 2 miles to a store and buy clothes, if it came down to it.
I also do not ever remove clothes from my stash until the replacement is already there.
__________________
Work: the 8 hours that separates bike rides.