I wear my regular bibs and jerseys for my 15 mile each way commute. I have a respectable hill to climb and with an hour each way in the saddle I'm much more comfortable in cycling togs. Plus I sweat buckets, so a change of clothes is mandatory.
As for attracting looks, there are enough cyclists in PDX that no one looks twice at a man in spandex (at least not portly dudes such as myself), and I'm just not cool enough to affect the anarchist chic of the messenger crowd.
I'm lucky enough to have a locker and a shower at work, so I keep shoes in the office and carry a change of clothes with me. Practice from motorcycle touring has taught me that by carefully rolling business casual clothes instead of folding them, wrinkles can be minimized.