Sometime's it the conditions and circumstances you ride in which dictate what *you* will feel comfortable enough to wear.
For example, I couldn't care less and would welcome cycling shorts if I took place in a bike ride or race or even touring; but because of the conditions of my work, and the support I've received from my company, I wouldn't deem it appropriate to walk into (and through) the office with spandex shorts. It's not the co-workers that would be my deterrent, but the clients that seldom wait in a sitting area for meetings; which unfortunately I have to cross to reach my dressing room. I've gotten away with shorts and gym pants with t-shirts, but spandex won't cut it, especially with the clients which are usually high-profile people who don't understand the benefits of cycling to work.
For me, the best solution is and will probably always be cycling underwear with a nice assortment of shorts.