I commuted to work by bicycle on Long Island for ten years. I wore cycling specific clothing the entire time. 40 miles minimum round trip. Longer when weather was nice.
I would change into dockers and a polo when I got to work and cycling clothes went into a gym bag or got hung up in a closet for the commute home. I never smelled and no one ever complained about body odor. The only time my cycling clothes smell really bad is when they were worn for a long time after riding.
What anyone thought about what I wore didn't concern me in the slightest although I did arrive late one day and the older ladies made it a point to express their approval of a fit man in cycling shorts walking through the office.
-Tim-