I wear my work clothes, but with a wool t-shirt underneath (in the winter, wool long johns too). I work in a laboratory, some suits but mostly casual.
17 miles from work, bike every day. Yes I am damp with sweat when I get to work sometimes, especially in the summer. But it's WORK, not a dinner party.