In my office I'm the only woman who rides to work, so the guys respect my commuting even if they don't do it themselves. I've gotten some incredulous what-are-you-crazy? looks from some of the other women when I've ridden in the winter time, complete with the lip curled in scorn. I suppose they think I'm extremely eccentric, especially since I'm not really into fashion and hairdos and makeup at all. (After 52 summers on the planet, I'm done with that stuff.)
I'm inclined to agree with the posters who think a change of job is in order. I know it's not a great time to be looking for work, but it might not be a bad idea to start getting some resumes out.