Wind, especially if you're upright. Luckily, on my commute the average wind speed is only about 15mph in my face... Once in a while I get it at my back, and then it's flying home... But alas, usually the wind changes direction on during the day. ;p