I don't mind the wind so much. It's the constant honking.
Story: last night, around 9pm, I was riding on El Camino (a busy thoroughfare and major bus route). Traffic was light because it was late, and the stoplights seemed longer than normal because the usual constant stream of cars wasn't there. At one point, when the last car had gone through an intersection I was stopped at, I realized it was completely and suddenly silent. It was surreal. You could have heard a cricket chirp if there had been one. The noise started back up after a few seconds as more cars approached, but it made me realize how much traffic noise we block out most of the time. I wish I had more opportunities to ride at night - it's a whole other world out there.