It happens. this fall i've ridden in 30 mph sustained winds gusting up to 50/60 mph. the worst is when the rain is heavy and blowing at you hard, it hurts the face. the fall, winter and spring generally brings those winds. you can look at it as the glass half full in that anything you sweat you will have a nice breeze to cool you down.

it's a matter of riding and getting used to it. i agree with others that gusts are worse than sustained winds as they can make handling harder (or more stressful).