I hate high winds. A 50 mph tail wind is fun, a 50 mph headwind is painful and a 50 mph crosswind is potentially deadly.
That said, I don't decide based on wind alone. Rain + Wind = no ride. That's just miserable. (If we had snow here I'd add that too.)