I'd say it depends on how big you're geared on the fixed.

If you're geared for the flats and have to really push up the hills, you're going to be hurting when a 20mph wind rolls in.