when i lived in west texas that was a common occurrence... it sucks but it's not impossible. at worst you just have to get off your bike and walk. i've never been blown off my bike, but i've been stopped dead in my tracks.
it really depends on your bike setup. if you have a lower gearing, drops, and clipless pedals you can make due alright, especially if you aren't on super busy streets.