I would call it quits for the day when you start to feel uncomfortable and not enjoying it anymore. I have ridden in very cold wind chills down to -15F but that high wind your talking about is almost too much. Also, something to remember is to allow more time in bad weather.