I know the feeling. I had one of those days last week. Temps were in the mid 40s, overcast and blustery. I managed to ride 24 miles out and back. Luckily I had some wind breaks at the beginning and the end. The middle part was a bear.....it beat the crap out of me. I was exhausted afterwards. I was dressed warm enough except for my feet. I wore my regular socks and couldn't feel my toes when I was done. I didn't think it was cold enough for the wool socks. I didn't factor in the wind chill and lack of sun.
Seems like it's been windy in the DC area all year. I've pretty much gotten used to it, but that ride last week was a tough one.