Yeah, I feel your pain. I was cycling yesterday morning around 7AM with a low of 41 deg F. I had to stop in the middle of my ride and buy cheap gloves at a walgreens.
Luckily it quickly warmed up to the mid-60s so I wasn't in too much trouble. Kept riding, took off my jacket and rolled up my full-sleeve jersey sleeves.