We've had the same thing in Tucson. I'm set up to be good into the low 50's, below that I'm just going to wait till it warms up, maybe head to the gym instead, or go on a hike.
Like the OP, no point in spending a lot on cold weather stuff when I spend the majority of my ride time trying not melt from the heat.
I was working in the snow on Wednesday