Does anyone else find that cooler temperatures tend to discourage you from riding?

I have arthritis in my hands and shoulders and it only takes a very few minutes (below 65 degrees) before I have to get off the bike and get inside. This is even wearing a couple of warm layers.

I'm going to keep on riding whenever the temperature is above 65 and it's not pouring rain, but I suspect my major rides will be after the first of the year and probably closer to March.