This actually means you're dressing just about right for your ride. I use 2-3 miles as my guideline, but every ride and every rider are different.
Sad to say that anything you do to make the first couple of miles more pleasant is likely to completely ruin the subsequent miles due to overheating and sweating through your clothes.
This works really well for me, especially in those first couple of miles before I'm warmed-up.
I refuse to be uncomfortable any more. I just don an extra layer for those first few miles then take it off when I warmed up. That may be all the motivation the OP needs. Being in a warm and toasty bed and knowing that the first 15 or so minutes of your ride you will be an icicle is going to suck the motivation out of anyone.
There is no law that says you have to wear the same outfit the entire ride. I ride at night and the afternoons a lot and I may be comfortable the first hour of a fall ride but get progressively colder as the ride goes on. I could start a ride at 2pm at 60 degrees in shorts, then end up riding at 5pm in triflex tights and a jacket in 45 degrees. That is why I bring my jacket and tights with me on my fall rides.