Gloves were the first thing I got to address the cold. Also got a top base layer. The only things that really get me in the cold are my protruding ears and face.
Some weather is just too much of a hassle to ride in. I considered fenders briefly, but then I thought about shoe covers, water proof gear, etc. I ain't trying to prep that much.