Definitely check the winter sub forum for ideas. I don't 'joy ride' in winter, but I do commute year round. Lots of good advice already given by seasoned winter cyclists and commuters.
It is important that you get it right when you head out the door. Overdressed and you're hit and miserable. Underdressed and your cold and even more miserable.
Legs, arms, and torso is not so difficult to do. So I'll tell what I do for head, hands, and feet.
Breathable balaclava that covers neck under helmet works good enough down to -15C. Below that you need an extra beanie for the head. Goggles that seal out the cold air will protect your eyes and peripheral eye area. That, in conjunction with your balaclava, will take care of your head and face.
When it gets down below -10C, you've got little choice but to go with mittens. The fingers help keep each other warm. The poor thumb is the odd digit out, and may require it's own heating pack. Below -15C, the fingers will require heating packs too. Your fingerless gloves are useless below 15C.
Feet and toes have always been an issue for me. Even with winter road shoes, they are still not happy. However, with the combination of heating packs, wool socks, insulated riding shoes, and neoprene covers, it is bearable down to -25C. Add or subtract a measure, depending on the temp.
As far as joyride are concerned, the joy part ends below about 12C, and then there are only commutes.