You can wear arm and leg warmers, though those are mostly for the racer type who doesn't want the extra grams. They're kind of a pain in my opinion (though to be fair they're small to store if you don't usually need them).

At those temps, I'd say a wind resistant jacket (and pants if possible, or tights). You don't need to go into "windproof" or you'll overheat.

There are a whole bunch of options, unfortunately I don't have the time to look them up right now. This is one from a guy who makes custom stuff (Lou At Foxwear), his E-Vap Light:
Jackets - Foxwear

Or here's another off-the-shelf one, Bontrager Race Windshell Jacket:
Bontrager Race Windshell Jacket - Freewheel Bike Shop - Minneapolis - Twin Cities - St. Paul

At those temps you usually want something wind resistant, not wind "proof" (because wind resistant lets out water vapor better and it's more comfortable).

If you want to go all out for comfort, you could wear a smartwool layer under it. But you'd probably be fine just wearing whatever you wear in slightly warmer temps, under the jacket, as well.