Sounds to me like extra socks, ski gloves, and a good meal are about all you really need. You could ask the person who you rode with what he wore.
Keep in mind that your body reacts differently to cold as the winter continues. Later on, the cold will not affect you so much. I think a 30 mile ride at 20 F is a very ambitious start to the season.
Paul
Paul