I have three balaclavas of different weights for different temps. If it's really cold, I add a turtle fur head band. I tried a Gore headband to cover my ears (about $30...), and it reduced my hearing so much that I only used it twice.

Keep your core protected, and your extremities will stay warmer.

I always wear a cycling cap.