I wear jeans, long johns, wool socks, mitts, a polartec fleece, one of those wind-proof hats, a bandana, and a windbreaker. It all worked just fine (I think my lowest temp this winter was -28 C or something like that). My ride is pretty short though...

With the exeption of the hat, none of my stuff is special or particularly expensive.