I haven't had much success trying to find clothing that would be comfortable during both riding and extended stops in winter. It's the same as with any winter exercise, you should feel a bit chilly at first until you warm up. If you're warm to begin with, you'll be uncomfortably warm soon.
I too wear a wool base layer and very breathable but windproof shell. I wear essentially same kind of clothing when xc skiing. For longer breaks I have a warm fleece jacket in pannier or backpack.
--J