Yes, you do need a windbreaker shell. Then your wool sweater can act as an isolating mid layer, on top of your base layer.

Sometimes, when I commute, I add a shirt with a thin wool sweater.

Remember not to wear too thick!