For mid-layer insulation, I like wool. It doesnt have to be expensive merino superfine sportwool. Any knitted woollen pullover will do. I like Alpaca because it is hollow fibre and works well when damp.
Sleeveless pullovers are good for fine-tuning your insulation.
As long as your inner and outer layers work, the midlayer material is less critical.