Alpaca wool is one of the original hollow-fibre materials. It will retain insulateing properties when wet.
My mid-layer insulation is usually a woolen jumper.