Actually you put the vapor barrier layer on first, next to the skin.

Its the perspiration that would cool you , and so the idea is to not perspire [by not letting it escape]

and the vapor if not stopped, wets your insulation layers and so they lose effectiveness.