Could it be that you were breathing in ultra cold air heavily through your mouth? That could possibly drop your core temperature and chill you quickly. Try using a facemask or balaclava to "rebreathe" (or pre-warm) incoming air and maybe that will reduce the core temperature loss.
.