What you wear over your arms (and legs) is important, too, as that is where a lot of heat can be lost on its way to your extremities. When in doubt, wear an extra layer and vent as needed.