I have never understood the need for vests, dont your arms and hands get cold when you dont have sleeves?

My torso produces enough of its own heat, if anything I think I would want to wear sleeves and nothing else. Can someone please enlighten me as to why vests etc are so popular.