I don’t see why you would in hot weather. At least I never do. When it’s cold, a layer of merino wool under my long sleeve jersey is the best thing ever.