I think you're forgetting why blocking off wind and dead air space keeps you warm - it's not the ambient air temperature but the heat exchange from your body. You're welcome to remove the fan belt from your car's radiator if you don't believe me; after all that air isn't moving that fast and would only matter a few degrees, right?