4 tires do this?

Are you tightening the presta valve "thing". Not the plastic cap, but the metal piece that stops it from being pushed?