Try loosening the stem and tighten the star nut just a little (1/4 turn at a time maybe), then retighten your stem and see if it still moves. Do this until it doesn't move back and forth anymore. Make sure not to make it too tight though or steering will become harder and feel notchy.