Is the new stem any narrower than the old one? Can you see any exposed steerer tube?

There's a chance that the new stem is narrower than the old one, meaning that the top cap can't compress the headset down properly, hence the play.