Looks pretty good. Shouldn't be hard to sand a little more and get the angles to match.

Are you greasing everything when you put it back together? Check your headset and make sure it isn't torn up from the last go around.

As long as the stem is seated well inside the headset your should be OK. I think the only way to get what you had would be to insert it incorrectly from the get go.