I'm having trouble believing that a stem would let the steerer slip through without falling out of alignment with the tire.

Go to a shop, man- you're missing something here, and it sounds like it could be dangerous.