The stem of my Specialized Tricross had a shim to fine tune the angle down to a couple of degrees. But, it threw everything out of kilter, so the whole stem went away.

Perhaps one of your spacers is angled to match a similar shim.

Nonetheless, as others have mentioned, you need to figure out what happened.