i have the same problem (but not the same amount) on my trek, i never really dug around in there to see what it was but one stem slams down and the other doesn't go as far.
as a result fit has never been 100% but its good enough. i dont intend on owning any more quill/threaded bikes in the future so im resigned to it just being whatever