Have you tried putting a 2mm spacer above the stem to see if that helps things? What does the rest of the spacer stack look like?

I'm wondering if the top cap doesn't have enough space to properly snug things down, but it's really close until things settle.