Today i removed the stem and came to find out that there's a huge gap between the carbon steerer tube and the top of the expander plug. I unscrewed it then screwed it back as per the spec (4Nm) but the gap is still the same. However, there's a 3mm gap when the stem is in place. Is there anything to worry about?
Please advise.

Thanks