I think (but maybe I'm wrong) that cxwrench may be referring to the fact that your top stem clamp is only half supported by the steerer tube/expander. Lowering the stem a few millimeters will give it full clamping support and less likelihood of the stem forming a crack at that spot over time. Maybe a little too cautious but could be a very expensive failure if not.