there is not that small an increase.. Lower ID shoulders against top of fork steerer..
Then the quill stem goes inside, so whole length of the quill is effectively above the top of the fork steerer.
load in the panniers , not on the handlebars, right?
this isnt a threadless headset fork, right?
'/,