I have around 1" variation in saddle/bar drop between some of my bikes. I really don't notice it that much.
Just because the drop changes it doesn't mean your torso angle does. That can stay the same and the variation taken up by the amount you bend your elbows.
See how much more/less you need to bend your arms to move your hands up and down 1". It is hardly anything.