Not that hard - 10 mm, just shy of 0.4". It'll be at a bit of an angle, but nothing to worry about.
Some claim that changing your stem by 20 mm makes a large difference in steering/handling, but I've never found any large effect either through geometry (math) or practical experience.
__________________
ElJamoquio didn't hate the world, per se; he was just constantly disappointed by humanity.