Yes, consider also adding spacers under the bars if you have enough steerer.
As for how things look ... everyone sees the same things differently. One thinks it's cool, another thinks it's stupid, and most don't even notice. If you want to enjoy riding your bike as opposed to pleasing some imagined bike-appearance Nazi ... then most people will see first and remember most your big smile.
You know how fads start? Some guy has the courage to do what he thinks is right, for all the right reasons ... people see his confidence and copy him, for no good reason. Start a fad .... short stems will be all the rage for a while ....