If looks matter more to you than comfort then that can be a big problem.

Otherwise, downsizing is an option if they can give you longer steerer tube to put enough spacers under the stem. Having lots of spacers under the stem might look ugly though.