Sure it makes a difference. With the large frame you might not be able to get the bars low enough. The larger frame might also require a stubby 90-100mm stem. Some brands only increase the reach by about 10mm between sizes, but some go as far as 15-20mm. You have to compare both the TT length and the seat tube angle to determine the change in reach. If the geometry chart lists the reach, a correction must still be made to account for the difference in stack height. A 20mm taller head tube will make the reach difference 6mm larger than listed.