The other change are the handlebars. A shorter stem only locates the bar for riding on the tops. Getting a more compact bar with less reach and drop will determine comfort on the hoods or in the drops.
Depending on the OP’s desired bar height, the stem angle can be changed or even flip-flopped. Since we are only talking 1.5cm between the two size top tubes, a lot can be slightly shaded to pick up a little here and a little there.
Stand over height is the one show stopper. Our next door neighbor is less than 5’8” and he was gifted a 60cm Allez. He rode that bike for a number of years until our much taller son bought it; and then left it in our garage.
I’ve ridden that bike after making enough changes to make it more comfortable (have no idea how our neighbor was able to ride it with a 140mm stem). But no matter what I do there needs to be a concerted effort when stopping to avoid that top tube. If the OP has a significant stand over issue, then he’ll need to go to a smaller frame or a lot of the fun of riding goes away.
John