Depending on:
- Stem height
- Stem reach
- Handlebar reach
- Seatpost height
- Seatpost setback
One frame size up or down can be the same bike. I don't think the frame size matters, the relationship of the rider to the contact points and how you arrive at that is the important part. The frame is just a hunk of metal holding things in the right position.
This doesn't apply for things like seat tube/head tube angles, wheel base and those sorts of things and their effect on "ride".