is 32" your pants inseam or your real inseam.
If it's your real inseam then you have really short legs for your height. Then a 56 cm frame will probably have too short a top tube for you. The head tube will also be shorter, making it harder to bring the stem up higher. I guess if it's a threaded steerer you can always just get a nitto technomic with one of those ridiculously long quills.

That being said, as smaller frame will in general be lighter and stiffer, and will be easier to throw around.

PS. that's some ridiculous saddle-bar drop going on there.