It really does sound like the 56 fits you well. You can make adjustments to make a 56 slightly larger to fit you, you can only do so much to make a bike smaller though. I would say go for it.