I say go for it! I'm 5 11 and I ride a 54. I've tried 56 and 58s and just didn't like them, the reach was too far. 54 has a shorter reach which is perfect for me.