I'm 5'8, 30" inseam, and I have a 175mm on my mtb, and my Specialized Sirrus came with 170mm cranks. I sure as heck think there is a difference, but might just be me. The Allez I used to own had 175mm as well, and I feel the 175mm was easier to pedal?
172.5 should be fine.