I ride to work, only a mile away, in my work shoes on SPD pedals. It's terrible. If the commute was longer I'd change shoes. I can't spin as fast, I can't accelerate as fast, I can't resist the pedals as well (Fixed gear).
Also, since going clipless my sneakers very rarely get worn. It's more like walking long distances requires special shoes, and the SPDs are my normal (Or the work shoes).