I've done hundreds of miles like this. Not ideal, but can be done. If anything, I've noticed the pedals can kinda chew up the bottom of a tennis shoe after a few hundred miles like this. The pedals showed zero damage, unless you're OCP about the paint wearing off.