Heck, I've ridden around on eggbeaters(!) without changing shoes.

But...why would you want to? Also SPDs and sometimes eggbetaers come with those dinky little test platforms that have a cleat onthe bottom so you can just take them in and out.

And no, the pedal will not be damaged unless you crash and hit it because you slipped off