Of course I am joking about this but beginners who are considernig moving up to clip-in pedals really worry about it. The nice surprise is that it suually only happens when you are stopping so you aren't moving. So it is one of those things that you have to do a couple of times to lose your fear of it.
In the end it usually is the bruised ego that hurts most.