I have had three falls but only two because I forgot to clip out. One was a knock down. But I traded my Speed plays for a set of egg beaters. The reason for me was if you walked anywhere there was dirt or grass speed plays would get crud in them and not want to clip in. While the pedal was very light the cleat was not. The bonus was my crank brother cleats work with my time attack pedals as well.
But like others have said if I even think I will have to stop I unclip. If the light turns green when I get there it is simple to push down and clip back in. I just hope talking about it isn’t a bad omen.