I don't find it hard to clip in or out. I ride SPD's in heavy traffic. Half the time, I plunk my foot down in just the right spot and clip in right away. I set mine loose to make it easy to get in and out. Since I've ridden with toe clips or cleats most of my life, I feel more secure with them than without them. I have fear of my feet slipping unexpectedly. To each his own. Use them if you like them. Don't use them if you don't.

I have SPD-SL's on my track bike for extra security. They are hard to get into. Before I clip in both feet, I ride very slowly and gently. The shoe is slippery on the bottom, so riding without being clipped in is precarious. Clipping out requires me to twist my foot hard, but I am able to bear this in mind, so I can clip out quickly if I need to. I don't ride my track bike on the street much anyway.