It also depends on the size of your feet. I wear a 15 . . there's no way I could ride any clipless pedal without the shoes! . . . I've tried it with Looks and classic Time pedals. . .I'm pedaling with the ball of the foot.
I was addicted to retention systems too . . . but after an extended period of not being able to ride . . . I found a pair of Wellgo MG-1 platform pedals with super grippy "spikes". They're not really spikes, but small allen head screws that grip very well. I use them with flat bottomed sneakers . . . and my feet are really loving it compared to Sidi's. I thought I'd lose a bunch of power . . . but I can't say I notice it, even on the 8-15% grade hills we have. Since I ride alone anyways . . . I can't say I'm worried about time though
It depends on the rider though . . . I'm a smooth pedaler. . . if you're not . . .I can see where it would suck.