I ended up keeping the Pearl Izumi's and just moved the cleat back a little bit. I took them out for the first time today and never felt worried or unstable at any time. I used to BMX and mountain bike so maybe that's why I didn't have any issues or fall. I have the pedals set at 1 notch up from the minimum and did pop out a few times, so I went a notch tighter. Thanks all!