Yeah, don't turn when you're going slowly.
This one set of cages/straps I had, I could adjust how far out the cages were from the pedals.. If your cages can do this, just adjust the position back to where there is no overlap, which should be where you would be with clipless.