I had that problem when I was using gym shoes on platform pedals. Since I've gone clipless and gotten proper shoes I've had no problems