Being extremely OCD I could never live with such a scenario but, from a purely mechanical point of view it shouldn't make much difference. The only issue would be having different cleats and pedals wearing out at different rates and the asymmetry in cleat placement (although most people would probably benefit from asymmetric cleat placement since hardly anyone has identical L/R posture)