I only have my one set of pedals, so this isn't a problem. Getting used to clipless is a bit taxing for other reasons ( foot placement, soreness in my left knee, suddenly using muscles I didn't know I had ) but at least this hasn't been an issue for me.
I fear the day I go somewhere and don't have normal shoes, though!