You are just paranoid. I ride everywhere with clipless but I do use mountain bike shoes so that I can walk around. Unclipping before you stop becomes second nature. I often find myself unclipped before I even think about it when I have to stop. Or I just trackstand at lights.

I wouldn't ride any distance without out clipless shoes on clipless pedals however. Those are pretty tiny platforms to try and keep from falling off of.