Speaking as someone who is right now awkwardly walking around his office in cleated shoes, I would say that generally speaking it is really annoying and I wouldn't want to do it. However, I do own clipped pedals that I chose not to use. Honestly I would prefer the walking annoyance anytime I plan on riding more than just a couple miles. I think the trade off is worth it.
That said, anyone know any decent shoes that are not too annoying to walk in?