I've thought quite a bit about this, but, as I see it, the problem is that regular shoes aren't rigid enough. You'd probably end up destroying the shoe with repeated clipping and unclipping. I have a pair of basic Shimano MTB shoes that I tried wearing around all over the place, but they're just not designed for lots of walking.
__________________