I've been through a few pairs of Casual SPD shoes and now sandals over the years. What I've found is that the features that make them perform well on the bike are the exact things that make them perform poorly off the bike.

Stiff soles, a bit narrow, eventually the soles wear down and the cleats click and scrape on the ground, oh and they can look pretty bikey.

But since I insist on riding clipless, like many others, I simply keep shoes at the office. It's really the way to go.