I'm a big fan of dual sided SPD pedals. You can ride them comfortably wearing regular shoes or you can flip the pedal and clip in while wearing MTB or touring shoes (which look and feel just like regular shoes but have a recessed cleat).

Like the OP, I like the ability to just jump on and go, but I also like the ability to clip in for more "serious" rides.