I ride with an under-seat bag; a small frame pump; and a mirror, and I wouldn't even ride with a dork dish!

Now THAT should tell you to what depths you'll be descending if you leave it on. (Ha! A few levels below me!)

Plus, I like to ensure that my RD's limits are properly set, when there is no tension on the cable- so I see little need for a dish.