I use clipless pedals on all my bikes... Road and mountain. The only time I wish I had flats was when I'm riding somewhere in regular clothes... Like a restaurant or convenience store.

If you're still keen on trying clipless, you may loosen up the tension so you can get out of the pedals very easily. Ride that way for a while to rebuild your confidence.

All that being said, you definitely don't need anyone's approval to ride whatever you want.