Plenty people ride thousands of miles per year without using clipless. I've used them, but have switched back to plain pedals. I may give clipless another try sometime.
There's nothing to be scared of. You'll probably fall once, while at a stand-still. Then it'll be second nature.