Some people aren't very prone to those injuries, perhaps because that sort of injury is rare, perhaps even rarer among those who don't ride hard. Anxiety is real, and it can be enough of a reason not to use something whose value is low.
I ride clipless virtually all the time. I prefer it strongly. I've never been injured from riding clipless, not even in a minor way. But I can't say others need it. My wife tried it. She fell and cracked her elbow. Her ankle isn't strong enough to twist out reliably. I am not going to tell her to try again.
My wife has anxiety and will only ride with me on our tandem. She is scared to drive our car in heavy traffic. I do not take issue with these things I just plan around them. I believe that most people can learn how to if they want to. If you think you can or think you can't you are right. I put my frogs back on and my Sidi shoes yesterday and had a quick practice and off I went. tomorrow I will do about 35 miles. My Sidi shoes are the mega meaning more fabric not last. I have some Lake shoes coming and hope I fare better with them.