My thinking is that only you know your abilities and your limits. If you still have the coordination, reflexes and skills to ride, you know that you can ride. If you are riding for health reasons, then you have to decided if the risk reward ratio is good enough to continue to ride.
I can't remember any sport or exercise that I have done and not suffered some injuries.
Every time that I clip a foot onto a pedal, I am on full alert for the unexpected. It is not fun to crash. I like to ride but if I ever get too spooked to ride, then I will move on to something more suitable.
I hope that you can get things sorted out and make the decision which is right for you. I feel like it is very important for you to not be influenced by peer pressure. Just do what is right for you.