Get back on the horse. The sooner, the better.
If you have anxiety about something, avoidance only makes your anxiety worse.

If you're haven't enough fear to convince yourself to avoid the things you love, then consider seeking therapy.
Not a psychiatrist, see a licensed psychologist.

I was attacked and bitten through one hand by a large dog while on a solo ride.
It's not the same thing, but the fear was the same.
Therapy has been very helpful.

Unless you're developing coordination problems or a balance issue, get back outside on the bike once your injuries have healed.