Do you have good glasses? I ride mtb better when I can see better, on the road it isn't as critical. I also get off and walk if it's too sketchy, not too proud to wuss out.
I also rode off road motorcycles for 10 years and wouldn't trade those good times for anything.
In my opinion road riding is the most dangerous thing I've done and is where I've had and seen the worst injuries.