The thing about carbon fiber is it's versatility. It isn't just for racers. They can make a frame very stiff (eg., Cervelo) or they can make it incredibly comfortable (Cannondale Synapse, Look 566).
I didn't buy my Look 566 for racing - lord knows, I'm decades past wanting to do that - I bought it because the roads are garbage where I live and it floats over that broken pavement better than my old steel road bike, and without the bottom bracket flex when I climb a hill. It feels like it was made for me. And that's the real criteria of whether a bike is "right". If it feels like it was just made for you, then it's the right material, no matter what it's made of.
I'm not worried about catastrophic frame failure. For one thing, this bike gets ridden only about twice a week, for another, I'm not likely to be racing any crits and crashing on it any time soon. I'm already 55, why would I need a bike to last another 40 years? It's unlikely I'll be going out for very long road rides when I'm in my 80s or 90s.