I'm not convinced.
I ride. I race. Been there, done that on steel, aluminum, Ti, whatever... for years and years.
As for quicker "race" handling. Simple marketing BS. The rake and trail on "race" and "comfort" bikes are within millimeters. In any event, a conveyance weighing under 20lbs. will never be hard to turn.
Given the choice, I will choose the more comfortable bike every time. When I am comfortable, I am fast. I want to hit the final turn as fresh as possible and getting beat up on a stiff bike does not encourage fresh.
Yeah, aero is nice, but the difference is mitigated by sitting in the pack drafting. Races on won by who is fastest on the hills, where "race" geometry is of no consequence. And by who is freshest in the final straight. See above.
My advice: Ride what is comfortable, that is going to be the fastest for you.
-Z