I mean, people have done it before, or at least thought about it. It's kind of like those Cervelos with the gigantic seat tubes and aero stuff on them.
It probably doesn't handle that well, but it would work I guess. I'd just sell the TT bike and get a road bike.