The biggest issue I see that you didn't mention is what I ran into after buying my bike - where are you going to store it while you're at work? Are you going to be comfortable leaving a $2k bike that's obviously expensive locked up outside all day? Are you going to be comfortable leaving it out in the rain when it rains for hours? (Or even if it's a fair weather commuter, it's going to get wet sometimes when it rains unexpectedly).
If you have that in hand, I personally think it's a great idea. :-)
P.S. If you did sometime want to put a rack on it, from what I've read p-clamps on carbon fiber stays would be a terrible/dangerous idea, but there are good solutions (racks that are designed to be put on bikes without rack mounts). Just an fyi, I know you said it wasn't a big deal.
I second the previous opinion - "Since you don't need to carry a whole ton of stuff, I don't see any reason not to ride that as your commuter."