Hi summerman, i have a road and cx bike (well the cx bike is stolen now but I had them both at the same time).
I love my road bike (Allez). The CX bike (Specialized Tricross) was very comfortable because the geometry was more relaxed than the road bike but especially due to its 32mm lower psi tires. Out of the two bikes I always loved riding the Allez. It was so responsive, so fast, very accelerative. Whenever I came close to green lights, I used to gun it, and sometimes I made it, sometimes I didn't. But on the CX bike, I never made it.
The CX bike was hugely comfortable but and I was always amazed and the excellent ride quality. Alas, that only lasted 10 minutes into the ride when I wanted to go faster again. The CX bike was kitted out for commuting duties so had fenders and this caused toe overlap which I hated but learned to hate less. IDK if the bike would have toe overlap w/o the fenders but I read somewhere that due to the geo of CX bikes, you usually get toe overlap. Another 'feature' of CX bikes are those weird brakes. I dont know if the problem is now rectified, but I read (and experienced) front brake shudder on a CX bike with carbon forks. It's something you have to get used to but it was another thing I disliked.
In the end, I didn't miss my bike getting stolen. At the back of my mind, I might get another CX bike.
You can get a relaxed geo road bike like a Specialized Roubaix (I dont like the looks of the bike myself, but the head tube is exceptionally tall so it suits many people for longer rides; specialized changed the geo around 2007 to appeal to a wider market). You shouldn't worry about 105 level components either (unless there's something about them you particularly like), 2012 Tiagra is pretty good (I still use 2006 Tiagra

).
If you do choose a road bike, you can get stronger wheels of course but usually (always?) these bikes are limited to 25mm tires.. Another choice could be an audax bike. It's kinda like a very relaxed road bike geo, with greater clearances for fenders/racks and wider tires etc, and you can build it up with stronger wheels. IDK much about audax bike prices tho.
Hope that helps.
EDIT: I should have mentioned the CX bike also had panniers attached which are a real drag. Literally. They'r very un-aerodynamic. Even so, my road bike was still faster. I think it was mainly due to lighter wheels on the rb, and a little to do with geometry.
I also recall Trek 520 or Trek Portland, they might be good for you.