I ride just about like you do. I did the opposite, tried the Fuji CCR plushie, ended up with their Team full race bike. CCR was more stable, more comfortable, "quieter" on the road. Team felt a bit more "efficient." But that may just have been because it's twitchier. Same money, same component quality. I chose the race bike but the CCR would have been just fine, too. Then again, I'm smaller and weigh about 50 pounds less. Either race or plush will do you fine.

Think of the plushies as Corvettes: plenty of performance, but they pay attention to rider comfort. Race cars don't.