I ride Carbon wheels full time, I only switch to Aluminum wheels during the winter on rollers and when the roads at still salt covered in the spring. IMO, they are fine for everyday riding, you just need to be careful when riding in the rain.
I didn't have any problems running clinchers when I was in Colorado, but the descents out there are not very technical.