Carbon Fiber is quite fragile. That's why it's used in commercial aircraft, road bicycles that carry 175lb men down mountains @ 60mph and F1 cars.
Seriously, my Sidi shoes have little walking pads. Unless you're going to walk across Manhattan every day wearing your cycling shoes, you should be OK. The carbon doesn't really touch the ground, the rubber pads do.