Thousands of people ride carbon forks every day without any issue, although Grant Peterson would disagree.

A frame is really no different. There are also carbon cross and mountain bikes.

If you are looking at carbon track frames keep in mind that weight is not an issue on the track, so carbon track frames are generally insanely stiff, rather than lighter.