I am going to play the devil's advocate here. While carbon fiber doesn't have a fatigue life in the traditional meaning of the term, it is very possible for there to be micro-cracks in the structure that are not immediately visible to the naked eye, especially in a high-stress application such as forks. So it is a bit irrational to assume that your fork is structurally sound without putting it under a X-ray machine to check for possible structural damage. And when carbon fiber components let go, they unfortunately tend to do so in a sudden, catastrophic fashion.
With this said, I ride a carbon fork myself understanding the nature of the material. A brand new carbon fork could fail before a 10 year one does under the right circumstances. But I personally would rather be safe than sorry in this case.