If carbon fiber steerer tubes fail similarly to the way carbon fiber fly rods fail, it will be when you are trying to stop, trying to quickly accelerate, or trying to corner, all situations where you are putting extra force on your stem, and all terrifically bad times for the sudden loss of firmly attached handlebars! I wouldn't ride it at all, but then, I hate hospitals and facial reconstruction.
CC