Usually you can just use a punch to unthread the remains. If the plastic shatters more, big deal. If enough shatters, it will just fall out without unthreading.

N.B. ther caps aren't strictly necessary, but they do help keep the extractor threads clean. If your bottom bracket has a "female" type axle, you can get Allen head bolts with integral caps to keep the threads clean.