I made my own CF outer cages for the really crappy Shimano SIS derailers a while ago (for friends), and drilled through it fine with HSS bits.

But no, don't drill your frame.