No, don't drill your carbon frame. You'll tear the fibers and weaken it.

And your bike will have two places already drilled for bottle bosses, no need to drill yourself. They already took care of it.