I'm not sure that anything on a bike can be theft-proof given a very determined or skillful thief!
Like CMD, my battery key-locks to the mounting plate. It would not be easy to remove and it would be a noticeable struggle, but I have no doubt it could be done.