Keep in mind that BSA30 is a minor miracle that they can make the threaded part thin enough to get a 30mm axle through. This was a later design, not something intended to work in the first place. So that bearing and the tube are as close in size as possible.

I would try a round punch with a sharp edge, working around the circumference of the bearing. But you stand a good chance of knocking the inner race out in the process.