I don't see a problem with this as long as you take your time and remove/start the cups straight.

If you can distort a tool steel bearing race with a rubber/plastic mallet,your a better man than me.