Get a chemical rust remover that's available at a good automotive or marine supplies store. It usually comes in a liquid gel.

I've used it on many types of steel and it works really well. It will stop and neutralize the oxidation.

It's not corrosive to the touch but will stain your hands so you'll want to use gloves.