Yep - get the PB and let it soak in. Then use a fine paper like Emory Cloth. Rust is just a surface oxidation and can be easily removed. Once it's gone, put a good oil on the surface and that should help prevent further oxidation (rust). Don't go overboard - rust is a very thin layer and comes off easily.