Sadly, my seat tube isn't open to the BB, so there'd be no way to remove the rest of the insert. I'm still not entirely sure what I'm going to do about this.

What do you mean by "rustproofing"?