Brass would work, but I'd be afraid that it would wear back in there. Filler rod welded in and filed down would be tougher, and you don't need a framebuilder to do it.
__________________
If someone tells you that you have enough bicycles and you don't need any more, stop talking to them. You don't need that kind of negativity in your life.