(I am not sure what you mean by "Tightening that bush will make the bike track straight again" because the steel spindle was sloppy in the old plastic bush, no amount of tightening would cure that.)
My fault. I meant tightening up the lash in the area where the old plastic bush was (by making a new one) will make the bike track straight again. I was just commenting on what you were already doing.