Would say in this case, if replacing the stem, do the handlebar at the same time, not only will you save a lot of weight going from Steel to Alloy, but will eliminate the possibility of your current handlebar damaging the alloy on your new stem, as the current handlebar seems to have been working like a file.