I always considered cold setting a hack, I would not do it or want a frame it was done to. Too much room for imperfection, and I'd rather not have bent seat and chain stays anyway.
There's no downside to giving the remove spacer / re-center the rim method a whirl though.