Keep in mind there IS the risk without cold-setting that only one side of your stays move, or one side moves more than the other, changing your chainline, impairing shifting and causing faster wear of the drivetrain components. It's rare, but I've seen it happen.
I find it's best to cold-set just to avoid these issues, but it's obviously not always necessary.