I'm a newb to road biking, but comparing it to mtn bikes, I would never switch out XT components for XTR, unless they were given to me or if I were seriously considering sponsorship.

Those components will not help your time. If you do end up getting them and notice an improvement, then it was all psychological, not mechanical.