Rotating mass has a multiplier effect varying between 1 and 2, so yeah, lighter wheels are nice.

That said, is it worth it to be a weight weenie? No. Not at all. Ride what you have and love it. Buy for quality and fit, and if the weight comes down too, then so be it, but if you buy Ti bolts to "tune" your bike, you've wasted your life.