If you are happy with the contact points - bars, stem, saddle, post, bar tape, pedals, shoes, then I'd look at tires.

What tires are you running? New tires and latex tubes can make as big, or bigger difference than wheels.

That said, wheels are never a bad upgrade, and it's always nice to have two sets.