I'd say changing the frame makes the biggest difference LOL!

But seriously, i think tires make the biggest difference as they telegraph the bumps affecting the way you interface with bars, saddle, cranks,etc. My second choice would be brakes, a spankin new set makes a massive difference on the backside of every hill.