What are you starting with?

I'm a hopeless upgrade addict. I've found that a lot of upgrades make almost no discernable difference, but they can be fun anyway. Tires are almost always the best bang for your buck in ride quality (maybe second to a good saddle). If you have cheap mechanical disc brakes, Avid BB7's are definitely worth the upgrade.