My opinion: the difference is mostly weight, at least with shimano. In my experience, even low end (shimano RSX) shifters and derailleurs will shift flawlessly for a long time with the proper maintenance. Put your money into the frame and wheels of a bike. That's where you will notice the most difference.