It's like everything else; there's a point of diminishing returns. The difference between a $10 headset and one costing $100 is very significant and noticeable, but the incremental improvement going up to a $200 headset is very small and hardly noticeable. Same goes for hubs, cranks, pedals and anything where precision of manufacture has an impact on performance.