Your biggest gains will be had from changing things that rotate. Wheels; cassette; cranks; tires; going tubeless; and pedals. You can also shed weight in the seat; seat post; handlebars; grips; various clamps and bolts, but these gains will not be nearly as obvious as those that rotate.

I have pulled almost 6 pounds off a bike by making these types of changes.