Best places to lose weight in order of priority:

1. Gut and man-boobs.
2. Wheels
3. Cranks
4. Stem/bars/seatpost/saddle

Aim for the parts that weigh more to begin with. Much easier trying to save 100 grams off the cranks than off the derailleurs.