This isn't 100%, but it's how I see it:

Light weight = easier to lift and carry;

Aero riding position = easier to go faster.

If speed is what you want, you're not going to get it by only chasing after lighter bike weight.

OP, your starting post only asked about speed, really. Riding position matters more than bike weight.