Weight will matter a little in speed, but remember, if we compare you (I'm going to assume 75kg) to me (54), I'm going to be a scrawny little bastard standing next to you, which means smaller arms, legs, hips, shoulders, chest, etc. All the little things add up, and a much smaller body in weight is probably a much smaller body to the wind.