I read that at some point on a high speed descent, the energy that it would to take to increase your speed becomes so great, and the gains so little, that it makes more sense to become aero and spend the time recovering.