warming up, cooling down, training etc. Even if you only ride it on the track chances are you will be spending a fair amount of time on the tops of the bars.
If you get an oversize frame to make it more comfortable in the drops you might as well not have any.