Or you could get another fit. Fits are about balancing comfort, aerodynamics and power generation. Some riders will give up one for another. Others have physical limitations. You could also just ride in the drops more.
If you don't tell a fitter what you want out of a fit, it's fair for them to guess someone with an endurance bike prioritizes comfort, and someone on a racier bike prioritizes performance.