Based on your reading your biggest gain will be the bike's stack/reach and bar width combo given you claim you are eating so much air.
Aero frames may have gains, at high speeds and riding alone, but not on the magnitude of getting a frame that gets you a bike fit that allows you to be more aero on the bike yourself.
So, pay attention to the stack/reach and included handlebar width figures as much as you're looking at aero frames. IMO, ymmv, standard disclaimer stuff.