I've got two cross bikes, a winter/rain commuter, an ss/fg beater and a fully rigid MTB. I'm planning to add a sixth bike in the next year, and I can already see the need for a seventh. I think your plan sounds entirely reasonable.
If you were looking for the voice of reason, I think you came to the wrong place.