I’m definitely on board with the specific purposes thinking. Rigid Fat for slow sloppy rides, dual sus for the rest.
Since you’re only planning on needing the fat tires a few times a year, we’re it me, I’d just rent one on those days and put my money and garage space into a regular duallie.