Swapping out the stem isn't a big deal, I agree. It's more a matter of my laziness wrt hunting down a geometric replica. I'd still probably eventually do that if it weren't for second part....wanting the ability to change the adjustment setting to lower the bars on a good back day. My adjustables are sturdy...just a bit heavy.
Also agree with that don't want to mess with a dialed in saddle position bit. I actually have a second saddle/post setup for my road bike....a B17 adjusted to compatible with the lower bar position. Other bike I use an adjustable stem on is my sorta hybridized mtb with a cruder saddle adjustment.