Concerned? Nah, not really. Smiles per mile and all that stuff. Any time I spend off the bike these days is not "happy time"
It's more a question of time. I'm not fast so any 40 or 50 mile ride, for me, is a major time commitment.
That means, on Saturdays -when I so ride- the chores don't get done. This does not make Mrs S happy.