I have a friend in much the same situation- and while I haven't found a great solution yet, I ride recovery rides with him (much as others have suggested) . We did talk about it, and he knows what is going on, but we are still able to have some time together.