I also have multiple hobbies as I cannot sit still. I got into really long rides as well but it's just too much as is not fair if you also work alot or do lots of family stuff. I always told my golf buddies I will wait until I retire for more play as 18 holes pretty much takes your day, but there I was riding all day.

One thing I did, my wifee rides but she is not passionate about., But she wants to be in better shape. So we got a personal trainer and work out three times a week together. Great quality time. I ride two other days and maybe Sat or Sunday for a little more distance, but do the early rides so I have the day.. One thing may also want to do is crits or those type rides for road or fixed. Fast and shorter. I try to get in a one hour push in per week. Going full on you don't need to do 100 miles and it's fun watching times get better.
​