Embrace the Invisible Hour. My club - about 20 active, all dads, age range 38-62; avg. age 50(ish)... We've been meeting at 6am for an hour ride for about 13 years. On weekends; usually Saturday, we meet at 8am (ish). The guys with older kids (who aren't on a traveling soccer team grrrr) definitely have it easier.
I love getting in a solid weekday ride and getting home before anyone misses me - hence the "invisible hour."