I ride to and from work to avoid this exact issue. No one misses me due to the fact they are asleep. When I grab the occasional weekend ride I get up early and am back around noon. Plenty of time to avoid conflict. However, I require the occasional very long weekend ride.