My office is just over 26 miles from home, so my roundtrip is almost 53 miles. My ride is right at 2 hours, each way so I get asked how I deal with such a long commute. It's more a mental thing than a physical one (fitness does play a significant roll, but it kind of takes care of itself). You need a mindset that is dialed into the task at hand. If you're in a hurry or anxious about it, you'll be miserable and probably not do it often.
The extended time between locations, combined with the physical exertion that comes along with it, you can have a unique advantage in separating your work and home life. By the time I get to work, I've put my home-life problems aside and I can focus on work. This goes both ways. It is rare that I come home from work and snap and my wife or kids because of a stressful day at work. It's another mindset thing that comes along with a long bicycle commute.