I'm saddened when folks see biking as only competition or as an obsession.
Recreational and fun rides can be so great. When pulling the trailer did you also go as fast as you can go and puch as hard as you can? You will likely do the same thing on the rowing machine, and injure yourself there!
Slow down a bit, have fun recreational rides, life does not have to be a continuous contest. Smell the roses. This gives a whole new dimension of bicycling.