I've learned never to worry about how I feel on a ride until after five miles or 20 minutes. It takes that long to work out the kinks and get the juices flowing.
Early on there were a few times when I turned around after less than that, and I arrived home thinking, "Now what in hell was the problem that made me come home?" Then I'd turn around again.