I've found (over a lifetime of riding) that at about the 3-hour mark in a ride is where saddle comfort comes into play. The right saddle won't be fighting you or irritating you with unwanted pressure, or worse, causing pain.

On a full-day ride, the correct saddle pays for itself. I've not yet met a padded saddle that can pass the 3-5 hour test, but I've ridden several leather saddles that can and do.