It depends on your goals for both the specific workout of the day and long term.

I have charted Cadence vs. Average speed. vs, Average heartrate for nearly every ride during the last year in an attempt to understand the most efficient use of my energy for attaining speed as well as endurance.

This real data along with notes documenting the physical effects has been quite enlightening.