I just happened to receive a copy of Jamie Smith's "Roadie" in the mail today, and in it he mentions training for 15-20 hours per week. I added up the time it takes me to commute each week (not counting the club ride that I tack on most Wednesdays), and it came to... less than four.
Clearly I'm not riding nearly enough.