One year ago (Jan 2009) they removed cartilage in 3 different places from my left knee. I had an easy recovery and was walking around in a few days, back on the bike going easy in 4 or 5 weeks. Full tilt shortly thereafter. I've heard of people riding faster even, and I've heard of people taking months. It's a YMMV situation, so don't listen much to anybody but your body and your doctor.
One year later, I feel better than I've felt in a decade. No problems or pain whatsoever thus far.
EDIT: And to the point contained in your subject line, I finished the first 3 seasons of Weeds in 2 days. Painkillers + DVDs + bed rest = mmmmmmmm...