I did the Potash Road a few years ago. It was the first significant ride after I broke my ankle, so even though it was nominally down-hill, it was still a real challenge. I did it in August.
I met a guy at a bike shop who would ride the whole 100 miles of the White Rim road in one day. I doubt I could do that.