Ride whatever you're comfortable in.

I wear merino (wool) hiking base layers. I don't like the rear pockets - stuff pushing into my lower back bothers me a little, and I'd rather avoid it.