They are pricey, but I have a couple pairs of Outlier pants (OG and Workwear) that I've beaten the hell out of for the last 4+ years (at times I've worn the Workwears every day for weeks) and they are still going strong. They dry quickly after riding through the rain, and are comfortable to wear even all day on bike. No fading, no stains from my saddles - I have other wool and cotton pants that have saddle/fade marks after only a few weeks or months of semi-regular wear on the bike.
I feel like a ridiculous commercial, and have a deep and abiding irritation for their marketing, but it is true that you pay for quality. One pair I bought new and one I picked up for a significant discount barely used on eBay - so you can always buy something cheaper but keep your eye out if the fancy stuff pops up there. I will also add that for myself, having products either made in the USA or elsewhere with well-documented fair labor standards is an important factor - others will have different opinions.