I've been wearing Banana Republic non iron trousers for about 3 years commuting 2 miles each way with zero issues. I have a Brooks smooth saddle, which I think helps keep the crotch from rubbing too much. I use an ankle band to prevent the pant leg from hitting the chain.

Most of my BR pants are not of the stretch variety, but it seems all the sell these days.