"that won't catch on the chain"
Thats what really matters. I wear khaki's or jeans often - my road bike is my transportation... and I just use rubber bands to hold the bottom of the pants from the chain. Works great, as will any pants that allow leg motion and don't chafe.
This all assumes you have cycling shorts underneath, IMO much needed.