I would go for a lightweight zip-off nylon pant (often sold as "hiker" or "traveler" pants). I've had a number of different brands. I think my current ones are from the North Face. At any rate, they cut wind, are a bit more athletically cut, and while they do soak through easily (since they have thin fabric), I'm dry after 5 minutes in the office.