Any sort of hiking/backpacking pant will dry very quickly. I've got a pair of REI brand cycling specific ones that are very good. I'm also a big fan of Marmot hiking pants.

Non-convertible pants will look more professional and are suitable for many office casual workplaces.
Marmot Arch Rock Pant - Men's | Backcountry.com