I understand you're asking for pants that dry quickly, but I carry a fresh, dry pants and underwear with me to work and change when I arrive (along with a fresh shirt). If you have no place to hang your wet clothes, just keep them in the plastic bag and change back into them at the end of the day. It's a little uncomfortable at first, but I've done it a few times. I also do this when biking out to restaurants and get-togethers. I change in the restroom. I carry a plastic trash bag (or two) so I can put my biking clothes in there. I keep shoes at the office, but when I ride elsewhere I just wear my bike shoes, although sometimes I'll bring a nicer pair.

Once again, I realize this is not what you asked about...but I wanted to share.