I wear scrubs. Yes, that's probably a little bizarre.
Mind you, not the typical blue, straight-legged type. There's actually a retail store around here that sells various types with pockets, belt loops, etc. They basically look a lot like outdoor pants you'd find at REI—very lightweight, stretchy enough, they dry almost immediately, but they're about half as much. Basically they work for me.