I just leave my bike clothes at my desk. I've never had an issue. My work gives us towels, so I just put my towel in the bin for dirty towels.

Paul

Edit: My wife suggest a camp towel. They are quick drying.