I've ridden to work many times wearing my office clothes. This in Georgia; hot, humid, rolling hills. It all depends on the route, your level of fitness, and planning.
Top of the "planning" part is to always store a full change of clothes at work, even if you always carry a change anyway.