How far are you riding? For my 3 mi commute, I find that bringing a shirt to change is sufficient. I ride in athletic shirts for running and such because they dry fairly quickly. I carry a softshell with me though.

When you lube the chain, you should consider wiping the excess lube. It should not be dripping for a day or two.