Maybe you have a special situation, but I don't understand why you wouldn't want to change at work.
I'm quite minimalist when it comes to commuting compared to the rest of the commuting community.
Carradice Barley bag:
Main pouch - Small towel, shirt/pants (ironed and rolled so they don't wrinkle), undies, and deodorant.
I get to work and go to the restroom. Towel off all the sweat and change into fresh clothes.
I used to bike to work in my work clothes and I'm incredibly glad I changed my ways. Cycling shorts and a jersey is god send at 5AM when I start my commute. Comfortable, warm/cool when you need it, and moisture wicking. Who cares how it looks (if you do care). Function > fashion