i don't wear tie but wear nicer button down shirts. i have about 5 i just keep on the hook behind my door (i wear jeans too).
when needed (mostly the white shirts) i bring them home, but i started just dropping them off at the dry cleaner a few at a time. for $2-3 a shirt they'll do a good cleaning, and even better press and fold it. i can easily put these in my grocery pannier.
i keep shoes at work, so the only thing i bring is pants and clean undershirt, and pants i can wear a couple days in a row, so don't always taken them back and forth