Most days I'll detour to take a longer ride to work, but if I take the direct ride home it's in office clothes. Four miles isn't enough to hassle with changing clothes, or even shoes, most days. Especially when the weather's cool.
I just put on pant cuff bands and go.