My rule is usually to dress for yesterday's weather, but look out the window before I leave and adjust as necessary.
It sucks to get soaked heating into work. But on the ride home, it's really not a big deal, because we all have a hot shower and clean clothes waiting for us at home. Except the hippies.