I quit commuting when the weather gets to be around freezing, and found that being cool at first and then stopping part way through to take off a layer is more comfortable for me. I plan on being able to stop and take something off so that I don't end up needing to replace a warm layer with something cold, and find that stopping like that is still faster than cooling off at the end of my ride when it's hot out.