I prefer a backpack over panniers for commuting, and just factor in the warmth from it while I'm getting ready in the morning. This time of year the weather changes so much that I end up being prepared for most any temperature and the warmth from the backpack isn't a problem.