Shower before you leave.
Wear merino wool base layer
Dont overdress, dont wear a waterproof unless it is raining, use a windproof of appropriate permeability (more permeable for spring/fall, less permeable for winter). Consider sleeveless gillet style outer layer.
Putting insulation OVER your shell makes it easier to add or remove during a ride.
Ride more slowly. Use the final section as a cooldown. It takes much longer to cooldown off the bike and inside. Going fast just requires a longer cooldown so there is no gain. In hot weather, splash some water over yourself when riding. In cold weather, open up your zippers to cooldown.