For longer rides where you can really generate some heat I'm totally with you on this; however if it's a short commute of less than 10 miles, I might dress a little warmer. Especially if it's urban where you spend a lot time sitting still at stoplights and such.