Exactly...I used the Showers Pass Elite gear on commute all last fall and winter and that's what I do. You just take it into account when you add that as your top layer, and adjust your dress accordingly. I'm thinking that I wear it and a jersey on anything down to about 50, go to a long sleeve jersey down to about 40, then add a beefier long sleeve jersey and layers as necessary below that. The great thing about it as a top layer in colder weather is the way that you can vent it. That really helps to stay warm without building up enough heat to sweat too much. That alone had me wearing the Elite Jacket on plenty of non-rain days, which suprised me.
__________________