Yes, Spring and Fall of the year especially, The difference in temps can be 30 degrees from morning to afternoon commute. They are so easy to peel off or roll down. I wear them in the morning with a SS shirt. I also use them frequently on long road rides to start out, they are really easy to stow in a jersey pocket they're cheap too.

Balaclava, for sure if you are going to ride in the real cold.