I still wear shorts when it's in the 40's and 50's.

When it gets colder I have some fleece pants and some shell pants that will keep me cozy even when the temps are in the negatives.