I have a goretex jacket and pants, and rubber boots when the occasion calls. Depending on the cold outside, I can add layers as needed.

If you're new at this, remember not to wear cotton against your skin. You can still have a cotton sweater as long as you have wool or polyester underneath. Cotton will leave your skin wet from sweat and give you a chill.