I do option #2 and #4.

I've got a winter bike with studded tires, full fenders, and pannier that I use. When weather is good (dry and no chance to ice/snow) and I need to carry lots of things I'll swap out the wheels for a set of 25 mm tires. When weather is good and I don't need to carry stuff, I'll take another bike.