I wonder where you live, or as others have mentioned if you have to put your feet down in snow or something.

I do wear my summer shoe in the winter, 1 ski sock, and neoprene booties over the shoe. However, for whatever reason I just don't have any issue with cold feet. (I live in Minnesota). So yes, though it may not apply to you.

Personally, I've been thinking about buying a dedicated winter shoe so I don't have the hassle of putting on and off the neoprene booties.