You might get away with that in NY, where your coldest temperatures are usually accompanied by dry air. It'd be pretty miserable here in the Pacific Northwest, even with our mild temperatures, because there'd be no way to drive the accumulating moisture out of the house (unless you had a good passive solar setup) with the humidity so high most of the winter. Great way to get mildew and rot going.