If you're gona be outside on your bike in extreme weather, then spend a little extra and buy good quality stuff, trust me it's worth it, you'll be more comfortable and good quality clothing will last you for many years.
Cheap stuff just doesn't cut it when the weather turns nasty. You don't need cycling specific clothing but at least get a good quality outdoor/athletic clothing.