I love foggy weather, but that clammy feeling does get a bit annoying after a while. I'll take that over hot and sunny any day though.
For the really cold days I think a base layer, plus a light longsleeve wicking shirt or arm warmers and a light jacket on top should work. I just feel thermal underwear would be too hot for me. I can sweat in that stuff just sitting around.