Use nylon wind pants. I was out yesterday and now today in cycling shorts and wind pants and the temp is in the mid to upper 20s. My legs after a couple of miles are fine. 20-30 minutes yesterday I was riding in 40-45 degree rain. My legs stayed dry.
Remember nylon is what they make tents out of. It is pretty much rain proof but it definitely isn't breathable.