i do almost the same, except i have the cotton layer on the middle, and the polywhatever (plastic clothing) layer by the skin, in winter time this really helps, yes it is a little bit uncomfy but it keeps me dry and warm.

i actually picked that up from the Winter section of the forum.

unfortunately at 20c + high humidity in rain, it's just too hot and wet to use that technique.