You could use an ultralight nylon/pertex or polyester windproof smock. These pack down small and weight nothing. They are not waterproof but do stop you chilling out if it gets too cool and are much more breathable than the best waterproofs.