It all adds up! My old max limit was 15lbs incl. bag. New limit is 3lbs for winter 2 or for summer (including the bag/rain cover/clothes/deoderant/makeup/towel).
Switching from a 6lb bag to a 1lb bag (with 6oz rain cover).
A bigger weight saving is to take out unused compartments from the panniers or bag.The cardboard/plastic inserts weight about 8oz each!