I have a huge seat bag because I also find it necessary to start overdressed and then strip layers. I also have a couple stretch-straps (bungees or used inner tubes) around the bag so I can secure other layers there if it is full. The key word is "secure"---as others have noted, you don't want to lose something while riding, particularly if it is likely ten end up ending your ride as it falls.