Not as worried about the standing weight. That's a static load.

Vibration from the road, with a little bit of weight on, can destroy handlebars. I know a local racer guy who replaced his handlebars every 2-3 years just from stress loading. Aluminum especially gets brittle over repeated stressing. What does carbon do? Dunno.