If you are carrying weight in panniers, that would increase lateral and twisting torque on the frame. I ride steel for commuting. The Brompton carries the load on the front, centered. I carry the load on the Riv in panniers. Although I try to even the load, the weight is often lopsided due to my computer. I can feel the stress on the frame when riding but it’s lugged steel so I have little concern. Don’t know if I’d feel as comfortable doing that on a CF bike. If you carry your load on you back where it is centered, it would probably be better. I just personally hate riding with a backpack.
john