I haven't toured on a Cervelo, but I regularly do credit card tours on a full carbon road bike with a Nelson longflap saddlebag supported by a bagman. I'm not as minimalist as you, so despite not carrying a tent or sleeping bag my gear is still close to 20lbs. Anyway, my experience is that there is no trouble with frame or wheels and that it should work well for you.