That's strange. No bike frame that fits you should break under normal use regardless of material or rider style. XL size frames are usually overbuilt on purpose.
KHS makes a road bike designed for big guys, a mass manufacture version of a design by big guy bike techie Lennard Zinn. It also has extra long cranks and overbuilt wheels
FLITE 747 - KHS Bicycles
It's not a cross-adventure bike though.
Zinn would also sell you a custom frame of any style but that's spendy.
You could look at older stuff. Really big classic frames are not too common because the demand was small when they were made, but they also don't usually cost much because the demand is still small.