I've got a 2004 Sequoia and was told by the dealer after they contacted their rep that the bolts above the axel should be used to mount the rack. That is why they are there. It looks like they are used in the connection between the carbon and the aluminum but that is glued and they since they are threaded into the aluminum it is a solid mount.
I have a Topeak rack on mine and have only had it loaded as much as the trunk bag with the expandable panniers can handle. I think you would be fine for light to moderate touring. Without a front rack or a trailer you would be limited for space for a heavy load anyway.
__________________
Nothing compares to the simple pleasure of a bike ride - JFK