I tend to agree with the "go lighter" folks. I have used a Bianchi Volpe, a cross bike, for several years for touring. I still have it, but it was replaced by a Surly LHT as my primary touring bike. The Volpe is a jack of all trades and the only thing it does exceptionally well is doing many things fairly well. I still ride it around town, and on club rides when fenders are in order. However, I have been thinking about doing more with it, simlar to what you described. It is a little lighter, more agile, and about the same price as the LHT. The LHT tours exceptionally well, but is not as versitile.
Bianchi in fully loaded tourng configuration.
LHT minus racks and fenders (steerer tube also needs cutting)--still a truck