I think whenever you build up a bike you end up having to make compromises between speed, comfort, and durability. It sounds like your build put too much emphasis on durability and too little on speed. I'm currently experimenting building up a Soma Double Cross that has a greater emphasis on speed than the Campeur I use for commuting.