I went from a Trek 1.2 to a Cervelo R3 a few years ago.
There was a big difference (stiffness, responsiveness, ride feel, etc.) but it had very little to do with the bike weight. Kind of like comparing a $20,000 sports car to a $50,000 sports car - the weight won't tell the whole story.