There's another aspect to "fast" frames' Frames that feel "fast" or "race" inspire greater effort. More effort, faster times.

I just picked up a Pro Miyata frame from a forumite and set it up with roughly period race hardware. Chorus crank, Cyclone derailleurs and brakes, my usual Delta standard pedals, etc. First ride - this is a slightly less radical but just as pure race as my old Fuji Professional that I raced and loved, only now with late '80s better tubing and a couple of other nice touches. Like my Fuji, it just wants to go fast. And is a pure joy to ride fast. So it happens, Regularly. Always faster than I would on another bike. Just like you would drive a windy road faster in a Ferrari than a Volvo, even if you weren't in a hurry.