Test rides were great for the first bicycle I bought - It helped me experience the subtle variations between different materials, geometries...
That said, since I purchased that first bicycle, I have not test ridden any frames before purchase/acquisition. One was a warranty replacement (different model due to the first being discontinued), one I bought for $100 on craigslist, and one I could tell by the geometry it would be fine. I have not been disappointed yet.
And my next frame, likely to be purchased later this year, also likely will be bought without a test ride, as the supplier does not have a physical shop.