There are two clubs that cater to the needs of the "ordinary bicycle". Veterans Cycle Club and the American Wheelmen. A ready to ride ordinary runs in price from $2,000-$5,000 depending on condition but there are still some out there to be found. I have read that the reproductions are generally "novelty" items/riders that only vaguely resemble the originals.
I rode one once also. It was really fun once I stopped fighting the wheel.