I don't know where you get the equipment, but I've seen a few vintage/single-speed guys around here use cages mounted to the back of a brooks-style saddle. I've also seen some handlebar arrangements that use some of the rubber clamps as shown above to attach more modern aluminum cages that fit braze-ons.
Good luck!