Sheldon Brown defined "quill" as:
1. The vertical part of a conventional handlebar
stem.
Perhaps the thought was that a stem stuck out of the bike like a feather?
EDIT: I see after re-reading this thread that others had gotten to the same point. More evidence for it, I suppose.