Small handlebar baskets dont hold much and larger ones can bob around when loaded, which is why delivery style baskets have braces to the fork. A handlebar bag may be better. From there I would look at rear rack and trunk bag/panniers.
If it is for a purse, get a small messenger bag like Timbuk2.