I currently use Wald folding baskets on the rear rack but the next ones are going to be canvas or duck sewn with brass colored thread and Steampunked with leather straps and brass/bronze fitting from the hardware store.
For me they must fold flat or rollup so that they are always with me and they have to fit my grocery bags.
Oh yeah you'll need a rack.