5mm seems very adequate to me. Buy high strength heat treated black bolts and nylon lock nuts or use some Locktite. My handlebars are held in place with 5mm bolts and they are subjected to a helluva lot more weight, leverage, and jarring than a basket or rack.
