the shear load capacity of a 5mm bolt is a bit below one metric ton... an aluminum bike rack is rated to about, what, 50 Pounds? :-D
i'd suggest custom grinding or filing a standoff out of a tall V-brake pivoting base(the taller aluminum part, they come in two thicknesses), but then you characters couldn't rack up another 85 posts discussing this simple fix.
carry on