Remove bolt and nut
Replace bolt/nut with a single bolt with a solid head, that goes behind the metal piece (but does not go through the piece). Take this opportunity to use a bolt with a smooth, round head.
Cut notch in back of bolt to tighten/loosen it with screwdriver
Profit?