Adjust properly, and fill the allen bolt heads. If you are in high crime area, fill with epoxy, if in a low crime area filling with PL adhesive will suffice, all without having an old chain hanging from your bike.
Or replace you allen bolts with tamper proof torx bolts if you are really picky.