I had that problem for a while but I think it was because of the holes in the chainring were worn and no longer round. So check that out. Loctite sounds like a good suggestion too. And the metal dust is most likely from the bolt threads getting stripped - make sure you're screwing them in straight.