Depends on what is rattling.

Dremel a small (whatever size needed to get the clearance) section, if it is a support for the fender, you may have to go with rubber tube as that may be the solution.