I would not grind it. If your bolt is tight leave it alone. If it makes noise put some tape where the fender contacts the fork and reinstall the fender.