I'd use a file or some sandpaper to take off the bit that has mushroomed out. Aside from adding resistance, that lip can also make it very difficult to remove the arm in the future if you slap it back together without addressing it.