Well, it turns out I was able to (carefully) thread it all the way in with the help of a wrench and WD-40, and the arm popped right off, so problem solved!