I think that this may have been the problem. There was a stiff link that I had lubed and tried to work back and forth, but the chain was just too old I guess. I have bought a new chain since, and will put it on today.

I just hope nothings wrong with the derailleur, it seems sort of bent in towards the spokes but it could just be an illusion.