If your derailleur is that far out of adjustment, I'd start by looking at the place where the cable attaches to the derailleur. If that's loose and has slipped some, it would cause exactly the problems you are seeing when you knock it around. If it's a really old bike, you might even be able to see a spot without rust/dirt/grime from where it used to be crimped, assuming this theory holds water. Good luck!