I think there are two main things that would cause this:

1. Your chain line isn't straight.
2. Your chain is too loose.

Does it look like either one of these are true?