You might have a stiff link. Pedal backwards slowly and watch the chain as it comes off the cassette; stiff links won't follow the contours of the cassette very well.
How worn was your old chain? If your chain has stretched significantly it could have worn the cassette down to the point where a new chain won't mate with the old cassette very well.