what kind of chain are you using? Seems like the kind of thing that can happen if you use an 8-9-10 speed chain on an older crankset.