There's two causes for this in my experience:

A: Rim seem defect or other defect.
B: The brake isn't tightened down enough--this could either be on the recessed/hex nut or on the middle axle nut.

Both will cause jerking or clicking.