Or tighten your crank arms. I've seen a bunch of people strip out their crank arms because they were loose.

You should just tighten everything up. Makes sense, it's good cycle maintenance.