I'd say if it doesn't affect anything, take that blessing and keep on motoring. I've come across a few wobblers and they definitely did affect ride and shifting. Sometimes it's just the chain ring and other times it's the spider arm of the drive side crank. I've found out which (or both) by making a flag-ish shaped piece out of masking tape, sticking it to the seat tube where the tape nearly touches the chain ring (or spider arms) and spin the cranks. If the 'ring is bent, get a new ring. If the spider arm is bent, an ever so slight and gentle persuasion with the 'jaws' of a 12" Crescent wrench around the offending spider arm tab (where the rings bolt to/through) can ease things back. This is a Sheldon recommendation, and one I've used a few times to good effect. I'd rather not do it, but cranksets bend sometimes. As always, you do this operation at your own risk. And like I said before, if it ain't messin' with anything, let sleeping dogs lie.