Don't ride over bumps.

Or cable-tie some old inner tube material to the stay.

As long as there's a pad or sticker on the stay to keep the chain from chewing it up, it's ok for the chain to hit it.