Kill the sperm? So what, your body will just make new just like every other time you lose sperm.
I'd be more concerned about a saddle that puts too much pressure on the soft tissue where the blood vessels are located. This is what could cause erectile difficulties because of the vessels flattening, thus getting larger in diameter, reducing blood flow.