Sounds like another job for Bag Balm. Apply lots before you ride and I'll bet that this heals up and doesn't come back as long as you use keep using it. The stuff is cheap, readily available (an any old-school pharmacy), keeps forever after opening and it works. (As the poster above says, it was formulated for the early mechanical milkers after farmers found their cows unwilling to subject their nipples to the early crude machines. Every day for years on end. Out butts have it easy.)
Ben