If you're not already doing this - ice the pain area. Proactively ice it a few times a day to start and ice it after every long ride thereafter. It just reduces the inflammation that's causing the problems.