Riding gravel...are branches making contact with your spokes? Also, i23s are low end wheels....and you're carrying extra weight on those 28 spokes. Ever weigh your total load; you+panniers+cargo+clothing+shoes, etc to see if you're over their limit?
Just some additional variables to eliminate while on your quest to solve the issue.
Good luck!