I had this exact problem, and it took me awhile to nail it down. In the end it was poor core strength, I was working out the lower back too much compared to my abs. I stretched my back after every ride and a good ab workout twice a week and it was gone.