Your post implies that your back is moving around on the seat as you ride, especially since you don't have that problem on other contact points, as with the seat bottom. When I'm riding, my back is firmly planted that you could shake the bike without shaking me too. Maybe all you need to do is to recline more firmly into the seat back so there is no motion at all.
:)ensen.