Take some Proofhide and smear it between the underside of the saddle and the bar the rivets are attached to. Take a hair dryer and get the Proofhide hot enough to run under the bar. I'd grease the rails where they contact the seat post too. I'm betting that's what is causing the noise.