Hmm........Sounds like someone gave you to short of screws. Get some longer ones......And maybe wrap the seat stays with a piece of old innertube or electrical tape to help protect the finish. Got a pic of the rack so we're all on the same page? Is it a Pletscher or whatever those old school alloy ones were called?
Like this?
