Your RD should not be touching the spokes. Because it is touching, and because you suggest shifting is slow to the large cog, I'd check the derailleur hanger for correct alignment. If the hanger alignment checks out okay, then possibly there's an issue with a bent derailleur cage?