My bike has very steep seat stays, so the strap that goes to the brake bridge isn't anywhere near that long. I can see that if your panniers are all the way back it will place a lot of force on that strap. I think your best bet is to fabricate a new heavy duty strap. That or find a way to move the rack closer in to your seat tube. I'll see if I can get a pic up of my rack asap.