I have a trunk bag that isn't quite a year old, but i use it mainly off road and carried it through some nasty winter weather this year. It uses velcro and is very secure on the rack. I see no signs of wear at all.

Perhaps you just need a better trunk/velcro straps.