I think you need to get a better bag. I have Ortliebs. A pain in the butt to mount and unmount but they are rock solid if mounted correctly.

I solved the mounting problem by fixing a second stem. I mount the bag to that then simply remove stem, bag and all when desired.