You could probably get some velcro, or even a zipper, on there- zig zag stitch for stretch-

but most folks cover the miles w/o stuff falling out. I have some cheapo jerseys, but no problems except contempt from the Rapha-wearers.

Maybe un-slam the stem?? Bigger saddle bag?