I carry the two most common size of Allen wrenches instead of a multi-tool. You could add a small Phillips or slotted screwdriver if you think you may need them but I haven't personally in 30 years of riding. Those three tools should way less than most multi tools and do the job better.

When I did carry a multi-tool I periodically tightened the bolts on it so as not to have the problem you encountered.