I've got bar ends with an Allen bolt in them that expands the inside of the bar end to prevent just such an occurrence from happening.
Found a link, not the exact ones but you get the idea.
Hope Grip Doctor Plugs > Components > Grips & Tape > Bar Plugs | Jenson USA