I found a contact adhesive called Seal-All at the hardware store that works pretty niftily. If you find it, it says to let it dry (solvent evaporation) for 10 minutes before you put the things-to-be-stuck-together together, but I've found that, in the case of grips, it's best to just let put them right on and then hands off.

I don't know how the stuff works with cork, though, and furthermore, it's some hyper-permanent artillery. Only way off is cutting 'em off.