Isopropyl alcohol squirted in under the grip will make them slippery enough to remove or replace easily and doesn't have to be cleaned off. Also known as rubbing alcohol.
Vodka will work in a pinch.
Steve