Thanks for the replies and suggestions. I'm going to buy some new grease.
Go to the auto parts store and get yourself a tub of boat trailer wheel bearing grease. It is waterproof, you can use it on practically anything on a bike which needs grease (including wheel bearings!) and a tub is almost a lifetime supply.