As someone who rides in the rain a lot, I've dealt with this on a few occasions. I think some corrosion has managed to get into the electrical contacts that your unit and your handlebar mount connect with. I've heard that spraying it with some WD-40 and leaving it for a while can work. Sometimes just wiping it won't be enough if you have a substantial build up of corrosion there (as it sounds like you might)