I try to signal as little as possible. If drivers know where I'm going they can aim for me. May sound paranoid, but it has happened to me more than once.
I do signal when I am slowing to make either a left or right turn. I always point with my right arm for a right turn, left for a left. At the same time, I look over my shoulder at the driver so there can be no confusion.