I do when I feel it is safe to do so.

Taking your hand of the bars to signal isn't always a great idea IMO.