Don't wear it when it's too hot. Feel more comfortable with one less thing on my body. I also wear shorts instead of bibs on these days for the same reason.

Wear it but don't look at it when it's a fast ride. Don't want to psyche out when it shoots up.

Wear it at all other times.