Depends on things like how much traffic is backed up, how soon before they can get around, whether there's a good place to pull over, etc.

I almost never do, but occasionally I'll find that someone isn't passing me when they could and the traffic is piling up behind them. In that case, I will pull off to the side.