It doesn't take very long for a car to overtake a slow moving vehicle, so it generally doesn't bother me if someone does it on a double yellow. I think it's probably more dangerous to try to thwart a motorists efforts to pass than to allow the driver to choose when it's safe to pass.