It is the responsibility of the person doing the overtaking to do so in a safe manner. If a driver attempting a pass has to drive into the ditch (or forces oncoming traffic into it) they are breaking the law, and creating a dangerous situation. That those they are overtaking may be breaking the law is immaterial.
Cool thing is, the OP understands this.