In the world of dh, skiing, snowboarding and well any other sport in similar situations, it is the responsibility of the person following to be watchful, if you are going to pass (not what you were doing) it is your responsibility. Personally, I would have gotten up and yelled at you actually. Sounds like you were too close.