This may be a geographic phenomena, but in ten years of commuting I have never felt the least bit threatened by any non-motorized person.

And that includes those guys stuck in traffic who jumped out of the car and ran after me. For a few seconds.