Part of why I love being on a bike - not even a car can't really chase you effectively. You can cut down wrong-way streets, sidewalks, paths, grass, anything if necessary.
I had one guy get mad enough to speed ahead and get out, but I just rode right by with a calm wave. I didn't want to fight him (despite the U-lock in my back pocket if necessary), because its not worth it.