As good as it feels to give someone the finger, it almost never improves the situation. I tend to give an arms-out shrug, sort of a "WTF?" thing, which is hard to interpret as being aggressive. It's better to be quietly assertive of your rights rather than be aggressive, since the latter isn't likely to change their opinion anyway, least of all in the heat of the moment.