That said, the mentality I think a lot of drivers have, is that they see a bike in front of them on the road, regardless of the speed, they need to be past it
Yes - I'm not a militant angry cyclist (most days) but this annoys me to no end, especially approaching a stop sign when someone zooms around me.
If I hear a car approaching while coming to a red light I often speed up instead of lazily coasting to a stop like normal. And take the lane more to prevent getting passed/cut off.