That's a tough one. Applying rule 5 would mean you may potentially be stuck out in the open in that left hand turn lane waiting for a chance to go if there's a lot of traffic. I don't like that kind of situation because drivers aren't always expecting a cyclist to be there.

The only way to avoid any kind of altercation in the future is to do what you're doing and wait until there's no cars coming towards you as you cross the intersection before #4.

I can see how from the driver's perspective that what you did may have seemed odd but you need to do what is the safest solution for you given the situation.