Thanks for all the responses.
I don't have too much of an aversion to unclipping, just when traffic starts, it can be hard to clip in and get going fast, but that kinda plays along with me not wanting to hold up traffic. If I took that extra few seconds to clip in from a stand still and go, I just feel like a nuisance blocking traffic. But I'm starting to get over that, although I am very comfortable riding in traffic.
I usually try to be as predictable as possible when I'm riding in traffic and cars are passing me, like maintaining a certain distance from the edge of the road, taking into account sewer grates so I'm not swerving when they come. I guess riding next to a car in the left turn lane was pushing it. I don't get much interaction with other bikers too much so its nice to hear some opinions on it.
And I probably won't be changing to platforms on this bike as its my dedicated road bike; my commuter bike does have platforms because its ridden in a lot of stop and go traffic.