I don't see that you're doing anything wrong. A bicycle isn't a car. Of course you can advance past stopped traffic if you have room to do so. Why wouldn't you? In fact, many of us think it's safer to do this kind of thing because it's a defensive measure. When you're up front, you can be seen. It's kind of the same as jumping the green light a little just so you don't get caught by cars turning right on you.
So a driver gets mad, so what? At least up there you can be seen and not crushed as the light or arrow changes and the road race starts.