In most if not all states a bicycle is considered a vehicle, meaning a cyclist is supposed to obey the same traffic laws as a motorist. If you were in a car or on a motorcycle would you work your way to the front? NO. Wait your turn at an intersection just as if you were in a car.
When I was bike commuting I saw this guy who lived in my neighborhood do what you describe when we were both about a mile from our subdivision. I waited my turn and watched as the motorists he "passed" honk and yell at him. He never understood why they did that. I tried explaining it to him one afternoon but he just couldn't or wouldn't understand.