For me, it's not really about being in a hurry to get to my destination. I'd just rather be riding than standing at a light, especially when there is no traffic. In some cases, when there is traffic approaching from behind but the side streets are clear, it actually seems safer to carefully proceed through a red light or stop sign. Being passed by vehicles as you negotiate an intersection, or feeling their impatience if you choose to take the lane (my usual strategy), makes me nervous. I wish we had signals that allowed cyclist to have a short head start to clear the intersection, like I've seen in Denmark.
Another point is that in some cases I'll choose a side street that parallels one of the major connectors in town to stay away from traffic. These streets have stop signs virtually every block, which is why cars don't use them to get across town. I'd rather take my chances on the busy thoroughfare than come to a complete stop every block, but being on that street annoys drivers far more than rolling stop signs on the parallel street, so I use the side street and roll cautiously through stop signs.