To the OP, yes, it affects your average speed, sometimes significantly.

I like to look at my average speed on my 20 mile commute before I head into the city. Once I hit the city, I can easily lose 1-2 mph (over the last 4 miles) due to stopping/slowing for lights. It's a helpful stat, but not that important, even if it's fun to look at.