I find I pass them uphill more often. Not anywhere near as often on the flats.
But if I see a hill, I know it means that I have to really start pumping or I won't make it up the hill. So I'm already attacking. The roadie on the way is just icing on the cake of actually making it up the hill.