Avid does not mean fast. Some of the most avid and knowledgeable cyclists I know aren't fast roadies, but do a lot of practical riding.

Why don't you be a bigger man than you seem by tolerating the slower pace and encouraging your work colleague?

Or are you so ego-driven, as your BF name suggests, that you couldn't possibly bear to do that?