Only a valid comparison if you're drafting on both or not drafting on both. If you got dropped, you lose the draft, and there's pretty much most of the missing 2-3mph.
My drafted rides which are not even as hard as my solo efforts typically average 2mph faster than my solo rides, which are actually done at a harder overall effort.