Friction is not relevant to rolling resistance. The tires aren't sliding on either a rough or smooth surface. The extra resistance of a rougher surface is due to the wasted energy dissipated when the bike bounces up and down.