Here's an easier rule: any jersey is fine so long as it is worn with plain black shorts/bibs. Unless you are on a team, do not wear a full team kit.

Wearing a full team kit on a recreational ride is like wearing a full Yankees uniform to play softball.

Also, football, baseball, basketball, hockey, and soccer uniforms look cool. It is virtually impossible for anyone to make a cycling kit look cool.