People that don't know anything much about cycling won't pay attention to what you wear.
People that know all about cycling should be able to recognize that the ****er next door isn't on a pro team, so no confusion there.
Figure if they sell it in stores, they mean for people to buy it, and you won't be the only one wearing it. If it was meant for team members only, then they'd only sell it to team members.