I doubt if one percent of all the people I see wearing Duke University t-shirts went there. I KNOW that all those folks wearing Michael Jordan's jersey are not Michael Jordan. None of this has ever bothered me in the least.
Paul
(who usually wears either Armani or Brooks Brothers while riding, but is neither a Brooks nor an Armani)