Jersey? no.
Jacket? iffy.
Women can get away with it, but I wouldn't be caught dead in a ....no... that ain't right.

I saw a very attractive woman wearing a Kelme jersey at the grocery store, and it looked awesome.
IMO, a man wearing a Kelme jersey would look silly.