I wouldn't wear it but hey, go for it.

There's always going to be someone that's going to say something under his breath about whatever you wear anyway so you might as well enjoy it. You can't please everybody.