I wear it during TT's. Fred or not, it helped drop my times and put me in the top couple of spots. I don't break position to take any drinks(yeah yeah, drinking is for *******). A friend of mine wears it for crits and he's a solid 2.
You can wear what you want when you can back it up.