You're fully dressed and 'decent'. So they have no grounds whatsoever for complaints.

What if you all of a sudden started complaining about the outdated fashion sense of your colleagues? You would have no grounds to stand on. It would be silly to expect your colleagues to change anything. it's equally silly of them to expect you to change anything in this case.