I wear a helmet most of the time just because I would rather have one on my head in the event I should happen to whump my coconut against the pavement.
If it is really cold in the winter I sometimes just wear a wool beenie instead so my ears don't freeze off.
If you do not wear a helmet that is your skull and your business.