with many fixie riders, the look is often the most important thing.

Helmet - never, way not cool
Carhartt pants - yes, more mandatory than any cycling shorts
chin pubes aka goatee - necessary for at least 75% of all male riders
button down SS shirt - no jerseys needed.

Personally I wear cycling gear when I'm riding my bike & commuting