Yes, but only with major noises... like when my performance shoe covers were squeaking with every revolution, or a dragging brake rotor. I don't care so much about things like chain noise.

I do love the quiet of the fixed gear though...