I leave the helmet pads in place just to ensure that I don't lose any of them. I wash/rinse out my helmet only once a week. I have never experienced a particular smell from my helmet. We have lots of rain this time of year in Hawaii, so I want to minimize the chance of something growing in there by keeping it clean.....and I might be a little weird about cleanliness...haha