I've never had removable pads that also didn't try to remove the stick-on velcro pieces that are supposed to stay stuck to the helmet, so I've quit trying to remove pads.

A few minutes with shampoo in the shower is enough for me. Hair funk is hair funk, even if it's in the helmet pads.