If it is a Cane Creek, what is the model of your headset. Some of them appear to have a huge gap at the bottom which closed out (internally) by an elastomeric seal.

http://www.canecreek.com/110_headset.html

http://www.canecreek.com/headset_technology.html