Get a pack of these from your auto parts store and swap the valve out from an old tube.
TR VC 2 Screwdriver Type Valve Cap - Tire caps - Tire Hardware | Miltonindustries.com
They have a version that actually is supposed to act as a seal.
Possibly, the valve may just need to be tightened.