Valve cap is useful as it keeps dust out. If dust gets into the inner workings, it might cause the valve to leak very slowly because the little dust particles might prevent it from closing completely.
If you take them off, wheels will all-encompassinlgy be lighter tho' .