Lighter wheels accelerate faster, which can be noticable. Unless you're riding up steep hills and nothing else it won't make much difference in terms of overall speed. It depends what you value and why you're riding the bike. If it's for fun and pleasure, pushing down on the pedal and feeling the bike move more immediately is satisfying.