Here's two racing cases where light wheels and their lower inertia work for you.

For a time trail the initial acceleration is included in the total race time. However, the "deceleration" or negative acceleration occurs after the finish line. Therefore, there's a net gain with lighter wheels for this particular event.

For a sprint to the line the acceleration occurs before the line and "deceleration" occurs after the line.