Do you want to be able to go faster or be able to prove to people that you didn't go faster?
Power meter really only matters if you are on a serious training program, and need to know all your numbers so you can make sure you are hitting your numbers and that your training program is working, and also are competing so you can set different targets at different parts of the race and make sure you are riding to the number.
A power meter might be a fun toy for a non-competitive rider, and there is nothing wrong, per se, about having more data. But will the data help you enjoy your ride more? For whom would you be collecting this data and what use would you make of it? How would it improve your life?
On a different hand, having lighter wheels should allow you to climb and accelerate more quickly---but the difference might be so slight that you couldn't even tell with out a power meter.