Never under-estimate the psychological aspect. If wearing some ankle weights make you more conscious of getting up and moving around a little more at work, taking the stairs instead of the elevator, going for a walk at lunch, whatever is applicable to your situation, it can be worth it just for that aspect, in my mind.

Being more active always helps you.