I can never ride no hands if I have anything on my bike that's no on the other. My 2 lb lock makes me drift to the side. It probably does effect the bikes balance. But no where near the point where your coworkers is expecting the change to be.