It is time for a new rim. It is either caused from flaws in the rim, or rim wear from caliper brakes that people that dont like disc brakes says almost never happens.