It means your brake pads aren't very good. Buy some new decent ones.

A rim is worn out when the braking surface is noticeably concave. It's best to replace them before they crack and fail.