Ask yourself do you actually use your brake and if so, how much?
Many people, like myself, just have the brake as an cautionary safety measure and don't even really use it. At least I don't. In this kinda situation I don't really see much happening to non-machined rims.