Go with brass nipples. The durability issue isn't about rider weight, it's about aluminum nipples having a tendency to round over after a time, often because the nipples have become very difficult to turn, and a spoke wrench will no longer turn them. The weight savings is minimal, I don't know exactly how much you'd save but the two ounces you mention sounds like more than it would be to me-