I have never broken any aluminum nipples either, and no brass ones since I was a kid on bmx bikes. I have been riding for more than 30 years. I think build quality and proper tension are much more important than nipple material choice.
Besides aluminum nipples come in cool colors just make sure they are lubed so so they don't oxidize themselves to the spokes.
I must be doing it wrong too