You need not worry about your AL frame. Every frame material can crack or fail (although titanium is bloody TOUGH). I have been riding aluminum for years and have never had one fail or even crack. The person who told you that is like some of the members here.....lots to say but nothing factual.
Ride your bike and don't worry.
__________________
“A good teacher protects his pupils from his own influence. ”
― Bruce Lee