Aluminum is lighter and stiffer than steel. So you'll go 20mph faster on average with an aluminum frame, but if you hit a bump you might shatter your wrists or crush your spine.
Carbon will make you go even faster, but if you accidentally bang the frame against a lamp post or any other object, the frame with catastrophically explode and the shrapnel may sever your carotid artery.