Calv is right on all counts but the most important reason is vibration dampening. Think of a tuning fork made of aluminum:

designed to resonate a note and ring for a pretty long time. If you were to make a tuning fork out of carbon, it would just "clunk" when you hit it and have very little vibration and as a result, no resonating sound. Now translate that same thing to a bike fork.