If you are not sure if you like cycling definitely go with an aluminum bike(Such as a CAAD10). They can definitely keep up with a carbon fiber bike. And for a beginner a pound or two difference won't effect your speed much.
And no there is not a big weight difference between a high end aluminum bike and a carbon fiber bike. I say save your money and go aluminum. But if you want to start racing in the future get a carbon bike.