Austin, Tx. Probably the largest 'college town' in the country.
The entire metro area is easily accessible and has some nice rolling hills for a good workout. Serious riders have a whole lot of options when you head west a little bit, from long road rides to aggressive downhills.
Great weather means you can ride year-round with little problems. I couldn't recommend it enough.
Cheers