it improves bike handling and you actually need to have decent handling to ride on gravel. we've got hundreds of miles of gravel trails in north texas that you won't ever see a car on- that's cool too. most of the gravel trails aren't in the city so you get a since of being "out there" when you're riding.
i love gravel.