I'm going to recommend you stay with slick tires, even though you have a little crushed gravel. Think about it this way, the knobs will help you a little over the small amount of gravel, and then hurt you significantly on the road, and even the hard packed dirt.
28mm is a great all around size, rolls well over rougher terrain, but still at home on the road.