Extra bulk=extra weight, extra weight doesn't usually effect performance until the gradient starts to change in the upward direction. I think it depends on what you consider "buff" - Tone or mass?
Mass tends to slow most riders down on the incline.